johnc_1
New Contributor
Joined 12 years ago
User Profile
User Widgets
Contributions
export run results including images
Our development team wants to be able to more easily view the results of scheduled TestComplete tests run as scheduled items in QAComplete, particularly failed ones. In QAComplete, I can open the Test or Test Set, click the icon for View Report..which opens my browser and shows the panels for the log tree, test log and another panel which includes screen image as appropriate. I would like to make this page/image easily accessible, but not sure if there is a specific file on the server to look at or if there is a way to export the Report to pdf. I cannot yet access our server folder where the html url is pointing, i.e. http://devqa/FileExchange/Temp/2018041214583039/index.htm , but would that be the folder area to open access to developers?Re: Maximum number of simultaneous scenarios to run
Perhaps it might help if I provided some detail of our application. It is a web based software package for the administrative side of K-12 schools...ranging from student and family demographics information, student data (attendance, schedules, health, discipline, standardized test results, etc), teacher gradebooks (and attendance taking by teachers), family and student portal to the student information. So, during the course of a day, the list of activities occurring that could reasonable need scenarios built include: Enrolling/registering students and updating data - 200-300 users Maintaining and creating student class schedules - 200-300 users Discipline offense and response entry - 200-300 users Viewing student data in the administrative portal - 300-500 users Accessing/updating historical data such as grades, enrollments (db reads) - 200-300 Teacher entry of absences in their class - 2000 (not all concurrently in groups, such as all H.S. teachers) Teacher creation of grading assignments and updating of assignments - 2000 users throughout day Reports of data - 100-300 users Viewing of student data with some update options by parents - 40,000 potentially over course of day Viewing of student data with some update options by parents - 75,000 potentially over course of day With that type of real world activity, 1. While we can generate scenarios and parameterize entries, is it realistic to run such a test continually over an 8 hour day cycle? 2. With at least 10 parameterized scenarios running continuously, will monitoring of the activity as well as interpretation of the results become too massive...other than to determine whether such activity reaches the max stress point. Does that help?...Maximum number of simultaneous scenarios to run
We have a client who is requesting that we run 50 different scenarios, simultaneously over the course of 8 hours, to simulate their real world activity. These scenarios mostly would be 10-15 step sequences, all starting from a log in screen with significant security validations. Before we go too far down this road, wondering if anyone can comment on what they feel is a typical number of scenarios to run is in order to appropriately test the system's performance. Or, from the perspective of monitoring and evaluation of results, what would be the maximum to run at the same time. Thanks in advance.How to follow up on failed test run
As a manager overseeing multiple teams of staff running manual tests within test sets, I want to be able to identify tests which fail (against a given release and environment) yet which are subsequently tested and pass, without having to monitor (via report or searches) failed tests, then opening the test record manually and looking for any successful test runs after the fail. Along the same line, I also need to monitor those tests which failed and haven't yet been re-run yet, or which have re-run and haven't passed yet. Any suggestions?...I'd be willing to entertain suggestions using Crystal reports if someone can provide some details. Thanks.Speed up linking of tests to configurations
There are only 2 ways to link a test to a configuration...either 1. select the test (or test set), open the link to items, select the configuration folder, and check each sub item (e.g. Windows8>IE, and Chrome and Firefox), repeating for each config folder. 2. select the configuration, open the link to items, specify type and folder, and individually check every item (test) in the folder. Repeat for every configuration. Even with just a few Windows environments, each with 3 or 4 different browsers, times our 2500 tests, and this is a monumental task. While we could have done it as we created tests, our focus was on creating the tests, and not linking..that was a mistake. However now, we need to make these links, yet we are looking at nearly 10,000 clicks/steps. If nothing else, in the selection of tests (or sets) drop down, add a "Select All" to check all tests in that folder. Then we would just need to repeat for each Configuration, each folder...a much more manageable task.Add ability to clone release
We have about 2500 tests at this time. As the process of connecting that many tests, even organized into test sets, is cumbersome (creating another suggestion for that issue), it would extremely helpful to be able to clone a release or iteration to another release or iteration, and carry across the linked items (we only use tests, not sprints or requirements). That way, even though I would have to manually link all the tests to a release, at least for the next release, I could clone and be done, and just add any new tests (or test sets).
