Ask a Question

Test Results

SOLVED
Mark1
Contributor

Test Results

I have a script which calls a lot of tests from other scripts, lets call this a master script. I have around 8 master scripts which can contain anywhere from 20 to 80 individual tests. I have distributed testing set up and I have my different master scripts as my tasks so instead of having to call loads and loads of tasks per job I just need to call the one master script for that particular job. 

The problem is my results dont reflect the amount of tests actually ran. Since I only run 8 master scripts thats all it says actually ran, instead of the 200+ it should say. Is there any setting or way to have my results display the actual number of tests ran without having to have a load of tasks in each jobs in place of a master script?

The first image is what our results look like and the second is a small example of what I mean by master script where its one script calling all related tests.

results covered.png

test.png

3 REPLIES 3
tristaanogre
Esteemed Contributor

The log summary you see gives the report on TestItems... these are individual items set up in a project for execution.  They do NOT equate to actual tests. Notice that even the summary makes the distinction of calling them "test items", not individual tests.  

If you want to see a "number of tests run", you'll have to write a custom output of some sort, especially since you're tests are not the same as test items.  Our automation is driven from SQL and, after each test we write a record to an SQL table indicating pass or fail of the specific test.


Robert Martin
[Hall of Fame]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available
AlexKaras
Community Hero

Hi,

 

Another option is to consider TC 14.1 Beta that makes it possible to define a kind of test case from within test code and see these test cases as a separate items in the Summary test log.
https://community.smartbear.com/t5/TestComplete-General-Discussions/TestComplete-14-1-beta/td-p/1823...

 

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================

Thanks, I will wait for this feature to exit beta but it sounds like exactly what I will need.

cancel
Showing results for 
Search instead for 
Did you mean: