Hello
the two questions are somewhat related.
TestComplete offers a nice reporting tool including summary with some basic stats, graph etc. (That was, in fact, one of the deciding point for me to use the tool, we code everything otherwise ourselves)
However, to get such summary one needs to run the entire test suite with the test items structured as per: http://support.smartbear.com/viewarticle/55015/?aliaspath=/viewarticle and requires us to add tests as test items manually ( as per another forum discussion)
From the command line, one can execute the entire test suite and in that case, the summary page is available.
With all other options available in: http://support.smartbear.com/viewarticle/55587/?aliaspath=/viewarticle it seems that the a) summary page is not available and b) it is impossible to execute a "group of test items", unless I am missing something.
At the moment, I ask our test developers to add manually each test into a specific group of test items for the project as well as into a method that allows us to execute just a specific group of tests. This may introduce additional errors once we have more tests and more test developers
I need a flexibility of executing all tests in a project or certain groups of tests depending on a requirement.
Ideally I would like to do it all programatically and still take advantage of the reporting tool that TestComplete has to offer.
Note, that I do not want to introduce separate projects for each requirement as some of the tests overlap and common libraries are used
( for the common libraries the plan is to introduce extensions eventually, but the team and our project is not mature enough just yet )
Please, let me know, if more explanation is needed. A possible user case is:
As a user I would like to combine existing tests any way I want, exdecute these combinations and get the full test report with summary and stats for it.