Forum Discussion

NonFunctional's avatar
8 years ago

Running TE with a list of tests

Hi,

 

I've spent some time trying to find a way to run TE with a list of tests passed in via the command line.

 

The only options I have seen so far are:

1) Use VBScript or JavaScript: https://support.smartbear.com/viewarticle/54654/

2) Create some bespoke code to process a XML file: https://community.smartbear.com/t5/Functional-Web-Testing/Possible-to-run-an-execution-list-of-Testcomplete-Project-with/m-p/85272/highlight/true#M19767

3) Create a series of batch files, one per test, and call this via a "master" batch file

 

To be honest, there appears to be little benefit to use option 1 or option 3 and option 2 is beyond my current development skills.

 

Given that some of the forum posts and suggestions are a few years old, it would not be unreasonable to expect this kind of functionality from the latest version of the software. Do I have to raise a product request for this?

 

In the mean time I think my only option is to go with the series of batch files although this is inefficient and prevents me from easily returning an overall exit code from TE for the set of specified tests.

 

Editing the TC project is not an option as this needs to remain untouched for our CI. We just need to give testers the option to run specific tests on demand.

 

If there is another option that I have not come across yet please do let me know.

 

Thanks,

 

John

2 Replies

  • AlexKaras's avatar
    AlexKaras
    Champion Level 3

    Hi John,

     

    Unfortunately, the situation has not been changed in this area - it is still not possible to execute a test item or a set of test items from command line. The only real possible options are either script mentioned by you as option a) (or, maybe a little more handy https://support.smartbear.com/viewarticle/54655/ one) or to create a driver program using any regular programming language so that this driver instantiates an instance of TestComplete's COM object and command it to execute this or that test item. (Yes, this functionality is accessible via COM.)

  • What's the organization of your tests? Different project suites? One suite with multiple projects? One project with multiple test items?

     

    We have a setup where the test itself determines what needs to be tested based on different criteria. So from the command line, we send in things like an environment, client name, etc., and whether we're running an entire project suite, or a single project. Then within each project, the test items determine whether they need to be executed based on the command line parameters and what is found on the screen.

     

    Kicking off tests in an automated way, and knowing what tests to run has been a negative for TestComplete for some time. We've figured out workarounds, but it'd be nice if more was supported out of the box.