Forum Discussion

Venugopal2's avatar
Venugopal2
New Contributor
4 years ago
Solved

Azure Devops is not executing the Test items which are not marked as Testcase in Testcomplete.

I am using Testcomplete v14.10,  To integrate with Devops, i am using Visual Studio Test Task in my pipeline.  Visual Studio Test Task settings is attached. (Refer -VSTest_setting.JPG).  In my  Test items page, I have a group. in which 2 child Items are enabled, First enabled child item is marked as Testcase & the second one is not marked as testcase, (Refer -Testitems.JPG) . Also the second enabled test-item is linked with a script which uses  aqTestCase.Begin& aqTestCase.End commands. ( Since the number of testcases associated with this item is dynamic). 

Now after Execution of the Test cases from Devops, the pipeline displays a report which has only the log of First Test item. (Refer -Summary.jpg).

Can someone help me, what can be done to display the full log.?. ( Note : i dont want to mark the second test-item as Testcase, since it has some pretasks as well. i dont want the log of pretask to be considered as test case)

Test Results
  • JuliaBernikova's avatar
    JuliaBernikova
    4 years ago

    Hi Venugopal2,

     

    Thank you for attaching the screenshots.

     

    By design, the TestComplete Test Adapter can only discover TestComplete test items that are marked as test cases, so the behavior you observe is expected. Thus, making the "Regression_Tests" item a test case is the only way to run it from Azure DevOps. You mentioned that "Regression_Tests" uses the aqTestCase methods for creating dynamic test cases and running some pre-tasks. However, dynamic test cases are not supported in Azure DevOps - "Regression_Tests" and everything it runs will always be shown as a single test case there. We'll review our documentation to see if we can explicitly mention it.

     

    Also, please note that by default the adapter runs all test cases, no matter if they are enabled or disabled. So, to be sure no disabled test cases will ever be run, you can use this filter syntax: Enabled=True.

     

2 Replies

Sort By
  • JuliaBernikova's avatar
    JuliaBernikova
    SmartBear Alumni (Retired)
    4 years ago

    Hi Venugopal2,

     

    Thank you for attaching the screenshots.

     

    By design, the TestComplete Test Adapter can only discover TestComplete test items that are marked as test cases, so the behavior you observe is expected. Thus, making the "Regression_Tests" item a test case is the only way to run it from Azure DevOps. You mentioned that "Regression_Tests" uses the aqTestCase methods for creating dynamic test cases and running some pre-tasks. However, dynamic test cases are not supported in Azure DevOps - "Regression_Tests" and everything it runs will always be shown as a single test case there. We'll review our documentation to see if we can explicitly mention it.

     

    Also, please note that by default the adapter runs all test cases, no matter if they are enabled or disabled. So, to be sure no disabled test cases will ever be run, you can use this filter syntax: Enabled=True.