cancel
Showing results for 
Search instead for 
Did you mean: 

TestComplete Azure re-run failed tests

SOLVED
tphillips
Community Leader

TestComplete Azure re-run failed tests

Hi

 

I am running TestComplete tests in Azure using the TestComplete test adapter. I noticed that the Visual Studio Test task has an option to re-run failed tests (much like the recently added feature for TestComplete).

However when I enable this option the pipeline errors out when trying to re-run any tests, saying that it couldn't find any tests to run.

It runs the tests again with the filter

FullyQualifiedName=<ProjectSuite>.testitem:<Project>\\<test case name>

Which I think it doesn't understand.

 

Is there a way to make the azure pipeline re-run the failed the tests, the same way that TestComplete itself can?

 

I am thinking I might have to change to just call TestExecute from a script, but I don't know if TestExecute can export JUnit to be consumed by the pipeline. From what I can tell, Smartbear recommends to use TestComplete test adapter with Visual Studio Test


--------------------
QA Systems Architect
1 ACCEPTED SOLUTION

Accepted Solutions
tphillips
Community Leader

Re: TestComplete Azure re-run failed tests

Got a response today:

"Sorry for the delay.

Our developers were able to make a workaround to make this feature work in Azure DevOps. This workaround will be included in the next release of TestComplete test adapter. This next release should be out sometime Thursday. Make sure to upgrade the TestAdapater extension and see if you run into any problems.

Thank you!"

 

I will test it out next week and check if it works 😄


--------------------
QA Systems Architect

View solution in original post

5 REPLIES 5
AlexKaras
Community Hero

Re: TestComplete Azure re-run failed tests

Hi,

 

I would recommend to ask Support directly via the https://support.smartbear.com/message/?prod=TestComplete form.

I also will appreciate it if you update this thread with their reply.

 

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================
tphillips
Community Leader

Re: TestComplete Azure re-run failed tests

I created a support ticket and so far have got a response saying they're looking into it:

 

"Thank you for creating a case!

We are looking into this issue. I will let you know when I have an update.

Thank you!"

 

I will post any further replies here


--------------------
QA Systems Architect
tphillips
Community Leader

Re: TestComplete Azure re-run failed tests

New update:
"Our developers think this may be a bug on the Microsoft end. They filed a ticket to find out what might be happening. I will let you know when we hear from them."


--------------------
QA Systems Architect
tphillips
Community Leader

Re: TestComplete Azure re-run failed tests

Got a response today:

"Sorry for the delay.

Our developers were able to make a workaround to make this feature work in Azure DevOps. This workaround will be included in the next release of TestComplete test adapter. This next release should be out sometime Thursday. Make sure to upgrade the TestAdapater extension and see if you run into any problems.

Thank you!"

 

I will test it out next week and check if it works 😄


--------------------
QA Systems Architect

View solution in original post

sonya_m
Community Manager

Re: TestComplete Azure re-run failed tests

@tphillips Thank you for keeping us in the loop! Did you get a chance to try this out?🙂

Let me mark this as a temp solution, feel free to update this thread!


Sonya Mihaljova
Community and Education Specialist

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others. ⬇️⬇️⬇️
New Here?
Join us and watch the welcome video:
Announcements