Ask a Question

TestComplete Azure re-run failed tests

SOLVED
tphillips
Frequent Contributor

TestComplete Azure re-run failed tests

Hi

 

I am running TestComplete tests in Azure using the TestComplete test adapter. I noticed that the Visual Studio Test task has an option to re-run failed tests (much like the recently added feature for TestComplete).

However when I enable this option the pipeline errors out when trying to re-run any tests, saying that it couldn't find any tests to run.

It runs the tests again with the filter

FullyQualifiedName=<ProjectSuite>.testitem:<Project>\\<test case name>

Which I think it doesn't understand.

 

Is there a way to make the azure pipeline re-run the failed the tests, the same way that TestComplete itself can?

 

I am thinking I might have to change to just call TestExecute from a script, but I don't know if TestExecute can export JUnit to be consumed by the pipeline. From what I can tell, Smartbear recommends to use TestComplete test adapter with Visual Studio Test


--------------------
Senior SQA Automation Engineer
5 REPLIES 5
AlexKaras
Community Hero

Hi,

 

I would recommend to ask Support directly via the https://support.smartbear.com/message/?prod=TestComplete form.

I also will appreciate it if you update this thread with their reply.

 

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================
tphillips
Frequent Contributor

I created a support ticket and so far have got a response saying they're looking into it:

 

"Thank you for creating a case!

We are looking into this issue. I will let you know when I have an update.

Thank you!"

 

I will post any further replies here


--------------------
Senior SQA Automation Engineer
tphillips
Frequent Contributor

New update:
"Our developers think this may be a bug on the Microsoft end. They filed a ticket to find out what might be happening. I will let you know when we hear from them."


--------------------
Senior SQA Automation Engineer
tphillips
Frequent Contributor

Got a response today:

"Sorry for the delay.

Our developers were able to make a workaround to make this feature work in Azure DevOps. This workaround will be included in the next release of TestComplete test adapter. This next release should be out sometime Thursday. Make sure to upgrade the TestAdapater extension and see if you run into any problems.

Thank you!"

 

I will test it out next week and check if it works 😄


--------------------
Senior SQA Automation Engineer
sonya_m
SmartBear Alumni (Retired)

@tphillips Thank you for keeping us in the loop! Did you get a chance to try this out?🙂

Let me mark this as a temp solution, feel free to update this thread!


Sonya Mihaljova
Community and Education Specialist

cancel
Showing results for 
Search instead for 
Did you mean: