Azure DevOps TestComplete Re-run failed test cases does not work

This is a known issue when using Azure DevOps' “rerun failed tests” feature with the TestComplete Test Adapter. Azure filters reruns with:

/TestCaseFilter:"FullyQualifiedName=ProjectSuite.TestItem:Project\\TestCaseName"

But this format often doesn't align with how TestComplete identifies test cases, so reruns fail with "no tests found." The adapter doesn't currently support using ~ (contains) or partial matching in FullyQualifiedName.

Workarounds:

1. Custom rerun logic:
   Parse the first run’s results (.trx or JUnit) to get failed tests, then re-run them in a separate step using filters the adapter supports (e.g. tags or test item names).
2. Use TestComplete’s built-in retry:
   Configure retries directly in the Execution Plan (On error → rerun current item).
3. Check with SmartBear:
   While you're likely on a recent version, SmartBear can confirm if recent adapter updates improve rerun behavior or support more flexible filtering.

Docs:
Test Adapter Setup
Tag-Based Filtering Setup

🤖 AI-assisted response
👍 Found it helpful? Click Like
✅ Issue resolved? Click Mark as Solution