TestComplete run test in Azure pipeline successfully but no result

[jesseejames]

I try to run a simple TestComplete UI test (open google in browser and search something), and run as part of Azure Pipelines, so I followed the documentation on "Run TestComplete Tests as Part of Pipeline"(Run TestComplete Tests as Part of a Pipeline | TestComplete Documentation (smartbear.com))

I created a pipeline, with self-hosted agent (also try it in interactive agent)

Added a "Visual Studio Test" task, using "Test assemblies", try to find all **\*.pjs files 

The task did run successfully, it tries to run the .pjs files, and it did find "A total of 1 test files matched the specified pattern."

and it did publish the test result, create a test run, successfully.

But, it actually didn't run any test, 0/0 test has been executed. The test result is empty. 

I have attached screen shot to help explain the issue.

I thank you in advance and appreciate any advice at this point. 

[rraghvani]

I do have to ask...does your project contain any tests and execution plan!?

[jesseejames]

yes, it does have some simple tests, (open browser and search Google.com, search something and hit enter ), I can run the test manually in the self hosted agent, but it just can't be run by azure pipeline, (or it did run, but just not run the actual test)

[AlexKaras]

Hi,

Just to be on the safe side - can you double-check and confirm that interactive user session exists on the agent machine when the agent runs the test? (I.e. whether the agent was configured to start and execute as an application, not as a service.)

[jesseejames]

hi AlexKaras, thank you for your response, yes I can confirm the interactive user session is being used during the testing. It does run as part of the pipeline, we can see timestamp of agent is running, it just the actual test is not executed.

I can manually run the test in the agent, and it runs fine. 

I can also use command line to execute "TestComplete.exe "E:\azagent-staging\_work\r1\a\_TCPipelineTest\drop\TestProject1\TestProject1.pjs" /r /p:TestProject1"

please advice how to trouble shoot, thank you.

[rraghvani]

Can you verify your \TestResults folder has files? And it includes results?

See https://stackoverflow.com/questions/60203610/publishing-xunit-test-results-in-azure-devops-fails-wit.... 

[jesseejames]

Hi yes I can verify the TestResult has file, some "xxxx_xxxx_timestamp.trx" file with only 2k size, and 0/0 test being run.

what other reason could cause the test Not being run?? 

[rraghvani]

The file(s) exists, ok. Does it include results?

[jesseejames]

Yes and no. The test result trx file does exist, but it said "0/0 tests has been run". So I would think the test actually didn't get run. 

if it did run, then it supposed to said "2/2 test has been run"... or something like that. 

[rraghvani]

It seems like you don't have any test execution plans set up, or TestComplete/TestExecute installed 😕

Might be worth going through https://support.smartbear.com/testcomplete/docs/working-with/integration/azure/test-adapter/index.ht... again, and ensure nothing is missed out.