How to integrate TestComplete to Azure DevOps?

[c_lau]

Hi Community

Currently I am trying to integrate TestComplete to an azure devops pipeline. To run the tests i have set up a virtual machine (not azure) where my TestComplete project-files are located and where TestExecute is installed. 

So far I managed it to execute my tests via self hosted azure-agent (vsts-agent) with a simple batch command. But now I am facing these two major problems/questions:

• How can I run the tests with an interacitve user session?
• And even more important: How can I parse the results in my buildplan, to see if the build (depending on tests) is failed or not?

I  have read these two articles regarding CI systems and test results, but I don't know how to use this information in my case.

• https://support.smartbear.com/testcomplete/docs/working-with/integration/continuous-integration-syst...
• https://support.smartbear.com/testcomplete/docs/testing-with/log/working-with/index.html

A while ago I tried the same setup with jenkins and there it was no big deal for me. Unfortunately there is no such good documentation around for Azure DevOps.

I hope this all makes sense to you, since it's my very first post here and I'm not that experienced with TestComplete.

Thanks, Christian

[AlexKaras]

Hi Christian,

Far not sure as for Azure, but hopefully a set of AWS-related articles from the https://support.smartbear.com/articles/testcomplete/ page would help:

-- https://support.smartbear.com/articles/testcomplete/cloud-testing-with-testcomplete

-- https://support.smartbear.com/articles/testcomplete/preparing-cloud-env-for-automated-testing

-- https://support.smartbear.com/articles/testcomplete/simplifying-deployment-test-machines-cloud-testi...

-- https://support.smartbear.com/support/articles/testcomplete/using-elastic-ips-for-cloud-testing

-- https://support.smartbear.com/articles/testcomplete/cloud-testing-using-different-regions

-- https://support.smartbear.com/articles/abs/cloud-test-automation-tutorial

[c_lau]

Hi Alex

Thank you for your quick answer and for the articles (and telling me about the article page). They are very interesting but unfortunately dont contain the solution I was looking for. I was searching for a more generic approach for integrating TestComplete to my azure build job. Something like running tests, collect and publish results without various tools. But maybe I was thinkig too much in the "jenkins way". Meanwhile i think I have to do it somehow like this: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/team-builds/defin...

What do you think about it? I was also wondering as well, if there is anyone out there already using Azure DevOps and TestComplete?

Many thanks & regards,

Christian

[c_lau · Accepted solution]

Hi

Meanwhile i found a suitable solution for my problem. Maybe this helps anyone getting started with azure and TC. Here is what i did:

• In azure devops pipeline i used the visual studio test task where I reference the ".tc12Test" file. Important was to add the specific path to vstest.console.exe on the remote machine.
• On my testmachine first I had to install the vsts-agent (not as service) to perform build jobs. The next step was to install the MS Visual Studio Test Agent (standalone). To make it understand testcomplete tests, it is necessary to install the TestComplete integration package (Test Agent version VS2017)
• In Visual Studio I configured the tc12Test for VS test agent. This is well documented here: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/add-tc-tests.html

These are the basic steps i did. In my case I also had to tweak some windows settings to make the agent more stable.

Regards, Christian

[AlexKaras]

Hi Christian,

Excuse me for overlooking your previous message and not replying to it. (Though I did not use Azure yet, thus I am doubting that I could be able to reply with something meaningful... 🙂 )

Thank you a lot for the update to this thread with your real experience. Much appreciated.

@TanyaYatskovska, @HKosova: Could you please consider, ladies, to create help article and/or some other article based on Christian's message?

[prashantmohan]

Hi everyone!

TestComplete does natively integrate with Azure Devops, I just wanted to ensure that anyone looking for this integration has the latest documentation link -  https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/index.html

Thanks,

Prashant