cancel
Showing results for 
Search instead for 
Did you mean: 

How to integrate TestComplete to Azure DevOps?

SOLVED
New Contributor

How to integrate TestComplete to Azure DevOps?

Hi Community

 

Currently I am trying to integrate TestComplete to an azure devops pipeline. To run the tests i have set up a virtual machine (not azure) where my TestComplete project-files are located and where TestExecute is installed. 

 

So far I managed it to execute my tests via self hosted azure-agent (vsts-agent) with a simple batch command. But now I am facing these two major problems/questions:

  • How can I run the tests with an interacitve user session?
  • And even more important: How can I parse the results in my buildplan, to see if the build (depending on tests) is failed or not?

I  have read these two articles regarding CI systems and test results, but I don't know how to use this information in my case.

A while ago I tried the same setup with jenkins and there it was no big deal for me. Unfortunately there is no such good documentation around for Azure DevOps.

 

I hope this all makes sense to you, since it's my very first post here and I'm not that experienced with TestComplete.

 

Thanks, Christian

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
New Contributor

Re: How to integrate TestComplete to Azure DevOps?

Hi

Meanwhile i found a suitable solution for my problem. Maybe this helps anyone getting started with azure and TC. Here is what i did:

  • In azure devops pipeline i used the visual studio test task where I reference the ".tc12Test" file. Important was to add the specific path to vstest.console.exe on the remote machine.
  • On my testmachine first I had to install the vsts-agent (not as service) to perform build jobs. The next step was to install the MS Visual Studio Test Agent (standalone). To make it understand testcomplete tests, it is necessary to install the TestComplete integration package (Test Agent version VS2017)
  • In Visual Studio I configured the tc12Test for VS test agent. This is well documented here: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/add-tc-tests.html

These are the basic steps i did. In my case I also had to tweak some windows settings to make the agent more stable.

 

Regards, Christian

 

 

 

5 REPLIES 5
Community Hero

Re: How to integrate TestComplete to Azure DevOps?

Hi Christian,

 

Far not sure as for Azure, but hopefully a set of AWS-related articles from the https://support.smartbear.com/articles/testcomplete/ page would help:

-- https://support.smartbear.com/articles/testcomplete/cloud-testing-with-testcomplete

-- https://support.smartbear.com/articles/testcomplete/preparing-cloud-env-for-automated-testing

-- https://support.smartbear.com/articles/testcomplete/simplifying-deployment-test-machines-cloud-testi...

-- https://support.smartbear.com/support/articles/testcomplete/using-elastic-ips-for-cloud-testing

-- https://support.smartbear.com/articles/testcomplete/cloud-testing-using-different-regions

-- https://support.smartbear.com/articles/abs/cloud-test-automation-tutorial

 

Regards,
Alex
[Community Expert Group]
____
[Community Expert Group] members are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Postings made by [Community Expert Group] members
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
[Community Expert Group] signature is used with permission by SmartBear Software.
http://smartbear.com/forums/f83/t86934/community-experts/
================================
New Contributor

Re: How to integrate TestComplete to Azure DevOps?

Hi Alex

 

Thank you for your quick answer and for the articles (and telling me about the article page). They are very interesting but unfortunately dont contain the solution I was looking for. I was searching for a more generic approach for integrating TestComplete to my azure build job. Something like running tests, collect and publish results without various tools. But maybe I was thinkig too much in the "jenkins way". Meanwhile i think I have to do it somehow like this: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/team-builds/defin...

 

What do you think about it? I was also wondering as well, if there is anyone out there already using Azure DevOps and TestComplete?

 

Many thanks & regards,

Christian

Highlighted
New Contributor

Re: How to integrate TestComplete to Azure DevOps?

Hi

Meanwhile i found a suitable solution for my problem. Maybe this helps anyone getting started with azure and TC. Here is what i did:

  • In azure devops pipeline i used the visual studio test task where I reference the ".tc12Test" file. Important was to add the specific path to vstest.console.exe on the remote machine.
  • On my testmachine first I had to install the vsts-agent (not as service) to perform build jobs. The next step was to install the MS Visual Studio Test Agent (standalone). To make it understand testcomplete tests, it is necessary to install the TestComplete integration package (Test Agent version VS2017)
  • In Visual Studio I configured the tc12Test for VS test agent. This is well documented here: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/add-tc-tests.html

These are the basic steps i did. In my case I also had to tweak some windows settings to make the agent more stable.

 

Regards, Christian

 

 

 

Community Hero

Re: How to integrate TestComplete to Azure DevOps?

Hi Christian,

 

Excuse me for overlooking your previous message and not replying to it. (Though I did not use Azure yet, thus I am doubting that I could be able to reply with something meaningful... Smiley Happy )

 

Thank you a lot for the update to this thread with your real experience. Much appreciated.

 

@TanyaGorbunova, @HKosova: Could you please consider, ladies, to create help article and/or some other article based on Christian's message?

 

Regards,
Alex
[Community Expert Group]
____
[Community Expert Group] members are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Postings made by [Community Expert Group] members
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
[Community Expert Group] signature is used with permission by SmartBear Software.
http://smartbear.com/forums/f83/t86934/community-experts/
================================

Re: How to integrate TestComplete to Azure DevOps?

Hi everyone!

 

TestComplete does natively integrate with Azure Devops, I just wanted to ensure that anyone looking for this integration has the latest documentation link -  https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/index.html

 

Thanks,

Prashant

 

New Here?
Join us and watch the welcome video:
Join the September Hub-bub to show off, learn and win