Ask a Question

How to integrate TestComplete to Azure DevOps?

SOLVED
c_lau
New Contributor

How to integrate TestComplete to Azure DevOps?

Hi Community

 

Currently I am trying to integrate TestComplete to an azure devops pipeline. To run the tests i have set up a virtual machine (not azure) where my TestComplete project-files are located and where TestExecute is installed. 

 

So far I managed it to execute my tests via self hosted azure-agent (vsts-agent) with a simple batch command. But now I am facing these two major problems/questions:

  • How can I run the tests with an interacitve user session?
  • And even more important: How can I parse the results in my buildplan, to see if the build (depending on tests) is failed or not?

I  have read these two articles regarding CI systems and test results, but I don't know how to use this information in my case.

A while ago I tried the same setup with jenkins and there it was no big deal for me. Unfortunately there is no such good documentation around for Azure DevOps.

 

I hope this all makes sense to you, since it's my very first post here and I'm not that experienced with TestComplete.

 

Thanks, Christian

5 REPLIES 5
AlexKaras
Champion Level 3

Hi Christian,

 

Far not sure as for Azure, but hopefully a set of AWS-related articles from the https://support.smartbear.com/articles/testcomplete/ page would help:

-- https://support.smartbear.com/articles/testcomplete/cloud-testing-with-testcomplete

-- https://support.smartbear.com/articles/testcomplete/preparing-cloud-env-for-automated-testing

-- https://support.smartbear.com/articles/testcomplete/simplifying-deployment-test-machines-cloud-testi...

-- https://support.smartbear.com/support/articles/testcomplete/using-elastic-ips-for-cloud-testing

-- https://support.smartbear.com/articles/testcomplete/cloud-testing-using-different-regions

-- https://support.smartbear.com/articles/abs/cloud-test-automation-tutorial

 

Regards,
  /Alex [Community Champion]
____
[Community Champions] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Champions]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Champion] signature is assigned on quarterly basis and is used with permission by SmartBear Software.
https://community.smartbear.com/t5/Community-Champions/About-the-Community-Champions-Program/gpm-p/252662
================================

Hi Alex

 

Thank you for your quick answer and for the articles (and telling me about the article page). They are very interesting but unfortunately dont contain the solution I was looking for. I was searching for a more generic approach for integrating TestComplete to my azure build job. Something like running tests, collect and publish results without various tools. But maybe I was thinkig too much in the "jenkins way". Meanwhile i think I have to do it somehow like this: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/team-builds/defin...

 

What do you think about it? I was also wondering as well, if there is anyone out there already using Azure DevOps and TestComplete?

 

Many thanks & regards,

Christian

c_lau
New Contributor

Hi

Meanwhile i found a suitable solution for my problem. Maybe this helps anyone getting started with azure and TC. Here is what i did:

  • In azure devops pipeline i used the visual studio test task where I reference the ".tc12Test" file. Important was to add the specific path to vstest.console.exe on the remote machine.
  • On my testmachine first I had to install the vsts-agent (not as service) to perform build jobs. The next step was to install the MS Visual Studio Test Agent (standalone). To make it understand testcomplete tests, it is necessary to install the TestComplete integration package (Test Agent version VS2017)
  • In Visual Studio I configured the tc12Test for VS test agent. This is well documented here: https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/add-tc-tests.html

These are the basic steps i did. In my case I also had to tweak some windows settings to make the agent more stable.

 

Regards, Christian

 

 

 

AlexKaras
Champion Level 3

Hi Christian,

 

Excuse me for overlooking your previous message and not replying to it. (Though I did not use Azure yet, thus I am doubting that I could be able to reply with something meaningful... 🙂 )

 

Thank you a lot for the update to this thread with your real experience. Much appreciated.

 

@TanyaYatskovska, @HKosova: Could you please consider, ladies, to create help article and/or some other article based on Christian's message?

 

Regards,
  /Alex [Community Champion]
____
[Community Champions] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Champions]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Champion] signature is assigned on quarterly basis and is used with permission by SmartBear Software.
https://community.smartbear.com/t5/Community-Champions/About-the-Community-Champions-Program/gpm-p/252662
================================

Hi everyone!

 

TestComplete does natively integrate with Azure Devops, I just wanted to ensure that anyone looking for this integration has the latest documentation link -  https://support.smartbear.com/testcomplete/docs/working-with/integration/ms-vs/alm/index.html

 

Thanks,

Prashant

 

cancel
Showing results for 
Search instead for 
Did you mean: