cancel
Showing results for 
Search instead for 
Did you mean: 

ReadyAPI Test for Azure DevOps manual test association

SOLVED
sokol
New Contributor

ReadyAPI Test for Azure DevOps manual test association

Hi

I have executed test in Azure Devops pipeline and Ready API Test for Azure Devops extension.

I have tried to connect my ReadyAPI test executed in pipeline in Azure Devops (using ReadyAPI) to my manual test cases to make more coverage result and see much more information such test case steps, description etc. 

 

Have you guys tried something like that? I have read a lot of information and can find only answer that it is not supported (e.g. Selenium test you can easily associate in VisualStudio to manual test cases prepared in AzureDevops, but I can't find info how to do it with ReadyAPI tests). 

 

I'm sure that someone maybe wrote some addon or maybe it is only a matter of configuration.

 

Please help, any good ideas or info from your experience are more than welcome.

 

Thanks in advance

Piotr

1 ACCEPTED SOLUTION

Accepted Solutions
khanchett
Contributor

Re: ReadyAPI Test for Azure DevOps manual test association

It's a rather involved process.  The gist of it is this:

* Install and setup Visual Studio for MSTest

* Write a MSTest test case that calls a command line to execute the ReadyAPI command line call.

  NOTE:  I've noticed anything printed to the console during the test run is shown as an attachment in the ADO test case results.  This can be helpful to relay info back to ADO.

* Get this working through VS, then move on to Azure DevOps.

* In Azure DevOps, Test Plans, create a test case and save. 

* Grab the test ID and back to VS, open Test Exporer, right click on the test case to tie to the ADO test case and associate the test id and save.

* In Azure DevOps create a separate CI-CD pipeline to run just test plan test cases.

* In your new Test Plan, select the test case created and click "Run with Options" in the drop down.

* In the next pop up you will select the middle option to run automated tests, connect it to the build # and the pipeline and Stage.

 

There are a lot of little things in-between to tweak.  This is the general format that I have working for a Java Selenium automation framework and for a ReadyAPI automation framework.  

 

Hope this helps.  To be clear, Microsoft doesn't clearly explain this in any way.  This is something I've come up with on my own and researching each step of the way in the process.  If you find something else that makes it easier please share!  

View solution in original post

5 REPLIES 5
khanchett
Contributor

Re: ReadyAPI Test for Azure DevOps manual test association

If I am understanding your question correctly you are wanting to tie in your test plans to execute ReadyAPI test cases?  If this is the case I have figured out a way to do it with ReadyAPI and any other tests you can execute from a command line that isn't "Microsoft".

 

The short of it is that you need to use Visual Studio to achieve it with Microsoft's VS Test task.  The good news is I believe it would even work with the Community version.  It's very bare bones of what you would need to do in Visual Studio.  I have it currently working with ReadyAPI and Java Selenium via Maven calls.

 

I don't think Microsoft supports any of it except if you are using their products exactly the way they say to.  I've not found much help elsewhere.  My results are reported back for each test case and traced and seems to be working pretty smoothly.  

 

If this is what you are looking for feel free to reach out to me directly.  I'm not sure there is a private way to do that here.  I would be more than happy to share my code and explanation.

 

sonya_m
Community Manager

Re: ReadyAPI Test for Azure DevOps manual test association

Thank you for helping @khanchett ! 

The SmartBear Community supports private messaging, however, if the info you are willing to share is OK share publicly, please do - other people will be able to use your approach in the future!

 

Hi @sokol, is this something you are looking to implement? Looks like khanchett  can help!


Sonya Mihaljova
Community and Education Specialist

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others. ⬇️⬇️⬇️
khanchett
Contributor

Re: ReadyAPI Test for Azure DevOps manual test association

It's a rather involved process.  The gist of it is this:

* Install and setup Visual Studio for MSTest

* Write a MSTest test case that calls a command line to execute the ReadyAPI command line call.

  NOTE:  I've noticed anything printed to the console during the test run is shown as an attachment in the ADO test case results.  This can be helpful to relay info back to ADO.

* Get this working through VS, then move on to Azure DevOps.

* In Azure DevOps, Test Plans, create a test case and save. 

* Grab the test ID and back to VS, open Test Exporer, right click on the test case to tie to the ADO test case and associate the test id and save.

* In Azure DevOps create a separate CI-CD pipeline to run just test plan test cases.

* In your new Test Plan, select the test case created and click "Run with Options" in the drop down.

* In the next pop up you will select the middle option to run automated tests, connect it to the build # and the pipeline and Stage.

 

There are a lot of little things in-between to tweak.  This is the general format that I have working for a Java Selenium automation framework and for a ReadyAPI automation framework.  

 

Hope this helps.  To be clear, Microsoft doesn't clearly explain this in any way.  This is something I've come up with on my own and researching each step of the way in the process.  If you find something else that makes it easier please share!  

View solution in original post

sokol
New Contributor

Re: ReadyAPI Test for Azure DevOps manual test association

Hi

Thanks a lot @khanchett it is very helpful. 

Your approach provide the full creation and connection from VS to Azure and it could be kind of solution (I'm going to test it). 

 

One more question - do you know if it is possible to not execute readyAPI in VS command line but use existing ReadyApi Task from azure devops which exactly did every execution, results etc. but haven't linked to description in manual TC.

 

Regards

khanchett
Contributor

Re: ReadyAPI Test for Azure DevOps manual test association

The problem I ran into is that VSTest ties nicely back to the test cases with the results and everything else.  The ReadyAPI task or other tasks do not (they are basically a standalone, not connected to the test run). It is because in MSTest in Visual Studio that you are tying it to the specific test case that allows that connection through.  So anything to do outside of the Microsoft umbrella can be executed within the MSTest environment.

 

Also, the ReadyAPI task is limited in what it can do and I normally do the command line task in ADO instead for the needs I have.  I had asked in previous posts about it and was told the thing I was trying to do was limited and the command line was the way to go.

New Here?
Join us and watch the welcome video:
Announcements
Top Kudoed Authors