cancel
Showing results for 
Search instead for 
Did you mean: 

Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

SOLVED
Occasional Contributor

Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Could you please suggest me if there is a way I could run my ReadyAPI project/test cases from JIRA utilizing Jenkins and also generating reports? My expectation:

A. ReadyAPI project/test case would be triggered through some Jenkins plugin when test run is invoked from JIRA . The scenario would be:

  1. JIRA will send run request
  2. Jenkin plugin will trigger ReadyAPI project/test case
  3. ReadyAPI project/test case would be run
  4. Pass/fail result is shown in JIRA
  5. Report is generated

The same if I could do with other alternates.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
Moderator

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Hi @prasanna2 

 

Let's consider your request once again:

1. JIRA will send run request

To run tests from Jira you need to use a plugin. It can be QMetry, TestRail, Test Management for Jira, Zephyr... Please see the details: 

QMetry: https://qmetrysupport.atlassian.net/wiki/spaces/QTMFJC/pages/12132218/Test+Execution

TestRail: https://www.gurock.com/testrail/jira-test-management 

TM4J: https://www.adaptavist.com/doco/display/TMFJC/Execute+Test+Cases

Zephyr: https://zephyrdocs.atlassian.net/wiki/spaces/ZFJCLOUD/pages/21757977/Executing+in+Test+Cycles

 

2. Jenkin plugin will trigger ReadyAPI project/test case

Running ReadyAPI Tests From Jenkins: https://support.smartbear.com/readyapi/docs/integrations/jenkins.html

 

3. ReadyAPI project/test case would be run

OK.

 

4. Pass/fail result is shown in JIRA

This will depend on what plugin you use.

 

5. Report is generated

A report can be generated by ReadyAPI if you specify the corresponding arguments in the TestRunner command-line: 

https://support.smartbear.com/readyapi/docs/soapui/running/automating/cli.html


Anastasia
Customer Care Team


Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓

12 REPLIES 12
Moderator

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Hi,

 

The following articles may help you:

https://support.smartbear.com/readyapi/docs/integrations/zephyr.html

https://support.smartbear.com/readyapi/docs/integrations/jenkins.html

 


Anastasia
Customer Care Team


Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓

Occasional Contributor

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Thanks Nastya! But my original concern is to use Jenkins and ReadyAPI NOT Zephyr. Please check my steps.

 

  1. JIRA will send run request
  2. Jenkin plugin will trigger ReadyAPI project/test case
  3. ReadyAPI project/test case would be run
  4. Pass/fail result is shown in JIRA
  5. Report is generated

The TestRail link is very useful. Is it possible if I can invoke TestRail test cases from JIRA?

Community Hero

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Hi,

My last contract a couple of years ago used Testrail and JIRA.

The team that worked for me did look at invoking testrail tests via JIRA, but was abandoned due to a number of technical issues...which i cant remember what the issues were as i wasnt directly involved...i was just getting reports. Its a couple of years on...maybe there have been version updates resolving the issues my team found.

I do remember however that i didnt think too highly of the testrail/readyapi! Integration....i remember youd have to create placeholder tests in testrail that equated to the testcase hierarchy in your readyapi project and thete was no way to represent a looping testcase in testrail. Essentially there was an exposed testrail (POST method) api and you add an equivalent POST step as the last step in your readyapi! testcase which updates the pass/fail status on the testcase in testrail.
We never found an effective way to handle a looping testcase....i.e. if the testcase looped and executed x number of times, the testrail post would repeatedly execute overwriting the pass/fail status, so we'd only know if the most recent loop passed or failed.

As i say....its been a couple of years....maybe things have changed, but we didnt think much of the testrail integration, and tbh, i didnt think much of the rest of testrail either. Just my personal opinion, other people might find it does exactly what they need, i just found it didnt do a lot of what i needed!

Sorry for the long ramble,

Richie


I do remember
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the title of the post to something more descriptive? This will help people when searching for problems.
Occasional Contributor

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Hi Richie

 

Thanks for the detailed explanation. Really appreaciated! Could you please let me know if the below statement for Zephyre is still true?

 

Currently, ReadyAPI integrates with the Zephyr for Jira Cloud edition only. So, when we say Zephyr, we mean Zephyr for Jira Cloud.

 

Regards!

Community Hero

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

My zephyr experience was even before my testrail experience (4years ago), so i have no idea!

I found https://smartbear.com/product/ready-api/integrations/zephyr-for-jira/

and this didnt mention the integration was for jira cloud only.

Best thing to do, id contact smartbear support for clarification

Sorry i cant be of more help!

Richie
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the title of the post to something more descriptive? This will help people when searching for problems.
Community Manager

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Hi Guys,

The latest ReadyAPI version has a special integration with Zephyr for Jira. We have a video demonstrating this feature. You can watch it here:

https://www.getzephyr.com/products/soapuipro-and-zephyr-for-jira

---------
Tanya Gorbunova
SmartBear Community Manager

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓
Moderator

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Thanks everyone who participated in the discussion!

 

@prasanna2, was your question answered? Could you please share your solution or mark the post that helped you as a Solution?
We are looking forward to hearing from you.

 


Olga Terentieva
SmartBear Assistant Community Manager

Occasional Contributor

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Partially.

Highlighted
Moderator

Re: Running ReadyAPI project and test cases from JIRA utilizing Jenkins and generating report

Hi @prasanna2 

 

Let's consider your request once again:

1. JIRA will send run request

To run tests from Jira you need to use a plugin. It can be QMetry, TestRail, Test Management for Jira, Zephyr... Please see the details: 

QMetry: https://qmetrysupport.atlassian.net/wiki/spaces/QTMFJC/pages/12132218/Test+Execution

TestRail: https://www.gurock.com/testrail/jira-test-management 

TM4J: https://www.adaptavist.com/doco/display/TMFJC/Execute+Test+Cases

Zephyr: https://zephyrdocs.atlassian.net/wiki/spaces/ZFJCLOUD/pages/21757977/Executing+in+Test+Cycles

 

2. Jenkin plugin will trigger ReadyAPI project/test case

Running ReadyAPI Tests From Jenkins: https://support.smartbear.com/readyapi/docs/integrations/jenkins.html

 

3. ReadyAPI project/test case would be run

OK.

 

4. Pass/fail result is shown in JIRA

This will depend on what plugin you use.

 

5. Report is generated

A report can be generated by ReadyAPI if you specify the corresponding arguments in the TestRunner command-line: 

https://support.smartbear.com/readyapi/docs/soapui/running/automating/cli.html


Anastasia
Customer Care Team


Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓

New Here?
Join us and watch the welcome video:
Top Kudoed Authors