cancel
Showing results for 
Search instead for 
Did you mean: 

How to run only testcases with a specific tag, in a full regression.

Occasional Contributor

How to run only testcases with a specific tag, in a full regression.

My scenario is the following.

I have a full regression with many test suites. In each of these test suites I have all my test cases tagged with "Known Defect" or "No defect"

The idea was to be able to run the entire regression for only the known defects, and also for only the known working functionality.

However when running my regression I seem to only be able to filter based on testsuite level tags, when running a testsuite seperately I can use testcase level tags but then I'd have to run every TestSuite seperately rather than in one large regression.

Is there a way for me to run all these testsuites at once using testcase filters, or is this missing functionality from SoapUI pro?

Thanks for your time

4 REPLIES 4
Contributor

Re: How to run only testcases with a specific tag, in a full regression.

@kendemoor

as per my assumption you have to run bulk of testcases in testSuites those are tagged as "Known Defect"

if this is your scenario then by following below step you can achive the result:-

1) define a new custom property as 'key and the value as Known Defect'\

2) put setup script on testSuite level as below it will disable the remaining testcases :-

runner.testSuite.getTestCaseList().each{tc->
if(tc.getPropertyValue("key").equalsIgnoreCase("Known Defect"))
{

log.info tc.name
}else{
log.info "disabling "+tc.name
tc.disabled=true
}
}

3) run the testsuite it will only run the testcases which are property key defined as Known Defect

 

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.Smiley Wink

 

Occasional Contributor

Re: How to run only testcases with a specific tag, in a full regression.

Thanks,

That is an interesting workaround and I could see how it could work, but for my specific use case it has some issues since I already disable/enable some testcases based on other factors. 

I know the functionality to filter a test run specifically based on tags already exists, since it's available when I use it on a testsuite. I'd like to find a way to specifically use this functionality on a higher level when combining test suites in a regression, without enable/disable overwrites.

Screenshot of the functionality for clarity.
mstsc_2018-12-26_10-44-28.png


Community Manager

Re: How to run only testcases with a specific tag, in a full regression.

Hi @kendemoor,

 

At the moment, there is no way to run all TestCases with a specific tag from different Test Suites at once. I suggest that you submit a feature request here. Other community members will be able to vote for this request, and this will increase its rating.

 

Meantime, you can try using the suggestion given by ashu248 - it sounds reasonable.

---------
Tanya Gorbunova
SmartBear Community Manager

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓
Community Hero

Re: How to run only testcases with a specific tag, in a full regression.

@kendemoor,

 

Another clean / elegant way to achieve the same could be to use Custom Events as there is no in built functionality. I am not sure though if API has been exposed it or not.

 

Here is the idea.

 

Write implement "beforeTestCase" method of TestSuiteRunListener.

# Access the current test case tags (please check the javadocs to see if possible)

# Execute the test case if the test case is tagged with intended one

# Skip the execution of test case otherwise

 

This way, either all the suites can be executed at once or execute them separately. Nothing to bother.

 

Hope this helps.

 

 



Regards,
Rao.
New Here?
Join us and watch the welcome video:
Watch the new interview
Top Kudoed Authors