Forum Discussion

ripplegupta's avatar
ripplegupta
Contributor
9 years ago

How to get reporting at test step level instead of test case level what surefire currently provides

I am running my test via jenkins and i have surefire plugin which generates xml reports in my workspace. But this report has run status of all test suites and all test cases. Each test case will ha...
Jenkins
Maven
Reporting
Reports
soapuing
surefire
ripplegupta's avatar
ripplegupta
Contributor

Hi Tanya, 

 

Definitely i am using 4-5 assertions in each test step and based on those assertions my test steps are declared passed or failed.

 

But when i fetch my test report from surefire plugin it shows me arrays of test cases only with status as passed or failed.

 

Failed ones has error details for all failed test steps that caused that test case to be failed.

 

Here in my sure fire test report i want all test steps details showing pass and fail.

 

Is it possible with surefire report plugin or some way else.

 

Thanks a lot.

JKambli's avatar
JKambli
Staff
9 years ago

If you would like to know each assertion status,

 

for (suite in testRunner.testCase.testSuite.project.getTestSuiteList()){
for (test1 in suite.getTestCaseList()){
for (i in test1.getTestStepsOfType(com.eviware.soapui.impl.wsdl.teststeps.WsdlTestRequestStep )){
for( assertion in i.assertionList )
{
log.info "Assertion [" + assertion.label + "] has status [" + assertion.status + "]"
}
}
}
}

  • ripplegupta's avatar
    ripplegupta
    Contributor
    9 years ago

    Hi, yes its possible via groovy and testRunner class. But can i get test steps status via some reports so that i can acces that during jenkins run only instead of writing this groovy in my each project.

  • ripplegupta's avatar
    ripplegupta
    Contributor
    9 years ago

    Hi, can someone help here ?

    I am running soapui project in jenkins and my server has pro license installed also.

     

    But default junit report generated in jenkins workspace shows only failed test steps. I want report generated should have 

    • Name of test step
    • Description of test step
    • Status of test step (pass or fail does not matter)

    What is my best option here ? On searching internet i found people are saying :

    • Use maven-soapui-extension plugin by redfish and override junitreportcollector class

              --But do smartbear support this plugin and my scripts are using references like "com.eviware.soapui.impl.wsdl.teststeps.ProJdbcRequestTestStep)", will this change to new references ?

    Any risk using this new maven-soapui-extension plugin ?

    • Another option i saw was, use smartbear official plugin <groupId>com.smartbear</groupId>
      <artifactId>ready-api-maven-plugin</artifactId> but override junit report collector class as per this link http://blog.infostretch.com/customizing-soapui-reports/, but how to provide new class in my pom and how maven test goal will know to use new class instead of default junit report collector class ?
    • Another option i see was people saying use "reportName" in pom configuration applicable for pro tool, which report name will satisfy my needs and will it generate xml with more details and jenkins can read that accordingly ?

    My company is using around 25-30 (i think more) licenses of this tool, but we are not getting what we need, Smartbear support team is required here, thanks..

    • cryptton2004's avatar
      cryptton2004
      Occasional Contributor
      8 years ago

      Hi,

      I'm using a similar setup (jenkins that triggers soapui suite) and I'm also interested in a similar solution. Did you manage to get the tests steps results in the generated report?

      • ripplegupta's avatar
        ripplegupta
        Contributor
        8 years ago

        Its possible to get step level data/result/request during runtime only. So i had to use event handler of type "TestRunListener.afterStep". This event handler runs after every step and collect the data and use it basis my need.

        Save the data in project variable in json format or something and after project run completes it processes it at once or in batches.