Forum Discussion

jkrier's avatar
jkrier
Regular Contributor
12 years ago

Reporting with requirements pass and fail by by testStep

I have a project with the hierarchy testSuite>testCase>testSteps(With many testSteps). I have added requirements to the project and then linked them to the testCase. When I create a report after a run the report generates and includes the requirement data but there is nothing to say that they passed based on the testStep results. Is there a way to do this? Specifically is there any way to tie assertions and results directly to an individual requirement and then print a report that will show this? I’ve tried reading some of the report documentation on the site and have browsed the forums but I don’t see any help on this particular question.

I did find a page on the site called Customizing Templates here http://www.soapui.org/Reporting/customizing.html which seems to be either outdated or not complete. I've tried following the steps but an error is always returned.

Fri Nov 15 12:48:29 MST 2013:ERROR:net.sf.jasperreports.engine.design.JRValidationException: Report design not valid :
1. Parameter not found : RequirementLinkedTestCases
net.sf.jasperreports.engine.design.JRValidationException: Report design not valid :
1. Parameter not found : RequirementLinkedTestCases
at net.sf.jasperreports.engine.design.JRAbstractCompiler.verifyDesign(JRAbstractCompiler.java:258)
at net.sf.jasperreports.engine.design.JRAbstractCompiler.compileReport(JRAbstractCompiler.java:140)
at net.sf.jasperreports.engine.JasperCompileManager.compileReport(JasperCompileManager.java:215)
at com.eviware.soapui.reporting.engine.jasper.GenerateJasperReport.createReport(SourceFile:460)
at com.eviware.soapui.reporting.engine.jasper.GenerateJasperReport$ReportFillWorker.construct(SourceFile:428)
at com.eviware.soapui.support.swing.SwingWorkerDelegator.construct(SwingWorkerDelegator.java:46)
at com.eviware.soapui.support.swing.SwingWorker$2.run(SwingWorker.java:149)
at java.lang.Thread.run(Unknown Source)


I tried going step by step through the walkthrough for Customizing Templates and the behavior in my instance of soapUI Pro does not match the instructions.

For example;
Step 6. None of my Project properties are displayed. I do see the "null properties" text above "Name" but there is nothing listed underneath it. I added the same property as in the example Name = Some property Value = with a value and it is not generated.
Step 7. When I go to the tab Subreports next to Available Reports in the Project it is blank. There is nothing to chose from.

I've tried adding my own Subreport for this but I saw no change in behavior.
  • jkrier's avatar
    jkrier
    Regular Contributor
    12 years ago
    Thanks Marcus, I will give this a try now and let know know how it goes.

    So this is what happened.

    I created a brand new project. I added one testStep under the testCase. I then followed the instructions in the link you provided

    1. Added requirements at the project level under the projects requirements tab
    2. Added my testCase to the requirements at the project level using the TestCases tab at the bottom of the project requirements screen
    3. In the TestCase editor window I opened the "Requirements" tab (I do not have a tab named "TestCase Requirements" as noted in the documentation) and the requirements that were mapped appear here.
    4. I ran the testStep and the response was good
    5. I clicked the "Create Report" button on the TestCase tool bar and nothing was generated.

    Am I missing a step?

    I also just ran the TestCase from the TestSuite and clicked "Create Report" and a report was generated but none of the requirements were listed.
  • jkrier's avatar
    jkrier
    Regular Contributor
    12 years ago
    Hello Marcus,

    I'm guessing maybe you were not notified about my latest response because I just edited a previous response instead of creating a new reply. Either that or you're just busy So just in case I'm creating a new reply with my results so far.

    I created a brand new project. I added one testStep under the testCase. I then followed the instructions in the link you provided

    1. Added requirements at the project level under the projects requirements tab
    2. Added my testCase to the requirements at the project level using the TestCases tab at the bottom of the project requirements screen
    3. In the TestCase editor window I opened the "Requirements" tab (I do not have a tab named "TestCase Requirements" as noted in the documentation) and the requirements that were mapped appear here.
    4. I ran the testStep and the response was good
    5. I clicked the "Create Report" button on the TestCase tool bar and nothing was generated.

    Am I missing a step?

    I also just ran the TestCase from the TestSuite and clicked "Create Report" and a report was generated but none of the requirements were listed.
  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    SmartBear Alumni (Retired)
    12 years ago
    Hi,

    This forum thread is tracked easier with a new response.

    I added some requirements to a project and added some test cases for the requirements. Then I ran the test case from the testsuite, and was able to generate the report with the TestCase requirements in the report. I'm going to attach the report and my project as an example. Also, which version of SoapUI Pro are you using?


    Regards,
    Marcus
    SmartBear Support
  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    SmartBear Alumni (Retired)
    12 years ago
    Hi,

    Are you doing a File -> Import Project? I'm not getting any errors downloading the attached and using it.
    Since the project was created with a local wsdl file I will attach, copy this to your C:\ location.


    Regards,
    Marcus
    SmartBear Support
  • jkrier's avatar
    jkrier
    Regular Contributor
    12 years ago
    Sorry, I don't know what the issue was but I closed and reopened soapUI and it loaded. I'll take a look at it and see if I can figure out what I'm doing wrong. Thanks for all of your help.
  • jkrier's avatar
    jkrier
    Regular Contributor
    12 years ago
    I created a completely new Project and added a TestSuite/TestCase and one TestStep. At the project I added a requirement and then added my TestCase to the requirement. Then I ran the TestSuite and generated a report and again I do not see the requirement in the report.

    I also ran your sample project from the TestSuite and generated a report and it also did not include the requirements.

    I'm attaching a screen shot of my project from the requirements tab and both of the reports I generated. One for my project and one for the sample project you provided me.
  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    SmartBear Alumni (Retired)
    12 years ago
    Hi,

    Can you double check a few things? That in the requirements tab at the TestCase level, there is a test case in the TestCases tab, that there is a requirement listed in the requirements tab, and a description in the Description tab.

    Attaching screenshots.

    Regards,
    Marcus
    SmartBear Support