Forum Discussion

SuperSingh's avatar
SuperSingh
Contributor
7 years ago

Generating Test Results for a Data Driven Test

I have my project in SoapUI Pro in the following format. Project    Suite          DataSource               TestCase          DataSink          DataLoop   I want to generate reports f...
sas's avatar
sas
Occasional Contributor

I have a similar use case. Wondering what was the resolution?

nmrao's avatar
nmrao
Champion Level 3
6 years ago
Data driven test is considered as single test case, hence single test in report. That is by design.

Just think if the test is failed because of one row in the data, will you run the test for only particular row or entire data source?
  • sas's avatar
    sas
    Occasional Contributor
    6 years ago

    I get that, but I should be able to customize the report to show what data is being tested in the iteration from the data source. 

    In that case, the question is how can I customize the report to show the data element on the reports?

    • sas's avatar
      sas
      Occasional Contributor
      6 years ago

      nmrao I want to add to my earlier response... 

      I think, you can write a single test case in SOAP-UI that is highly parameterized and templatized and that can use data from a data source to run different type types of tests. Essentially, you are writing a test engine and fueling it with data. That's the power of data-driven testing. 

      Now, one can say that if one test fails then we have to report as a test case as failed for the whole data source. I think end-users should be able to decide how to deal with the failed tests in the data source. Maybe there is flexibility in generating the test data for the data source... few thoughts... 

      • nmrao's avatar
        nmrao
        Champion Level 3
        6 years ago
        It will help how it is giving the error in the report?

        In the data source, there might be an expected result based on which assertion is executed and the same is expected to be in the report when particular test is failed. So, I believe that it will be evident which row got failed and that is enough to file bug report. Is my understand incorrect or missing something?