Forum Discussion

rupam_rajvanshi's avatar
rupam_rajvanshi
New Contributor
4 years ago

How to get pass/fail status of groovy scripting in excel sheet

Hello Everyone, I am taking data from excel sheet for that I am using data source. I have written groovy script for asserting response. I want get status of groovy scripts status as pass or fail and...
Data-Driven Testing
Reporting
  • ChrisAdams's avatar
    ChrisAdams
    4 years ago

    Hi,

     

    I use one Groovy script per condition to test.  In my own main test suite, I have approx. 20 groovy scripts.

     

    I suppose you could return an array from your groovy script where each element is a condition test and then update your datasink step to reference the element of interest.  Not tried, but I imagine it's possible.  You could also return a JSON object from the Groovy script. E.g.

    [
    {
        "surname": "Scholes",
        "forename": "Paul",
        "surnameCheckResult": "PASS",
        "forenameCheckResult": "FAIL"
    }
]

    And then reference the values in the Datasink...  E.g.

    ${MyCheck#result.someConditionName}

    Again, not sure if this would work.

nmrao's avatar
nmrao
Champion Level 3
In general, there are no explicit assertion be added to groovy script test step unlike other test steps.
Of course one can have assertions with in groovy script, but one can't really find the status of groovy script test step and I doubt if there any API available.
rupam_rajvanshi's avatar
rupam_rajvanshi
New Contributor
4 years ago

Is there any other way by which we can pass pass/fail depends on groovy script status to excel sheet?

 

Regads

Rupam

  • nmrao's avatar
    nmrao
    Champion Level 3
    4 years ago
    I can suggest a test with default reporting.

    Create a project with a simple suite, add a test case and add the same script step and try generating report and see if you get the correct status.
    • ChrisAdams's avatar
      ChrisAdams
      Champion Level 3
      4 years ago

      Hi,

       

      I do this all the time.

       

      I use Excel datasource for the params to call any given services for a single discrete test.  I use Groovy scripts to run checks (not assertions) on the response in order to work out what has passed or failed for that test.

       

      I then use a datastore step to write out the data.  I do not put the results back into the same Excel spreadsheet as the datasource, this doesn't make sense for future tests runs.  But, using the datastore step, you could pretty much write back out each column from the current row in the datasource as well was well the results from Groovy steps containing assertions.  I do this too.

       

      For the datastore setup, you can even use a groovy step to define the datastore filename.  I do this to give my datastore file a timestamp.

       

      I haven't actually used Excel as a datastore, I use (a kind of) CSV  and define the pipe symbol as my separator.  Can't always trust commas because, y'know, sentences or strings.  I then import these into a nicely formatted spreadsheet that is full of conditional formatting to colour the passes and fails.

       

      Each Groovy script will perform some sort of test.  E.g. customer surname in response matches the expected customer surname in the datasource by using a simple 'if' statement, then return the result. I don't use assertions because the test will fail at that point.  I don't want that.  I'd rather I run tests for every row and then see what has failed.  Some of my data-driven (aka functional tests) contain over 1,000 rows.  If I used assertions I'd have to continually have to stop-fix-retest.  

       

      When setting up the datastore, you can use the nifty 'get data' by right-clicking in the value cell for the datastore prop, simply navigate to the Groovy step and then select Groovy Step result.  What this does is run the check and pull out the return value and shove it in the datastore.  

       

      Sounds complicated, and it can be tricky to set up, so just try and get the flow working for one or two values.  Once you manage this, you'll be flying in no time.

      • rupam_rajvanshi's avatar
        rupam_rajvanshi
        New Contributor
        4 years ago

        Hi,

        I got your point, But can you please tell me how are you getting groovy script result. Like in custom groovy script properties there are two properties, one is result and other is script. For me I got nothing in result property value. So how are you getting value in result property? And from data store you mean dataSink test step?

        Please help me with the solution.

         

        Regards

        Rupam