Forum Discussion

testhrishi's avatar
testhrishi
Frequent Contributor
8 years ago

How to capture Test PASS or FAIL test count using a property

Hi,  I am looking to see if there is a way to count total PASS or FAILED tests and have it stored as a property at suite level.  Has anyone tried this?  I am looking to this for reporting purposes...
  • rupert_anderson's avatar
    rupert_anderson
    8 years ago

    Hi,

     

    I am guessing that you are trying to run the script at TestCase TearDown script level maybe? If so, there is no 'runner' variable, only 'log,testCase,context,testRunner' variables. Please see my TestSuite screen shot below:

     

    Note - If TestSuite isn't what you want, then the above script can be adapted to run at TestCase level.

     

    Regards,

    Rup

  • rupert_anderson's avatar
    rupert_anderson
    8 years ago

    Hi,

     

    Ok, glad it worked.

    Ok, a low tech way to get the totals at project level is to simply change the initialization of the passed, failed variables to take the current values stored at project level - something like:

    def passed=Integer.parseInt(runner.testSuite.project.getPropertyValue("passed"))
def failed=Integer.parseInt(runner.testSuite.project.getPropertyValue("failed"))

for ( testCaseResult in runner.results )
{
    for ( testStepResult in testCaseResult.getResults() ){

    	log.info testCaseResult.getResults().metaClass.methods*.name.sort().unique()
    	log.info testStepResult.status
    	 if (testStepResult.status.toString()=="OK") passed++
    	 	else failed++
	}	
}
log.info "passed="+passed+" failed="+failed

runner.testSuite.project.setPropertyValue("passed", "$passed" ) 
runner.testSuite.project.setPropertyValue("failed", "$failed" )

    Note - in this simple case, you'll have to be careful to manually set the properties passed,failed=0 in the properties section of the project before running. Then each TestSuite should simply increment the overall project level totals with it's totals when the TestSuites run their TearDown scripts. 

     

    Will this work for you?

     

    Regards,

    Rup

     

testhrishi's avatar
testhrishi
Frequent Contributor

Thank you for the Info.

 when I execute the script, I don't see anything pop up with the passed failed.

 am I missing something?

 My goal is to capture this number and create a project property and then provide that to some other api for reporting.

  • testhrishi's avatar
    testhrishi
    Frequent Contributor
    8 years ago

     May be I am missing something here.

     so from the example above, should something like this expected to log passed total count to a variable at project level when I used it as a teardown script?

    testRunner.testCase.testSuite.project.setPropertyValue( "+passed+", ${#Project#PASSED} ) 

     

     

    Thank you..

    • rupert_anderson's avatar
      rupert_anderson
      Valued Contributor
      8 years ago

      Hi,

      I guess it depends what you want to do with the totals. In the example you give, I would do something like:

       

      runner.testSuite.project.setPropertyValue("passed", "$passed" ) 
runner.testSuite.project.setPropertyValue("failed", "$failed" )

      This will create properties called passed and failed (set with the respective totals) on the project that contains the TestSuite where the above script was run (note - setPropertyValue requires String values).

       

      Is this what you wanted? It really depends what you intend to do next with the data as to whether it is convenient to store the totals at project level.

       

      Thanks,

      Rup

      • testhrishi's avatar
        testhrishi
        Frequent Contributor
        8 years ago

        I tried what you have suggested; however I am getting groovy.lang.MissingpropertyException for "runner"

        In some other documentation i was reading the tearDown script has no context of "runner"

        So I am getting the exception on line 3. is there a workaround for this?

         

        def passed=0
        def failed=0
        for ( testCaseResult in runner.results )
        {
            for ( testStepResult in testCaseResult.getResults() ){
                log.info testStepResult.status
                 if (testStepResult.status.toString()=="OK") passed++
                     else failed++
            }    
        }
        log.info "passed="+passed+" failed="+failed
        runner.testSuite.project.setPropertyValue("passed", "$PASSED" )