Forum Discussion

richie's avatar
richie
Community Hero
6 years ago

Execution Stats TearDown Script By Lucian

Hey!   TI am using a script Lucian developed to record my execution stats.   Its a teardown script I've stuck at project level at moment and is as follows:   It's fantastic - does almost ever...
  • Radford's avatar
    Radford
    6 years ago

    Opps... Sorry...

     

    The following code is very "rough and ready" and I don't have time to fully test and refine, but try the following:

     

    // Define variables for holding test suites, test cases and test steps
def testSuites
def testCases
def totalPassedTestCases = 0
def totalFailedTestCases = 0

def testSuitePassTotals = []
def testSuiteFailTotals = []

// Get the list of test suites
testSuites = runner.getResults() 

// Iterate through each test suite
testSuites.each() {
	log.info "----------------------------------------"
	log.info "The " + "'" + it.getTestSuite().getName() +"'" + " test suite has " + it.getStatus() + "ED."
	log.info "Test case execution results as follows..."

	// Get all the test cases and iterate through them

	def testSuitePassedTestCases = 0
	def testSuiteFailedTestCases = 0
			
	testCases = it.getResults()
	testCases.each() {
		log.info "Test case " + "'" + it.getTestCase().getName() + "' " + it.getStatus() + "ED."
		if ( it.getStatus().toString().equals("PASS") ) {
			totalPassedTestCases++
			testSuitePassedTestCases++
		} else {
			totalFailedTestCases++
			testSuiteFailedTestCases++
		}
	}

	testSuitePassTotals.add([name:it.getTestSuite().getName(), count:testSuitePassedTestCases])
	testSuiteFailTotals.add([name:it.getTestSuite().getName(), count:testSuiteFailedTestCases])
	
}

    log.info "----------------------------------------"
testSuitePassTotals.each(){
	log.info('Test Suite "' + it.name + '" number of passed test cases = ' + it.count)
}

    log.info "----------------------------------------"
testSuiteFailTotals.each(){
	log.info('Test Suite "' + it.name + '" number of failed test cases = ' + it.count)
}

    log.info "----------------------------------------"
log.info " Number of PASSES = " + totalPassedTestCases.toString() + " Number of FAILS = " + totalFailedTestCases.toString() + "."

     

    Note sure if it's exactly what you want, but hopefully it might point you in the right direction.

Radford's avatar
Radford
Super Contributor

Does the following give you what you want? I've just removed the resetting of the pass/fail counters, and then moved the logging of the totals to the very end.

 

// Define variables for holding test suites, test cases and test steps
def testSuites
def testCases
def passedTestCases = 0
def failedTestCases = 0

// Get the list of test suites
testSuites = runner.getResults() 

// Iterate through each test suite
testSuites.each() {
	log.info "----------------------------------------"
	log.info "The " + "'" + it.getTestSuite().getName() +"'" + " test suite has " + it.getStatus() + "ED."
	log.info "Test case execution results as follows..."

	// Get all the test cases and iterate through them
	testCases = it.getResults()
	testCases.each() {
		log.info "Test case " + "'" + it.getTestCase().getName() + "' " + it.getStatus() + "ED."
		if ( it.getStatus().toString().equals("PASS") ) {
			passedTestCases++
		} else {
			failedTestCases++
		}
	}
}

log.info " Number of PASSES = " + passedTestCases.toString() + " Number of FAILS = " + failedTestCases.toString() + "."
richie's avatar
richie
Community Hero
6 years ago

Radford

 

hahaha! - almost - it gives me the total execution stats across the whole project now, but I lose the 'per test suite' stats when I apply the change you suggest.

 

I need to keep the 'per suite' SUB TOTAL (like the old version of script) AND the 'per project' TOTAL (like your version of the script) - I need both - not one nor just the other.

 

I'm stuffed -  either reset the stat counters each iteration (to keep the per suite stats) or remove them and have logging at the end to have a cumulative (per project count).

 

Thanks man - appreciate the help - I'm gonna keep digging! :)

 

richie

  • Radford's avatar
    Radford
    Super Contributor
    6 years ago

    Opps... Sorry...

     

    The following code is very "rough and ready" and I don't have time to fully test and refine, but try the following:

     

    // Define variables for holding test suites, test cases and test steps
def testSuites
def testCases
def totalPassedTestCases = 0
def totalFailedTestCases = 0

def testSuitePassTotals = []
def testSuiteFailTotals = []

// Get the list of test suites
testSuites = runner.getResults() 

// Iterate through each test suite
testSuites.each() {
	log.info "----------------------------------------"
	log.info "The " + "'" + it.getTestSuite().getName() +"'" + " test suite has " + it.getStatus() + "ED."
	log.info "Test case execution results as follows..."

	// Get all the test cases and iterate through them

	def testSuitePassedTestCases = 0
	def testSuiteFailedTestCases = 0
			
	testCases = it.getResults()
	testCases.each() {
		log.info "Test case " + "'" + it.getTestCase().getName() + "' " + it.getStatus() + "ED."
		if ( it.getStatus().toString().equals("PASS") ) {
			totalPassedTestCases++
			testSuitePassedTestCases++
		} else {
			totalFailedTestCases++
			testSuiteFailedTestCases++
		}
	}

	testSuitePassTotals.add([name:it.getTestSuite().getName(), count:testSuitePassedTestCases])
	testSuiteFailTotals.add([name:it.getTestSuite().getName(), count:testSuiteFailedTestCases])
	
}

    log.info "----------------------------------------"
testSuitePassTotals.each(){
	log.info('Test Suite "' + it.name + '" number of passed test cases = ' + it.count)
}

    log.info "----------------------------------------"
testSuiteFailTotals.each(){
	log.info('Test Suite "' + it.name + '" number of failed test cases = ' + it.count)
}

    log.info "----------------------------------------"
log.info " Number of PASSES = " + totalPassedTestCases.toString() + " Number of FAILS = " + totalFailedTestCases.toString() + "."

     

    Note sure if it's exactly what you want, but hopefully it might point you in the right direction.

    • richie's avatar
      richie
      Community Hero
      6 years ago

      Radford

       

      that's brilliant fella.  Gives me everything I need and this will help me alot - cos I can now spend some time comparing the 2 scripts and I can now follow the progression - this has helped me - really!

       

      nice one!

       

      rich