Forum Discussion

sibaram_subudhi's avatar
sibaram_subudhi
Occasional Contributor
9 years ago

How to capture assertions from SoapUI Test steps while executing SoapUI Scripts from a java applicat

Hi,   I am working on implementing the SoapUI project execution using Java programming. I am able to get the test suites, test cases and test steps.   How can I capture the assertions defined in ...
  • sibaram_subudhi's avatar
    sibaram_subudhi
    9 years ago

    Hi Rupert,

     

    Thanks for providing your inputs. However I implemented in similar way with different approach.

     

    // get a list of all test suites on the project
    suiteList = project.getTestSuiteList();

    // iterating through each suite
    for(int i = 0; i < suiteList.size(); i++){

    //Neglect if suite is disabled/inactive
    if(suiteList.get(i).isDisabled()){
    continue;
    }

    // get the test suite name000
    suiteName = suiteList.get(i).getName();

    System.out.println("Test Suite Is :" + suiteName );
    reportStr = reportStr + "\nTest Suite: " + suiteName;

    // get a list of all test cases from the test suite
    caseList = suiteList.get(i).getTestCaseList();

    WsdlTestCaseRunner runner;

    // iterating through each test case
    for(TestCase testcase : caseList){
    //neglect the disabled/inactive test case
    if (testcase.isDisabled())
    {
    continue;
    }

    //Getting the WsdlTestCaseRunner
    runner = new WsdlTestCaseRunner((WsdlTestCase) testcase, new StringToObjectMap(testcase.getProperties()) );

    //Running the Test Case
    runner.run();

    //Getting the result of each step
    List<TestStepResult> results = runner.getResults();

    System.out.println("Test Case : " + testcase.getName());

    //iterating through the results of the test steps executed in the test case
    for(TestStepResult result : results ){
    TestStepStatus stepStatus = result.getStatus();
    //printing the status , we can have a check here for OK , FAILED or UNKNOWN test cases
    System.out.println("Test Step Is : "+ result.getTestStep().getName() + " Test Step Status Is : " + stepStatus.toString());

    if (result instanceof WsdlTestRequestStepResult){
    if(result.getMessages().length>0){
    //Getting the error messages
    String[] errStr = result.getMessages();
    StringBuilder sb= new StringBuilder();

    //iterating through the error messages
    for(int ii=0;ii<errStr.length;ii++){
    String asserWithExcptn=errStr[ii];
    String assertName= asserWithExcptn.substring(0,asserWithExcptn.indexOf("]")+1);
    String assertResult= asserWithExcptn.substring(asserWithExcptn.indexOf("]")+1, asserWithExcptn.length());
    sb.append("The failed assertion #"+(ii+1)+" as follows.. \n");
    sb.append("The assertion is: "+assertName+"\n");
    sb.append("The message is:"+assertResult);
    sb.append("\n");
    }
    System.out.println(sb.toString());
    }
    }
    }
    reportStr = reportStr + "\n\tTestCase: " + testcase.getName() + "\tStatus: " + runner.getStatus() + "\tReason: " + runner.getReason();
    }
    }
    //'reportStr' has the status of all the test cases
    System.out.println("The Execution Status as follows: \n"+reportStr);

     

    The above script  will capture more specific messages(Failed assertions from each test step).

rupert_anderson's avatar
rupert_anderson
Valued Contributor

Hi,

 

Sounds interesting...

 

I have only really tried to capture Assertion results in a project level teardown script after executing all the tests - here is a simple version of a similar script:

 

log.info "TestSuite Name,TestSuite Status,TestCase Name,TestCase Status,Error Messages(s)"
for ( testSuiteResult in runner.results ){
	
	for ( testCaseResult in testSuiteResult.results )
	{
		def row=""
		row=testCaseResult.testCase.name + ","+testCaseResult.status.toString()+","
    		for ( testStepResult in testCaseResult.getResults() )
    		{
      		row+=testStepResult.testStep.name +","+ testStepResult.status.toString()+","
			testStepResult.messages.each() { message -> row+=message
			}
		}
		log.info row
	}

}

The Assertion failure messages show up in the messages collection, but not success messages show there.

 

Hope this helps,

Rupert

sibaram_subudhi's avatar
sibaram_subudhi
Occasional Contributor
9 years ago

Hello Rupert,

 

Thanks for quick reply.

 

I am also able to get the result for Test suite, test case and step wise. Here the challenge is to get the assertion(s) and their results. The message we are extracting from step result is not even meaningful. need to implement to capture stacktrace or a meaningful error.

If you observe the screenshot, a test step may have more than 1 assertion and upon execution we will get the shown message. Trying to capture them as well. 

 

Please suggest if you understood.

 

Currently getting like [Ljava.lang.String;@729d6ee2 . 

 

Thanks, Sibaram

  • rupert_anderson's avatar
    rupert_anderson
    Valued Contributor
    9 years ago

    Hi Sibaram,

     

    Yes, that makes sense, it would be good to get more detail as you say. If you are seeing something like [Ljava.lang.String;@.... isn't it that you're just trying to view an Array/Collection of Strings or something similar (something with no toString() method defined) like explained here http://stackoverflow.com/questions/19477869/array-and-java-string-error-ljava-lang-string19c42c4b

     

    What is the statement that you are trying to output?

     

    Regards,

    Rupert

    • sibaram_subudhi's avatar
      sibaram_subudhi
      Occasional Contributor
      9 years ago

      Hi Rupert,

       

      I am just trying to extract the messages we are providing in assertions. If you look into the screenshot which I shared(5th line from bottom), there one such message is

      -> [Not Contains] Response contains token[Warning]  

      Missing token [text text text]

       

      Thanks,

      Sibaram