Forum Discussion

jneth8's avatar
jneth8
New Contributor
7 years ago

How do I pass a test case while ignoring only certain failed test steps?

I have a test case that has multiple test steps. Two of them are calling a REST endpoint that was not developed by my organization. It's essentially an API for viewing a log. However, sometimes when calling the API, it fails. No payload is returned, no HTTP status is returned, it is a null payload. I have accounted for this by not putting any assertions on the test step and I have a groovy test step right after to evaluate the payload. If the payload is null, I return to the to REST call and run it again. Once it returns a payload, the groovy script will allow the test case to move to the next step.

 

When the test case completes, if one of the API calls failed the entire test case is failed even though it eventually passed. It seems that the test case is looking at the log and if any test step failed at any point, the test case failed.

 

How can ignore the failures only for those specific REST calls? If any other test step fails, I still want to the test case to fail. I have attempted to add a script to disable the "Fail TestCase if it has failed TestSteps" option before the REST steps and then re-enable it after they have run, but the test case still fails. 

 

Thank you in advance for any help.

  • Lucian's avatar
    Lucian
    7 years ago

    Ok so it seems that you don't even have to use a try catch statement. Just disable the step for which you want to ignore the result and call it from a groovy script as:

     

    // Get the test step for which you want to ignore the result
def testStep = testRunner.testCase.testSuite.testCases[ "NameOfYourTestCase" ].testSteps[ "NameOfYourTestStep" ]
// Run the test step
testStep.run( testRunner, context )

    I attached a demo project at https://github.com/lucadln/soapui/tree/master/IgnoreFailedStep .

     

    Cheers!

  • Lucian's avatar
    Lucian
    Community Hero
    7 years ago

    Ok so it seems that you don't even have to use a try catch statement. Just disable the step for which you want to ignore the result and call it from a groovy script as:

     

    // Get the test step for which you want to ignore the result
def testStep = testRunner.testCase.testSuite.testCases[ "NameOfYourTestCase" ].testSteps[ "NameOfYourTestStep" ]
// Run the test step
testStep.run( testRunner, context )

    I attached a demo project at https://github.com/lucadln/soapui/tree/master/IgnoreFailedStep .

     

    Cheers!

    • jneth8's avatar
      jneth8
      New Contributor
      7 years ago

      That worked perfectly. I would have never thought to approach it this way. 

       

      Thanks a lot for your help.

    • pallavipandey's avatar
      pallavipandey
      Visitor
      6 years ago

      Hey I'm not able to find your demo link, getting 404 error. I need help reagrding my project, where I have to add assertion in all Test Steps using grrovy script, I have written the code for that, but it's considering Groovy Script also as a Test Step and trying to add assertion in it, which is not possible hence my script is failing. How can I identify only Request Test Steps and add assertion into it, by ignoring Groovy Script test Steps.

       

      My code:-

       

      def testCases = context.testCase.testSuite.getTestCaseList()
      testCases.each
      {
      log.info "~~~Test Case:" + it.name
      for(testSteps in it.testStepList)
      {
      log.info "~~~Test Step:" + testSteps.name
      def addassert = testSteps.addAssertion("Contains")
      addassert.setToken("REST Countries")
       }
      }

  • Lucian's avatar
    Lucian
    Community Hero
    7 years ago

    Not possible ootb. You can create a groovy to call the desired step and put the code in a try catch script.

    • jneth8's avatar
      jneth8
      New Contributor
      7 years ago

      I know it is not possible out of the box. As mentioned, I already have a groovy script to retry the REST step in case of a failure. What I want is to ignore the initial failure of that REST step at the test case level and have the test case pass if all other steps outside this one particular test step pass. Is there a way to manipulate the log files so that the test case thinks the test step passed?

      • Lucian's avatar
        Lucian
        Community Hero
        7 years ago

        Yes, again I think you can do this with a try and catch statement. I will try to do a demo later today.