Forum Discussion

sclavell's avatar
sclavell
Occasional Contributor
8 years ago
Solved

testrunner.bat not returning error code in 1.7.0

I'm using Testrunner.bat to execute my SoapUI NG tests in Jenkins.  After upgrading from ReadyAPI 1.6.0 to 1.7.0, I noticed all of my tests are reporting success even when assertions are failing.  I checked the exit code from testrunner.bat and sure enough it is returning 0 (no error).  Did testrunner break with version 1.7.0?

 

I have "Abort test if an error occurs" and "Fail TestCase if it has failed TestSteps" both enabled.

 

If I launch Testrunner from within ReadyAPI and run the tests there, it also reports Success even when assertions fail.  The setting for "Ignore Errors" is not checked.  I found that if I check the setting for "Run in the same process as the GUI", it returns errors as expected.  Unfortunately that doesn't help since it doesn't seem possible to check that setting when running from the command line.

  • It appears the problem was fixed in 1.8.0.

2 Replies

  • Thanks for reporting this.  We've reproduced the issue and logged it to developers (SOAP-5642).  As soon as I have an update, I'll post here.

     

    Thanks,

    Mike Giller

    SmartBear Software

    • sclavell's avatar
      sclavell
      Occasional Contributor

      It appears the problem was fixed in 1.8.0.