Forum Discussion

chilber's avatar
chilber
Occasional Contributor
6 years ago

Jenkins does not recognize ReadyApi maven plug-in test failures as unstable build

We're using Ready Api 2.3.0 with the ready-api-maven-plugin 2.3.0 to run our tests, which works fine. Although some tests fail, Jenkins does not recognice the build as unstable, as it should when t...
  • JustinM89's avatar
    JustinM89
    6 years ago

    You are ignoring test failures in your plugin config in this line:

     

    <testFailIgnore>true</testFailIgnore>

     

    Actually, that's not quite correct, according to the documentation, this property determines if a test will continue running if it encounters an error:

     

    Continues the test run even if an assertion triggers.
Possible values: true, false.

     

    After your test runs, you can use the JUnit plugin to parse the results, and that will pass/fail the build.

     

     

JustinM89's avatar
JustinM89
Contributor

You are ignoring test failures in your plugin config in this line:

 

<testFailIgnore>true</testFailIgnore>

 

Actually, that's not quite correct, according to the documentation, this property determines if a test will continue running if it encounters an error:

 

Continues the test run even if an assertion triggers.
Possible values: true, false.

 

After your test runs, you can use the JUnit plugin to parse the results, and that will pass/fail the build.

 

 

chilber's avatar
chilber
Occasional Contributor
6 years ago

Thanks for the answer, JustinM89.

But this does not adress my problem. I don't want the build to fail if a test fails, I want the build to be marked as unstable. Please consider the Jenkins terminology here: https://wiki.jenkins.io/display/JENKINS/Terminology

Thanks

Carsten

 

  • JustinM89's avatar
    JustinM89
    Contributor
    6 years ago

    I should clarify, the JUnit plugin will mark the build unstable (not failed) if there are any test failures.

    • Olga_T's avatar
      Olga_T
      SmartBear Alumni (Retired)
      6 years ago

      Thanks for the clarification, JustinM89.

       

      chilber, does it work for you in this case?