Forum Discussion

rajs2020's avatar
rajs2020
Frequent Contributor
5 years ago

ReadyAPI - How to repeat failed API tests ?

When *some* API tests fail, then we repeat it (say 3 times) until it succeeds. Currently, we do this by putting a "repeat" script in the tear down script (tab) of every test suite which is prone to f...
  • JKolosova's avatar
    JKolosova
    4 years ago

    Hi rajs2020,

    We currently do not have a feature like that in ReadyAPI, indeed. However, there is the corresponding feature request in our DB, and I have increased its rating according to your message, thanks.

    Using TearDown scripts to rerun failed tests sequentially or in parallel looks to be a good solution for now. For example, you can use a script from the Rerun failed test steps sample project available here:
    https://staging-support.smartbear.com/readyapi/docs/samples/index.html

rajs2020's avatar
rajs2020
Frequent Contributor

Yes, repeating tests seems like a problem with the dev code, test code or timing. IMO, repeated failures should be rare and hence tests should only be repeated manually. Automated repeating might mask serious problems. I don't know how such problems could be revealed outside of regression/functional testing. They might get revealed during performance testing or not.

BUT, I cannot prevent the repetition of failing tests for now. So, I'd like to know how to repeat tests for the short term.

 

JKolosova's avatar
JKolosova
SmartBear Alumni (Retired)
4 years ago

Hi rajs2020,

We currently do not have a feature like that in ReadyAPI, indeed. However, there is the corresponding feature request in our DB, and I have increased its rating according to your message, thanks.

Using TearDown scripts to rerun failed tests sequentially or in parallel looks to be a good solution for now. For example, you can use a script from the Rerun failed test steps sample project available here:
https://staging-support.smartbear.com/readyapi/docs/samples/index.html

  • rajs2020's avatar
    rajs2020
    Frequent Contributor
    4 years ago

    Thanks JKolosova . I'll see that example. Btw, it would be nice to have a cookbook for common ready api use cases. For many programming languages, people have written cookbooks for common tasks like getting the current time in a desired time zone, converting DB result sets to csv files, reading excel sheets etc. Looks like your link on samples is a tiny cookbook of sorts. But, it would be nice to declare it as such, add more content to it and update it regularly.

    BTW, here is an example of a cookbook for the Python language:
    https://www.amazon.com/Python-Cookbook-Third-David-Beazley/dp/1449340377