Forum Discussion

joostdgfed's avatar
joostdgfed
Occasional Contributor
6 months ago

Reporting on call-to-testcase

My goal is simple. In readyAPI, I have a test suite A where there is a test case X which only has one or more call-to-testcase test steps that target a test case Y in test suite B.

1) I do not want to report on the test case X (in test suite A) result. If that test step fails, I want only the test case Y in test suite B to report as failed. 

2) Whenever the test suite B starts to run, I do not want to repeat those steps that were run by test case X. I do want to show the proper reporting of test case Y in test suite B. So if 1 test step was failed during the run in test case X, I do want to show that test case Y as failed.

Why? Test suite A and test suite B encompass different API's to test. There is however a interaction between these 2 API's in order to test fully E2E.  

How to do this properly in ReadyAPI?

What I tried:

  • In test case X I disabled the checkbox that says "Fail Test Case if it has failed Test Steps". So to me, this means that this test case X will not fail (but pass?) regardless of the actual test step statuses.

Actual: It seems (at least in the readyAPI UI) that this setting is ignored? A run will still mark that test case X as failed in test suite A. Same in the jUnit reporting.

  • In test suite B I tag the test cases that were run exclusively by test suite A. In the test suite setup script I then disable all those test cases that so they will not run again during test suite B execution. In the test suite teardown script I re-enable those.  
  •  During a test suite B run, in test case Y I use the test case setup script to disable the test steps that were execute by test case X and then re-enable them in the test case teardown script. 

Actual: Neither results in proper reporting of the test suite B test cases. Either the results are not reported or the results show a PASSED where actually there should be a failed.

1 Reply

  • mantrobus123's avatar
    mantrobus123
    6 months ago

    I've been observing the same issue since 3.56 with the 'Fail Test Case if it has failed Test Steps' option, I'm surprised it hasn't been fixed yet.

    You can use version 3.55, the option works in this version of readyapi, I've been hard stuck on this version until this setting gets fixed myself.

    I'm not sure if this will fix the entire problem/configuration of what you're trying to do, but at least the setting works.