Create a testcase that uses DataSource Excel.For the Worksheet specify a name that does not exist in your spreadsheet.In the testCase options, set Abort on Error = checked.Run the testCase from command like testrunner. Notice testrunner will exit with error status.Change the testCase options, set Abort on Error = unchecked.Run the testCase from command like testrunner. Notice testrunner will now exit with non-error status.

Is this really a bug though? Leaving the Abort on Error unchecked seems to indicate that you want the errors to be ignored.How would you expect it to work?Regards,Manne

In all other cases, abort on error has nothing to do with the final status of the testcase or testsuite. It only controls if the test continues or aborts after a failed step.

Yes, you're right. Another developer will have a look at this right away.Thanks for reporting this,Manne

Have you tried to set the TestCase property "Fail TestCase on Error" - when enabled the test case should fail if there was an error in the data source test step.? If this property is not enabled then the test case will pass without error.Best Regards,PrakashSmartBear Sweden

SmartBear Support wrote:Have you tried to set the TestCase property "Fail TestCase on Error"That option is set by default and I did not change it - it is set.

Forum Discussion

SiKing

Community Expert

12 years ago

DataSource Excel wrong worksheet

Create a testcase that uses DataSource Excel.

For the Worksheet specify a name that does not exist in your spreadsheet.

In the testCase options, set Abort on Error = checked.

Run the testCase from command like testrunner. Notice testrunner will exit with error status.

Change the testCase options, set Abort on Error = unchecked.

Run the testCase from command like testrunner. Notice testrunner will now exit with non-error status.

SiKing
Community Expert
12 years ago
I found the problem: I had a testRunner.cancel() in my test, after the failed DataSource.

This was a user error. Sorry about all the confusion.
SmartBear_Suppo
SmartBear Alumni (Retired)
12 years ago
Great that you got it solved!

Regards
Joel
SmartBear Sweden