Flagging Known Bugs
So i wrote some UI tests for some feature which have known bugs.
Obviously those tests are currently failing because indeed the feature is broken.
However in my azure pipeline i would those tests to be flagged differently than other failing test so that i can know which one are really new failing tests.
The most logical way would be to show them as warning instead or errors.
Do you have an idea on how i could achieve this?
Currently im trying to use a @KnowIssue tag to identify those test, but not sure how to really consider that.
Also i though of renaming my test with a KnowIssue_ prefix and have the following OnStopTestCase event:
function TestFail_OnStopTestCase(Sender, StopTestCaseParams) {
// Check if the test case failed
if (StopTestCaseParams.StatusAsText == "Error") {
// Check if the test case is tagged with @KnownIssue
if (Project.TestItems.Current.Name.startsWith("KnownIssue_")) {
// Log a warning instead of a failure
Log.Warning("Test case '" + StopTestCaseParams.Name + "' failed but is marked as a known issue.");
}
}
}
Sadly this only add a warning on top of the current error and therefore the test still "fails with error"
Any ideas are welcome :)
I like to post a warning on top and disable the actions inside the Keywordtest, this way you can see what tests are disabld by the warning, and then just remove the warning an re-enable when it gets fixed:
If you use a ticket system you could post the ticket number in the warning.
