mnwill117's avatar
mnwill117
Occasional Contributor
5 hours ago
Status:
New Idea

Yellow 'Caution' status (in addition to pass/fail)

As a user, i would like to differentiate between new failures and existing/expected failures so i can easily triage new failures and not chase known issues we are already tracking. 

Use Case: 

  1. Test case fails
  2. Issue is logged with root cause of failure
  3. Waiting on fix for issue

What happens now: assertion continues to fail, causing test case to fail, causing test suite to fail. 

What I want to happen: I wish i could label, tag, or denote the failed assertion as a 'known issue' and have the status be yellow vs. red/green. That way i know if suite fails 'yellow' everything is expected/known/tracked vs. a suite failing 'red' contains issues i am not tracking. 

I don't want to disable the assertion as its still failing, i don't want to disable the test step as i'm still testing other assertions.

No CommentsBe the first to comment