4.0.1 Not marking test as passed

I ran the test case, and this test failed. I fixed the assertion and re-ran the test. It says pass in the assertions, but this red x (indicating the test has failed) persists. I am seeing this multiple times in my test suite. 

Now going back to 3.x.x. I knew there was a reason I did not update the installer, just new installation. Makes it easier to go back. Pretty bad when the customer reverts.