rancohen wrote:
To simulate user inputs. The user will not run the tests the same sequence as they tested. In some cases there is relation to the order of the tests.
Ran
That's not something to be tested with randomization of tests... it sounds like you want to test what happens with different "starting conditions". That's different test cases. Randomization of test order creates unpredictability in determining what causes any bugs. It would be better to control the tests so you can have better reproduction of what causes bugs.
Regardless, as mentioned before, there is no way "out of the box" to do what you're asking. You need to write code to randomize your test case execution. You won't get the nice neat "test items" results that you get now. You will have to find some other method to generate a similar report.