TestComplete- Compare Result Log Trends
Background: Our automated tests run nightly via Azure Pipelines and Test Execute. The .MHT logs provided from this output frankly suck and aren't usable. Question: Has anyone implemented anyth...
Forum Discussion
scot1967
Champion Level 3
Champion Level 3H BTip,
Yes, we have done trend analysis on pipeline runs. I use Power BI for this connected into Devops. There are also tools within Devops that will allow this sort of analysis as well. I would really checkout SmartBear's Zephyr if seemless intyegration with TestComplete and other products is needed https://smartbear.com/test-management/zephyr/
PowerBi DIY Report requiring a lot of tedious connections to the DevOps Tables.
DevOps also has some nice built in tools. These allow analysis logging and tracking.
Also, (This from and OLD document ut it might still work. There is a .trx file in the pipeline results you can import into Visual Studio.
- Open the downloaded .trx file.
- It should open in Visual Studio by default.
- The results will be shown in the bottom pane of Visual Studio.
- Group the list in Visual Studio by ‘Result’ and select all the failed results and copy them to the clipboard.
- Once selected, the list can also be sorted, and any unwanted columns can be removed.
- Once the list has been copied into the clipboard, paste it into a new Excel spreadsheet.
scot1967 Are you running your integration tests using TestComplete? Or creating your test plans within DevOps?
- scot1967
The "Test Plans" containing the "Test Cases" are created in DevOps and the "Test Cases" are created/automated in TestComplete and run in a DevOps Pipeline. Each automation test case is named with the TestCase number in a standard format. The Execution Plan is used to tie it all together. The "Link to external test case" in the execution plan can also be used to further tie things together here.