TestComplete- Compare Result Log Trends

Question

Background:Our automated tests run nightly via Azure Pipelines and Test Execute. The .MHT logs provided from this output frankly suck and aren't usable.&nbsp;&nbsp;Question:Has anyone implemented anything where they take the log results and store these separately (SQL, Access, etc) for trend comparison?I'd like to be able to easily compare results for Keyword Test 1 ran on Monday against the same Keyword Test 1 ran on Tuesday without having to view the detailed logs. My primary concern is: Did Keyword Test 1 fail on Tuesday when it passed on Monday.

rraghvani · Answer

I've set the automation to send an email (parsed XML summary results) once the run has completed. The data provided by the XML summary results can be inserted into SQL too. I usually compare the latest run with the previous run, similar to trend comparison I guess.
Great, one test has passed!

scot1967 · Answer

H BTip,Yes, we have done trend analysis on pipeline runs. I use Power BI for this connected into Devops.&nbsp; There are also tools within Devops that will allow this sort of analysis as well.&nbsp; I would really checkout SmartBear's Zephyr if seemless intyegration with TestComplete and other products is needed https://smartbear.com/test-management/zephyr/&nbsp;PowerBi DIY Report requiring a lot of tedious connections to the DevOps Tables.&nbsp;

DevOps also has some nice built in tools.&nbsp; These allow analysis logging and tracking.

Also, (This from and OLD document ut it might still work.&nbsp; There is a .trx file in the pipeline results you can import into Visual Studio.&nbsp;

Open the downloaded .trx file.

It should open in Visual Studio by default.

The results will be shown in the bottom pane of Visual Studio.
Group the list in Visual Studio by ‘Result’ and select all the failed results and copy them to the clipboard.
Once selected, the list can also be sorted, and any unwanted columns can be removed.
Once the list has been copied into the clipboard, paste it into a new Excel spreadsheet.

&nbsp;

scot1967 · Answer

The "Test Plans" containing the "Test Cases" are created in DevOps and the "Test Cases" are created/automated in TestComplete and run in a DevOps Pipeline.&nbsp; Each automation test case is named with the TestCase number in a standard format.&nbsp; The Execution Plan is used to tie it all together.&nbsp; The "Link to external test case" in the execution plan can also be used to further tie things together here.