Wrong error count Issue with Log report

[iamraj09]

Wrong error count is displayed in the Log report. Test has been executed with latest Test Complete version 12.41 i.e., when only one test item failed the error count is displayed as "6". 

Please refer the screen shot attached with this post and please let us know if it is a bug or problem with the settings in Test Complete.

Best Regards

Guru.

[tristaanogre]

Not sure... worth reporting to SmartBear support to see what they say...

However...  please note that a failed test item != error count.... Error Count = number of entries in the test log that are errors... in your screenshot alone, I see 4... Application Central not started, listboxProjectExplorer does not exist, Invalid Varieant operation, Script execution interrupted... that's 4 errors right there.  It's possible that the count has two extra probably from the "Others" and "Prepare" tree nodes but I'm not certain.

[AlexKaras]

@iamraj09:

Hi,

Like Robert said, this is how TestComplete counts errors: real errors posted to the leaf logs plus errors for the failed test items.

This was discussed with Support and personally I consider this to be misleading, but this is not considered to be changed as far as I was told.

If you like, you may create Support ticket via the https://support.smartbear.com/message/?prod=TestComplete form and voice your opinion directly to SmartBear.

[iamraj09]

@AlexKaras@tristaanogre

Thank you for the reply. I have another image of the Log report in attachment, please have look at it, because as per the logic that you have described, the image in the attachments should have "3" errors but it is displayed as only "2". which is completely misleading. But any way I have created the ticket.

[AlexKaras]

Hi,

Well, I am not 100% sure that the logic is exactly like I wrote (except the fact that it counts not only 'real' errors posted to the log but also (some) errors that correspond to the failed test items).

Hope that you will get more definite answer from Support.

In any case it is a good practice to go through the log and check errors there one by one. (And yes, I absolutely agree that it can cause you some problems if you mail test log with those 6 errors to the management while actually there were only 4 errors during test run.)

[iamraj09]

@AlexKaras thank you for understanding my point -> "(And yes, I absolutely agree that it can cause you some problems if you mail test log with those 6 errors to the management while actually there were only 4 errors during test run.)".

It will be difficult to convince them with that misleading information. :).Anyway I wrote a ticket and they replied me ..I am going to send my project and related information to them.