Ask a Question

Wrong error count Issue with Log report

iamraj09
Contributor

Wrong error count Issue with Log report

Wrong error count is displayed in the Log report. Test has been executed with latest Test Complete version 12.41 i.e., when only one test item failed the error count is displayed as "6"

 

Please refer the screen shot attached with this post and please let us know if it is a bug or problem with the settings in Test Complete.

 

Best Regards

Guru.

5 REPLIES 5
tristaanogre
Community Hero

Re: Wrong error count Issue with Log report

Not sure... worth reporting to SmartBear support to see what they say...

However...  please note that a failed test item != error count.... Error Count = number of entries in the test log that are errors... in your screenshot alone, I see 4... Application Central not started, listboxProjectExplorer does not exist, Invalid Varieant operation, Script execution interrupted... that's 4 errors right there.  It's possible that the count has two extra probably from the "Others" and "Prepare" tree nodes but I'm not certain.


Robert Martin
[Hall of Fame]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available
AlexKaras
Community Hero

Re: Wrong error count Issue with Log report

@iamraj09:

Hi,

 

Like Robert said, this is how TestComplete counts errors: real errors posted to the leaf logs plus errors for the failed test items.

This was discussed with Support and personally I consider this to be misleading, but this is not considered to be changed as far as I was told.

If you like, you may create Support ticket via the https://support.smartbear.com/message/?prod=TestComplete form and voice your opinion directly to SmartBear.

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================
iamraj09
Contributor

Re: Wrong error count Issue with Log report

@AlexKaras@tristaanogre

 

Thank you for the reply. I have another image of the Log report in attachment, please have look at it, because as per the logic that you have described, the image in the attachments should have "3" errors but it is displayed as only "2". which is completely misleading. But any way I have created the ticket.

AlexKaras
Community Hero

Re: Wrong error count Issue with Log report

Hi,

 

Well, I am not 100% sure that the logic is exactly like I wrote (except the fact that it counts not only 'real' errors posted to the log but also (some) errors that correspond to the failed test items).

Hope that you will get more definite answer from Support.

In any case it is a good practice to go through the log and check errors there one by one. (And yes, I absolutely agree that it can cause you some problems if you mail test log with those 6 errors to the management while actually there were only 4 errors during test run.)

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================
iamraj09
Contributor

Re: Wrong error count Issue with Log report

@AlexKaras thank you for understanding my point -> "(And yes, I absolutely agree that it can cause you some problems if you mail test log with those 6 errors to the management while actually there were only 4 errors during test run.)".

 

It will be difficult to convince them with that misleading information. :).Anyway I wrote a ticket and they replied me ..I am going to send my project and related information to them. 

cancel
Showing results for 
Search instead for 
Did you mean: