cancel
Showing results for 
Search instead for 
Did you mean: 

Is there an option that will count the number of checkpoints in the summary log?

Highlighted
Contributor

Is there an option that will count the number of checkpoints in the summary log?

Please refer to the image below:

 

Summary_log_number_of_checkpoints.jpg

 

Thanks,

Russel

9 REPLIES 9
Highlighted
Community Hero

Re: Is there an option that will count the number of checkpoints in the summary log?

I don't think Test Complete have that option, If you want this feature you can create Improvement request here


Thanks
Shankar R

LinkedIn | CG-VAK Software | Bitbucket | shankarr.75@gmail.com

“You must expect great things from you, before you can do them”


Extension Available

Highlighted
Community Hero

Re: Is there an option that will count the number of checkpoints in the summary log?

While not default as part of the overview, but you can get the checkpoint count by Log.CheckpointCound in script.


Thanks,
Carson

Click the Accept as Solution button if my answer has helped
Highlighted
Contributor

Re: Is there an option that will count the number of checkpoints in the summary log?

This will be helpful, I just need to find a way summarize all the results of all the checkpoint.

 

Thanks,

Russel

Highlighted
Community Hero

Re: Is there an option that will count the number of checkpoints in the summary log?

Hi Russel,

 

Out of curiosity... Can you provide your definition of checkpoint and a sample use case?

 

Assuming that checkpoint is a result of Log.Checkpoint command and/or any other checkpoint command provided by TestComplete (File, Region, web table, etc.) and that one test item can (and usually do) contain more than one checkpoint, what metric can be obtained from the summary that will have, say, text like "9 test items passed with 10 checkpoints" ? Will that mean that 8 test items have 1 checkpoint each and the 9th test item has 2 checkpoints? Can this help to figure out the situation when one test item contains all 10 checkpoints while 8 others contain none? Is the number of checkpoints somehow correlated with the quality of the given test?

Just wondering...

Regards,
Alex
[Community Expert Group]
____
[Community Expert Group] members are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Postings made by [Community Expert Group] members
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
[Community Expert Group] signature is used with permission by SmartBear Software.
http://smartbear.com/forums/f83/t86934/community-experts/
================================
Highlighted
Community Hero

Re: Is there an option that will count the number of checkpoints in the summary log?

Prime example... I have some test cases that I'm working with that only have 5 or 6 "checkpoint" calls in them.  Other functionality is tested using "if-then" logic to detect objects, error message, etc.  If all the checkpoints pass but one of those other logic statements fail, the test fails.  The detailed test log then gives me the why.  Likewise, if the logical tests pass but the one of the checkpoints fail, still, the test fails.

 

I have other test cases that have 20-30 checkpoints in them. A count, from the log, of all checkpoints and their individual result (pass or fail) is not important to me.  What's important is if the test case in total passes or fails.  If it passes, I really could care less what the checkpoints tell me.  If it fails, then I dive into the detail log to determine what, exactly, generated the error.

 

So, as @AlexKaras, it might be helpful to know what usage you have for the checkpoint counts and how it relates to the status of any given test run/test case.  There may be better ways of achieving your goal.


Robert Martin
[Community Expert Group]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available
Highlighted
Contributor

Re: Is there an option that will count the number of checkpoints in the summary log?

Hi Alex,

 

Based on the request that I have received, they are in need on the number of checkpoints not the number of test items.

For example, I have 10 project items wherein the items contains the steps on how the test goes.

All of the project items does not a checkpoint except for item #10 wherein It has 5 checkpoints (property, region, database etc.)

 

What I current did to satisfy their request is in the Summary Log, the information will be present:

*NOTE: My actual test may vary result, this is just for presentation.

 

Total number of project test items:10
Executed project test items:10

 

Project Test Item Results
Passed:9, including 0 warning(s)
Failed:1

 

But on the last keyword , I have added a script That would count the checkpoints.

Total Number of Checkpoint : 5

Total Number of Checkpoint - PASS : 3

Total Number of Checkpoint - FAIL : 2

 

I hope my explanation is quite clear.

Would there be any suggestions with regards to increasing the quality of test, I would appreciate.

 

Thanks,

Russel

Highlighted
Community Hero

Re: Is there an option that will count the number of checkpoints in the summary log?

So, it's a matter of a reporting requirement by your client then?

 

What I would suggest, then, is to utilize the OnLogCheckpoint event handler to enumerate the checkpoints into a global variable.  This will at least enumerate the number passed as, I believe, failed checkpoints simply log as an error.

 

if the number of checkpoints is known, then, ahead of time, you could take that value from OnLogCheckpoint, subtract it from the known total to get the number of failed.  Then report this out as needed.


Robert Martin
[Community Expert Group]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available
Highlighted
Contributor

Re: Is there an option that will count the number of checkpoints in the summary log?

Hi Tristan,

 

If ever possible, can you give me an idea on the events.

 

I haven't used any of the events. No idea so far.

 

Thanks,

Russel

Highlighted
Community Hero

Re: Is there an option that will count the number of checkpoints in the summary log?

Best documentation is http://support.smartbear.com/testcomplete/docs/testing-with/advanced/handling-events/creating-handle...


Robert Martin
[Community Expert Group]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available