selkind
16 years agoOccasional Contributor
statistics not reset with thread count change
I'm trying to put in a place a scenario with a warm-up period using multiple threads, followed by the actual test case where we send a single stream of requests with a fixed delay between requests - so I need the statistics reset at the time of the change to see the results of the measured part of the test.
So, I set up a load test with "Thread" strategy, 2 (also tried 1) threads, starting at two threads and ending at one. I also ensured that in the load test options "Reset statistics when the number of threads changes" is checked.
However, I see a long entry when the number of threads goes to 1, and the rate of requests does seem to get cut in half - but the statistics do not get reset. The "count" statistic continues to climb from the last logged value (also as seen in the GUI window), and min/max/avg don't change.
Just to double-check, I reversed the scenario, starting at one thread, increasing to two, and statistics are still not reset. For example:
date,threads,elapsed,min,max,avg,last,cnt,tps,bytes,bps,err,reason
...
Tue Mar 16 08:26:51 EDT 2010,1,14002,377,4700,671.9,539,20,1.48,149840,11119,0,13438,Interval
Tue Mar 16 08:26:52 EDT 2010,1,15001,377,4700,655.59,382,22,1.52,164824,11399,0,14423,Interval
Tue Mar 16 08:26:52 EDT 2010,1,15096,377,4700,655.59,382,22,1.52,164824,11399,0,14423,ThreadCount change from 1 to 2
Tue Mar 16 08:26:53 EDT 2010,2,16001,377,4700,532.33,801,25,3.74,22476,28059,0,1597,Interval
Tue Mar 16 08:26:54 EDT 2010,2,17001,377,4700,535.16,527,28,3.5,44952,26226,0,3211,Interval
...
Am I missing something here in the way I'm setting things up or viewing the results, or in my expectations?
Thanks in advance for any help.
This is v3.5, downloaded yesterday.
So, I set up a load test with "Thread" strategy, 2 (also tried 1) threads, starting at two threads and ending at one. I also ensured that in the load test options "Reset statistics when the number of threads changes" is checked.
However, I see a long entry when the number of threads goes to 1, and the rate of requests does seem to get cut in half - but the statistics do not get reset. The "count" statistic continues to climb from the last logged value (also as seen in the GUI window), and min/max/avg don't change.
Just to double-check, I reversed the scenario, starting at one thread, increasing to two, and statistics are still not reset. For example:
date,threads,elapsed,min,max,avg,last,cnt,tps,bytes,bps,err,reason
...
Tue Mar 16 08:26:51 EDT 2010,1,14002,377,4700,671.9,539,20,1.48,149840,11119,0,13438,Interval
Tue Mar 16 08:26:52 EDT 2010,1,15001,377,4700,655.59,382,22,1.52,164824,11399,0,14423,Interval
Tue Mar 16 08:26:52 EDT 2010,1,15096,377,4700,655.59,382,22,1.52,164824,11399,0,14423,ThreadCount change from 1 to 2
Tue Mar 16 08:26:53 EDT 2010,2,16001,377,4700,532.33,801,25,3.74,22476,28059,0,1597,Interval
Tue Mar 16 08:26:54 EDT 2010,2,17001,377,4700,535.16,527,28,3.5,44952,26226,0,3211,Interval
...
Am I missing something here in the way I'm setting things up or viewing the results, or in my expectations?
Thanks in advance for any help.
This is v3.5, downloaded yesterday.