Ask a Question

Difference between Test Case Level and Test Step Level

SOLVED
vondie
Contributor

Difference between Test Case Level and Test Step Level

I am new to load testing and trying to understand the Test Step Metrics in a test case with only one test step. What is the difference between Test Case Level and Test Step Level in regards to the Median? The Median values are five seconds apart... it seems like they should be the same though if there's only one test step. The same with errors. Why are they showing different values?

 

loadtestresults.jpg

1 ACCEPTED SOLUTION

Accepted Solutions
JamesLunan
Staff

Re: Difference between Test Case Level and Test Step Level

Hello Vondie, 

 

I recommend using the Statistics tab for these details, which uses a different way of mapping the results. It should not display this same issue. The real-time chart and statistics on the "Load" tab is using a different method of collecting data and more details below.

 

Basically it comes down to how this report is created. It is trying to capture events happening in a specific second and for some reason there is a separation of the test case and test step registering in the same time window on the report. I've created a research exercise for engineering that should kick off a longer-term effort to make this chart more clear. They should be showing the same values in your test setup and they do not. 

 

More to come on this in the future and thank you for posting this.

-----
James Lunan
SmartBear Product Manager

-----
Ready! Api Platform and Tools

View solution in original post

2 REPLIES 2
JamesLunan
Staff

Re: Difference between Test Case Level and Test Step Level

Hello Vondie, 

 

I recommend using the Statistics tab for these details, which uses a different way of mapping the results. It should not display this same issue. The real-time chart and statistics on the "Load" tab is using a different method of collecting data and more details below.

 

Basically it comes down to how this report is created. It is trying to capture events happening in a specific second and for some reason there is a separation of the test case and test step registering in the same time window on the report. I've created a research exercise for engineering that should kick off a longer-term effort to make this chart more clear. They should be showing the same values in your test setup and they do not. 

 

More to come on this in the future and thank you for posting this.

-----
James Lunan
SmartBear Product Manager

-----
Ready! Api Platform and Tools

View solution in original post

vondie
Contributor

Re: Difference between Test Case Level and Test Step Level

Thanks, James! I am looking forward to seeing this enhanced! 

cancel
Showing results for 
Search instead for 
Did you mean: