how to set baseline performance
Hi Team,
Any idea how to set baseline performance in Soap UI.
Thanks,
Hi,
In SoapUI itself you can add various assertions to each service. One of the assertion types is 'Response SLA'. This type of assertion allows you to define a max response time in milliseconds. If the service takes longer to respond than the time in assertion, the step fails. Obviously, you have to run each service, look at the response time and then think "what should the max be?". This is fine for a broad brush stroke approach and I use these for spotting poorly performing services.
But in terms of baselining and performance, Response SLA is not ideal.
An approach I have taken is this....
- - Created a test containing various calls I want to monitor.The final step in my test is a groovy script step that logs the response time for each service to the log console.
- - Created a spreadsheet where each tab contains the response times for a single run
- - Created a summary sheet in the spreadsheet that puts each runs results side-by-side
Whenever I test a new build, or there is patching, or the db changes or whatever else, I run the test again; create a new tab in spreadsheet; show results in the summary sheet.
The summary sheet then gives me a clear view of positive of negative change in performance.