[Res]Running a specific loadtest strategy from command line

Hi,

The loadtestrunner.bat\.sh options that may help are:
-l Sets the loadtest
-m Overrides the LoadTest Limit
-n Overrides the LoadTest ThreadCount

I don't see any specific options for setting the strategy via command line or other fine level of details for a load test.


Regards,
Marcus
SmartBear Support

can you please elaborate what that LoadTest Limit means? Is that the number of client threads? Also, as you mentioned I did not see any reference on how to run a specific strategy. So, it is not possible to do that via command line? If so, is there any other way to do it apart from the UI? I am looking for some way to automate these. We are trying to run these tests in different combinations to see the application limits and running them through UI is not very efficient. If we can run them in multiple thread / rate configurations automatically and dump the reports, then it might be lot faster to just analyze the data.

Hi,

can you please elaborate what that LoadTest Limit means?

The number of runs, it correlates to the Limit text box in the right hand corner.

Is that the number of client threads?

-m sets the number of threads

So, it is not possible to do that via command line?

You can set the load test strategy via the command line with the -l argument.

We are trying to run these tests in different combinations to see the application limits and running them through UI is not very efficient. If we can run them in multiple thread / rate configurations automatically and dump the reports, then it might be lot faster to just analyze the data.

If the command line arguments are not enough you should use the load test strategy "Script" to control the number of threads and other custom functionality.

http://www.soapui.org/Load-Testing/comm ... ution.html


Regards,
Marcus
SmartBear Support

Thank you for the clarification. But -l does not seem to specify strategy but the load test name. For example if I give the cmdline below it fails saying no load test matches. Am I missing anything in the cmdline?

C:\Program Files\SmartBear\SoapUI-Pro-4.6.4\bin>loadtestrunner.bat -e${#Project#
BASE_URL} -hitops-qa-153:8080 -s"Simple Instance Get" -c"Simple Instance GET" -l
"Fixed-Rate" -m20 -n20 -r -FPDF -R"LoadTest Report" -fC:\tmp\LoadUI Z:\svn\UIAl
erts\main\alerts\alerts-it\src\test\resources\Alerts-edaa-Simple-Gets-soapui-pro
ject.xml > c:\tmp\loadUI\1.out

SoapUI Pro 4.6.4 LoadTest Runner
Configuring log4j from [C:\Program Files\SmartBear\SoapUI-Pro-4.6.4\bin\soapui-log4j.xml]
11:16:14,265 INFO [DefaultSoapUICore] initialized soapui-settings from [C:\Users\ramakv\soapui-settings.xml]
11:16:14,665 WARN [SoapUIProGroovyScriptEngineFactory] Missing scripts folder [C:\PROGRA~1\SMARTB~1\SOAPUI~2.1\bin\scripts]
11:16:14,667 INFO [DefaultSoapUICore] Adding listeners from [C:\Program Files\SmartBear\SoapUI-Pro-4.6.4\bin\listeners\demo-listeners.xml]
11:16:15,986 INFO [WsdlProject] Loaded project from [file:/Z:/svn/UIAlerts/main/alerts/alerts-it/src/test/resources/Alerts-edaa-Simple-Gets-soapui-project.xml]
11:16:16,478 INFO [SoapUIProLoadTestRunner] SoapUI suite [Simple Instance Get] finished in 0ms
11:16:16,478 WARN [SoapUIProLoadTestRunner] No load-tests matched argument [Fixed-Rate]

But if I give, for eg,
loadtestrunner.bat -e${#Project#BASE_URL} -hitops-qa-153:8080 -s"Simple Instance Get" -c"Simple Instance GET" -l"Simple Get Loadtest" -m20 -n20 -r -FPDF -R"LoadTest Report" -fC:\tmp\LoadUI Z:\svn\UIAlerts\main\alerts\alerts-it\src\test\resources\Alerts-edaa-Simple-Gets-soapui-project.xml > c:\tmp\loadUI\1.out

It does run and create a report file. But it does not say what strategy it ran. Does it pick up the last saved load test Strategy? If so, then how do I modify the rate and Max Threads for the fixed rate strategy. Since there are two, Threads and Maxthreads for this strategy. I would really appreciate your help.

Hi,

You are correct. -l is the load test name and not the strategy. To set more load test options that the command line does not provide you will have to use Groovy. Please look at the SoapUI API. We do not support custom code solutions.


http://www.soapui.org/apidocs/overview-summary.html



Regards,
Marcus
SmartBear Support

Hi,

Also, you could create load tests with the different strategies and then call them from the command line with the -l option. Similar to this example:

http://www.soapui.org/Load-Testing/comm ... ution.html.



Regards,
Marcus
SmartBear Support

Are there any examples or tutorials on how to use these using groovy?

SmartBear Support wrote:
Also, you could create load tests with the different strategies and then call them from the command line with the -l option. Similar to this example: http://www.soapui.org/Load-Testing/comm ... ution.html.

I don't quite follow here. Say suppose I have to run a simple rate strategy with 100 clients, 50 request/sec with 100 max threads and another with 100 clients, 100 requests/sec with 100 max threads, then I create two load tests, save them and run those two tests for different rate? Does that mean, by default, the load test will pick up the last saved configuration of the load test?

Say suppose I have to run a simple rate strategy with 100 clients, 50 request/sec with 100 max threads and another with 100 clients, 100 requests/sec with 100 max threads, then I create two load tests, save them and run those two tests for different rate? Does that mean, by default, the load test will pick up the last saved configuration of the load test?

Hi, the solution suggested is that you create different LoadTests, like in your example, two LoadTests, each one using a different strategy.
Then from the command line you can specify the LoadTest you want to run which corresponds to the particular strategy you had defined, using the l parameter:
l : The LoadTest to run, used to narrow down which LoadTests to run (http://www.soapui.org/Test-Automation/load-tests.html)
So you would define your strategies in the GUI and your LoadTests differentiated by strategy would be available in your project so you can run the precise one you need from the command line. Otherwise, we do not have a documented approach to changing a LoadTest's configuration using Groovy or through the command line.

Regards,

Giscard
SmartBear Support

Thanks. While trying this, I am seeing that the report is not being generated in PDF. Here is the commandline I am using

"C:\Program Files\SmartBear\SoapUI-Pro-4.6.4\bin"\loadtestrunner.bat -e${#Project#BASE_URL} -hitops-qa-153:8080 -s"Simple Instance Get" -c"Simple Instance GET" -l "Simple Get Loadtest 25 User 25 per Sec" -r -FPDF -R"LoadTest Report 25 Users 25 Per Sec" -fC:\tmp\LoadUI\Get_25_25 Z:\svn\UIAlerts\main\alerts\alerts-it\src\test\resources\Alerts-edaa-Simple-Gets-soapui-project.xml >> c:\tmp\loadUI\1.out

This is generating a folder Get_25_25 with two files in it, all txt
Simple_Get_Loadtest_25_User_25_per_Sec-log
Simple_Get_Loadtest_25_User_25_per_Sec-statistics

Why am I not getting the pdf reports?

Thanks