Forum Discussion

AndyHughes's avatar
AndyHughes
Regular Contributor
14 years ago

How to manage hundreds of load tests?

What is the best way of managing a large amount of load tests without it becoming labour intensive.?

I have literally in the region of 400 SOAPUI requests that need load testing.

I have set up a load test in LOADUI using a SOAPUI runner and I can change the SOAPUI test that I run each time I run a load test. But I don't want to have to babysit the whole process, changing the SOAPUI test that I run 400 times. Even if my load test takes 5 mins to complete and file away the results it will take me a relentless week with no issues to get through 1 full run.

So how can I 'Automate' the whole process so that I only have to kick it off once, and it 'magically' changes the test case when each load test is finished.

3 Replies

  • AndyHughes's avatar
    AndyHughes
    Regular Contributor
    14 years ago
    Could I use an interval scheduler?

    If I set the duration of the scheduler to be infinite then will this run the test case until the test case ends? (The test case itself has a time limit)
    I could then set each test running 5 mins after the previous one and hopefully only one will be running at once.

    This is still a lot of initial work though to get 400 test scheduled.

    Or is there any way of using the same LoadUI test and changing the SOAPUI test case in the SOAPUI runner once the test has completed (after 3 mins) and getting it to cycle through all 400 SOAPUI test cases.
  • AndyHughes's avatar
    AndyHughes
    Regular Contributor
    14 years ago
    Still thinking about the best way to approach this. I've come up with the idea of running it all from the command line.
    From a previous post I made, I'm under the impression that each line in the command prompt is executed (and finished) before the next one is started. So in the example below, they would be done sequentially.

    loadUI-cmd.bat "-DmyCustomEndpoint=http://myWebSite.com" -p my-loadui-project.xml
    loadUI-cmd.bat "-DmyCustomEndpoint=http://myWebSite.com/admin.php" -p my-loadui-project.xml
    loadUI-cmd.bat "-DmyCustomEndpoint=http://foo.bar"-p project1.xml -r c:\reports -F PDF
    loadUI-cmd.bat "-DmyCustomEndpoint=http://twitter.com/eviware" -p testSLA1.xml

    So what I'm trying to work out is.......

    1. Is there any way I can use property transfers/expansion to reference a specific SOAPUI test case within LOADUI so that I only need 1 LOADUI test case. Then I can run it from the command line as follows loadui-cmd.bat -p my-loadui-project.xml -t MyLoadUITestCase -L 3600:0:0 but every time I run this line I want to be able to specify a different SOAPUI test case within MyLoadUITestCase's runner.

    So to recap, is there any way to run loadui passing through parameters which i can pickup in loadui, at the moment i can only see how to pick them up in SOAPUI
  • SmartBear_Suppo's avatar
    SmartBear_Suppo
    Icon for Alumni rankAlumni
    14 years ago
    Hi Andy!

    Currently there is no really good way to accomplish this.

    I've informed our Head of Products about this [LUCO-2470].


    Regards

    Henrik
    SmartBear Software