Forum Discussion

katgat's avatar
katgat
Occasional Contributor
13 years ago

Different Loadui results with Different Soapui versions

Hello, I am seeing different LoadUI results depending on the SoapUI version I use (at least that is the only difference I can identify). Using LoadUI 2.0.1 if I test with SoapUI 4.5.0 all seems to work fine with my load testing and results are as expected. We run 20 requests per second (fixed rate) and after 1 minute our application processes approximately 1200 requests. While LoadUI is running, the "Running" queue never really goes above 20 requests and none get queued. But with SoapUI 4.5.1, we only process about 895 requests in that same time period. When running the test, the "Running" queue maxes out at 100 and many end up being queued (in the hundreds). The two sets of tests (i.e. running one test with LoadUI 2.0.1/SoapUI 4.5.0 and then with LoadUI 2.0.1/SoapUI 4.5.1) are run back to back against the same web service that we are testing - so no difference in the web service code version that each one hits. I have compared the configurations and settings and everything looks the same. The only difference I see is using the different version of SoapUI. Is there a known issue around this? Or is there something I am missing? Thanks.

2 Replies

  • PM_r's avatar
    PM_r
    Icon for Staff rankStaff
    13 years ago
    Hi!

    LoadUI uses its own bundled soapUI engine, so it never interacts any soapUI installations on your machine.

    With that being said, you should really use loadUI 2.1.1 as it uses the soapUI 4.5.1 engine instead of the 4.5.0 engine. The 4.5.0 engine had two known bugs related to HTTP and parallelism :-/

    Regards

    Henrik
    SmartBear Software
  • katgat's avatar
    katgat
    Occasional Contributor
    13 years ago
    Hi Henrik, thank you for the quick reply! I am confused though when you say that loadui doesn't interact with any soapui installations on my machine. To get the logging working in loadui, I had to add a Property Transfer in my soapui and it uses those test cases from my soapui. So does that mean it just uses my project file but not my actual soapui install?

    Also, how can I find in loadui what version of soapui it is bundled with (would be good to know for future)?

    Thanks for your help!