Load test using SOAPUI issues

Hi!

hmm.. can you confirm these issues also with the newly released 4.0.0 version? If so, could you attach your project so we can try to reproduce?

regards,

/Ole
eviware.com

i have some problems with load tests in 4.0.0 and 4.0.1
Build soapui-pro-4.0.1-daily-2011-07-07-[1], Build Date 2011/07/07 02:30

i have simple test case with 3 test steps.

first is groovy to initialize some data.
second is soap test step.
third is groovy to verify response from second test step.

the problem is, when i call this line in third test step:
def response = context.expand( '${retrieveCdrs - Request 1#Response#declare namespace...blablabla...' )
i don't get anything.
log.info is empty.

it works if i run this manually in test case, it also works if i loop test case continuously, but it doesn't work in load test!

on the other hand, the same project works without any problems in version 3.6.2.

i have paste the project if it helps enathing.

please help.

Beno

Hi Beno,

have you checked the option "Do not disable Groovy Log" in the global UI Settings tab?

regards,

/Ole
eviware.com

hi,

yes, i did.
if i put log.info "aaaaa" it's shown correctly, no problems with this.
but if i use def response = context.expand(...) and try to show this, it's empty.
"log.info" is not a main problem at all.
the problem is, when i try to call response and do some assertions in groovy right after the response was recieved in soap message, nothing is done because there is no response!
well, it looks like this.
but on the other hand, HTTP monitor shows me all responses correctly.
i don't have any "events" configured on my project. SubmitListener.After... and stuff like this.
i really don't know what could be the problem.

it's not working in 4.0 and not in few latest nightly buidls. as i mentioned, everything works in 3.6.2 and perhaps also earlier versions, i didn't try them all.
if project works on earlier version (not that old at all!) i don't see any reason why shall not with 4.0.0 and later. especialy since it's a very simple project with just 1 request and 2 simple groovys.


man...
i have something else for you.
i tried another project and it has a problem with 4.0.x also!
it has 3 soap requests. after each of them i put groovy with log.info response.
1 of the groovys is returning me log.info response, other 2 are empty again. huh...

project was created in 4.0.1 (cloned) and it doesn't work as it should in load test. when i import the same project in older soapui version it works again!
i'll paste that project also.
it's very simple.

once again, if i run entire test suite or "Run this test Case" - i can use "loop" option also, there aren't any problems.
but in a load test... problem.

with best regards,
beno

Hi Beno,

It looks like you have set the "Max Results" option in the containing TestCase Options dialog to 0; please try setting this to a higher value (for example 100) to see if that helps.

regards!

/Ole
eviware.com

this doesn't change anything for me.
i though 0 means unlimited.

Ole, if you'll check my second project, this is what i get in script log:

Fri Jul 08 08:26:18 CEST 2011:INFO:5000
Fri Jul 08 08:26:18 CEST 2011:INFO:
Fri Jul 08 08:26:19 CEST 2011:INFO:5000
Fri Jul 08 08:26:19 CEST 2011:INFO:
Fri Jul 08 08:26:21 CEST 2011:INFO:5000
Fri Jul 08 08:26:21 CEST 2011:INFO:<soapenv:Envelope xmlns:soapenv="http://www.w3.org/2003/05/soap-envelope">
   <soapenv:Body>
      <getSupplementaryServicesResponse xmlns="urn:iskratel-si:itnbsp-1-0">
         <subscriber node="1200" areaCode="5" dn="5000" xmlns="">
            <service oid="CBAC">
               <param value="0" key="barringClass"/>
            </service>
            <service oid="CBSC">
               <param value="0" key="barringClass"/>
               <param value="no" key="authorization"/>
               <param value="no" key="activation"/>
               <param value="1111" key="password"/>
            </service>
            <service oid="DND">
               <param value="no" key="authorization"/>
               <param value="no" key="activation"/>
            </service>
            <service oid="CFU">
               <param value="yes" key="authorization"/>
               <param value="no" key="activation"/>
            </service>
...
         </subscriber>
      </getSupplementaryServicesResponse>
   </soapenv:Body>
</soapenv:Envelope>
Fri Jul 08 08:26:23 CEST 2011:INFO:5000
Fri Jul 08 08:26:23 CEST 2011:INFO:
Fri Jul 08 08:26:24 CEST 2011:INFO:5000
Fri Jul 08 08:26:25 CEST 2011:INFO:
Fri Jul 08 08:26:26 CEST 2011:INFO:5000
Fri Jul 08 08:26:26 CEST 2011:INFO:
Fri Jul 08 08:26:28 CEST 2011:INFO:5000
Fri Jul 08 08:26:28 CEST 2011:INFO:
Fri Jul 08 08:26:29 CEST 2011:INFO:5000
Fri Jul 08 08:26:29 CEST 2011:INFO:
Fri Jul 08 08:26:31 CEST 2011:INFO:5000
Fri Jul 08 08:26:31 CEST 2011:INFO:
Fri Jul 08 08:26:33 CEST 2011:INFO:5000
Fri Jul 08 08:26:33 CEST 2011:INFO:<soapenv:Envelope xmlns:soapenv="http://www.w3.org/2003/05/soap-envelope">
   <soapenv:Body>
      <getSupplementaryServicesResponse xmlns="urn:iskratel-si:itnbsp-1-0">
         <subscriber node="1200" areaCode="5" dn="5000" xmlns="">
            ...
         </subscriber>
      </getSupplementaryServicesResponse>
   </soapenv:Body>
</soapenv:Envelope>

i can read response just for 1 soap request out of 3. no idea why "getSupplementaryServices" works.

others are simply empty as you can see.
and once again, i have no problems with any of my scripts and projects in 3.6.

beno

Hi Beno,

thanks, I've confirmed this and added it to our buglist for fixing.

regards!

/Ole
eviware.com

any chance to fix this with nightly build?
it's strange to use 3.6 version when there is 4.

Hi Beno,

We've been looking at this issue now and actually aren't able to reproduce it any more with the latest 4.0.1 SNAPSHOT build - the first script step in your TestCase does some random jumping in the test which makes it a bit hard to follow the flow, but we are in all situations able to see the response in the log when running the TestCase, both standalone or during a loadtest.

Can you give the nightly build a try and attach your latest version of your project if it still fails?

Thanks in advance!

/Ole
SmartBear Sweden

during load test i can still see log for only one request (getSupplementaryServices) out of three.
i have no idea why.
i uninstalled old version, deleted the remaining map and installed fresh copy.
old problem remains.
strange...

Wed Aug 17 11:37:30 CEST 2011:INFO:5000
Wed Aug 17 11:37:31 CEST 2011:INFO:
Wed Aug 17 11:37:32 CEST 2011:INFO:5000
Wed Aug 17 11:37:32 CEST 2011:INFO:
Wed Aug 17 11:37:33 CEST 2011:INFO:5000
Wed Aug 17 11:37:34 CEST 2011:INFO:<soapenv:Envelope xmlns:soapenv="http://www.w3.org/2003/05/soap-envelope">
<soapenv:Body>
<getSupplementaryServicesResponse xmlns="urn:iskratel-si:itnbsp-1-0">
...
</getSupplementaryServicesResponse>
</soapenv:Body>
</soapenv:Envelope>
Wed Aug 17 11:37:35 CEST 2011:INFO:5000
Wed Aug 17 11:37:35 CEST 2011:INFO:
Wed Aug 17 11:37:37 CEST 2011:INFO:5000
Wed Aug 17 11:37:37 CEST 2011:INFO:
Wed Aug 17 11:37:39 CEST 2011:INFO:5000
Wed Aug 17 11:37:39 CEST 2011:INFO:
Wed Aug 17 11:37:41 CEST 2011:INFO:5000
Wed Aug 17 11:37:41 CEST 2011:INFO:
Wed Aug 17 11:37:42 CEST 2011:INFO:5000
Wed Aug 17 11:37:42 CEST 2011:INFO:<soapenv:Envelope xmlns:soapenv="http://www.w3.org/2003/05/soap-envelope">
<soapenv:Body>
<getSupplementaryServicesResponse xmlns="urn:iskratel-si:itnbsp-1-0">
...
</getSupplementaryServicesResponse>
</soapenv:Body>
</soapenv:Envelope>
Wed Aug 17 11:37:44 CEST 2011:INFO:5000
Wed Aug 17 11:37:44 CEST 2011:INFO: