Memory usage with large data driven test
Hi - I am running a data driven test case with about 100 rows of data. It calls 2 other test cases during each loop. It also uses the methods of an external Groovy class, but they are all declared ...
Forum Discussion
Hi
I know this thread is a bit older now but I'm getting a very similar issue, using the latest nightly build (as of today 21 June 2010)
I have a large data set (approx 19k rows and about 125 elements) which seems to be handled fine up to a point when I get a java heap space error (see below)
the step referenced on failure is a groovy script which gets the current testRunner results, matches on a step name and then outputs the step name, result and time taken values into a datasink
what I have noticed is that the datasink output file (xls format) does not appear to get updated at any point other than the test case startup script, does SoapUI store all the datasink info in memory before writing out to the datasink or should it do either as a batch or as an ongoing concern?
If I use a smaller sample data set all works fine, as a work around I could split out the data and do mulitple test cases but I'd rather keep this all together if possible so any help would be much appreciated
Thanks
Mike
Test Runner error:-
14:30:56,928 INFO [SoapUIProTestCaseRunner] running step [TS]
14:31:06,927 ERROR [SoapUI] An error occured [Java heap space], see error log for details
java.lang.OutOfMemoryError: Java heap space
at java.util.ArrayList.<init>(Unknown Source)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:93)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:78)
at org.codehaus.groovy.util.LazyReference.getLocked(LazyReference.java:46)
at org.codehaus.groovy.util.LazyReference.get(LazyReference.java:37)
at org.codehaus.groovy.reflection.CachedClass.getMethods(CachedClass.java:249)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:115)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:78)
at org.codehaus.groovy.util.LazyReference.getLocked(LazyReference.java:46)
at org.codehaus.groovy.util.LazyReference.get(LazyReference.java:37)
at org.codehaus.groovy.reflection.CachedClass.getMethods(CachedClass.java:249)
at groovy.lang.MetaClassImpl.populateMethods(MetaClassImpl.java:312)
at groovy.lang.MetaClassImpl.fillMethodIndex(MetaClassImpl.java:291)
at groovy.lang.MetaClassImpl.initialize(MetaClassImpl.java:2912)
at org.codehaus.groovy.reflection.ClassInfo.getMetaClassUnderLock(ClassInfo.java:166)
at org.codehaus.groovy.reflection.ClassInfo.getMetaClass(ClassInfo.java:195)
at org.codehaus.groovy.runtime.metaclass.MetaClassRegistryImpl.getMetaClass(MetaClassRegistryImpl.java:214)
at org.codehaus.groovy.runtime.InvokerHelper.getMetaClass(InvokerHelper.java:697)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.createPojoMetaClassGetPropertySite(AbstractCallSite.java:280)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.createGetPropertySite(AbstractCallSite.java:260)
at org.codehaus.groovy.runtime.callsite.GetEffectivePojoPropertySite.acceptGetProperty(GetEffectivePojoPropertySite.java:53)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callGetProperty(AbstractCallSite.java:237)
at Script1$_run_closure1.doCall(Script1.groovy:11)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:88)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:273)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:886)
at groovy.lang.Closure.call(Closure.java:276)
14:31:07,052 ERROR [SoapUIProTestCaseRunner] TS failed, exporting to [C:\Test\XXXXX\XXXXXSOAP_TestSuite-XXXXX_Full_Data-TS-10594-FAILED.txt]
FAILED.txt file contents:-
Status: FAILED
Time Taken: 11320
Size: 0
Timestamp: Mon Jun 21 14:31:08 BST 2010
TestStep: TS
Error:java.lang.OutOfMemoryError: Java heap space
----------------- Messages ------------------------------
Java heap space
JAVA_OPTS:-
set JAVA_OPTS=-Xms512m -Xmx512m -XX:NewSize=128m -XX:MaxNewSize=128m -XX:SurvivorRatio=2 -Dsoapui.properties=soapui.properties -Dgroovy.source.encoding=iso-8859-1 "-Dsoapui.home=%SOAPUI_HOME%\"
I know this thread is a bit older now but I'm getting a very similar issue, using the latest nightly build (as of today 21 June 2010)
I have a large data set (approx 19k rows and about 125 elements) which seems to be handled fine up to a point when I get a java heap space error (see below)
the step referenced on failure is a groovy script which gets the current testRunner results, matches on a step name and then outputs the step name, result and time taken values into a datasink
what I have noticed is that the datasink output file (xls format) does not appear to get updated at any point other than the test case startup script, does SoapUI store all the datasink info in memory before writing out to the datasink or should it do either as a batch or as an ongoing concern?
If I use a smaller sample data set all works fine, as a work around I could split out the data and do mulitple test cases but I'd rather keep this all together if possible so any help would be much appreciated
Thanks
Mike
Test Runner error:-
14:30:56,928 INFO [SoapUIProTestCaseRunner] running step [TS]
14:31:06,927 ERROR [SoapUI] An error occured [Java heap space], see error log for details
java.lang.OutOfMemoryError: Java heap space
at java.util.ArrayList.<init>(Unknown Source)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:93)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:78)
at org.codehaus.groovy.util.LazyReference.getLocked(LazyReference.java:46)
at org.codehaus.groovy.util.LazyReference.get(LazyReference.java:37)
at org.codehaus.groovy.reflection.CachedClass.getMethods(CachedClass.java:249)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:115)
at org.codehaus.groovy.reflection.CachedClass$3.initValue(CachedClass.java:78)
at org.codehaus.groovy.util.LazyReference.getLocked(LazyReference.java:46)
at org.codehaus.groovy.util.LazyReference.get(LazyReference.java:37)
at org.codehaus.groovy.reflection.CachedClass.getMethods(CachedClass.java:249)
at groovy.lang.MetaClassImpl.populateMethods(MetaClassImpl.java:312)
at groovy.lang.MetaClassImpl.fillMethodIndex(MetaClassImpl.java:291)
at groovy.lang.MetaClassImpl.initialize(MetaClassImpl.java:2912)
at org.codehaus.groovy.reflection.ClassInfo.getMetaClassUnderLock(ClassInfo.java:166)
at org.codehaus.groovy.reflection.ClassInfo.getMetaClass(ClassInfo.java:195)
at org.codehaus.groovy.runtime.metaclass.MetaClassRegistryImpl.getMetaClass(MetaClassRegistryImpl.java:214)
at org.codehaus.groovy.runtime.InvokerHelper.getMetaClass(InvokerHelper.java:697)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.createPojoMetaClassGetPropertySite(AbstractCallSite.java:280)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.createGetPropertySite(AbstractCallSite.java:260)
at org.codehaus.groovy.runtime.callsite.GetEffectivePojoPropertySite.acceptGetProperty(GetEffectivePojoPropertySite.java:53)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callGetProperty(AbstractCallSite.java:237)
at Script1$_run_closure1.doCall(Script1.groovy:11)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:88)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233)
at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:273)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:886)
at groovy.lang.Closure.call(Closure.java:276)
14:31:07,052 ERROR [SoapUIProTestCaseRunner] TS failed, exporting to [C:\Test\XXXXX\XXXXXSOAP_TestSuite-XXXXX_Full_Data-TS-10594-FAILED.txt]
FAILED.txt file contents:-
Status: FAILED
Time Taken: 11320
Size: 0
Timestamp: Mon Jun 21 14:31:08 BST 2010
TestStep: TS
Error:java.lang.OutOfMemoryError: Java heap space
----------------- Messages ------------------------------
Java heap space
JAVA_OPTS:-
set JAVA_OPTS=-Xms512m -Xmx512m -XX:NewSize=128m -XX:MaxNewSize=128m -XX:SurvivorRatio=2 -Dsoapui.properties=soapui.properties -Dgroovy.source.encoding=iso-8859-1 "-Dsoapui.home=%SOAPUI_HOME%\"