Contributions
How do you perform CRUD operations in performance testing?
Hey guys, I have an endpoint that has CRUD methods, to reuse the test data, I have to delete all data posted in the end. I want to make it as a test data auto-cleanup. So what I am doing right now is to chain those endpoints together, each of them is a test step of a test case, looks like below - Test Suite - Test Case 1 - Test Step 1: POST - Test Step 2: GET - Test Step 3: PATCH - Test Step 4: DELETE When I add this functional test case as a stress test, it looks like this: The issue is that when I run test with numbers of VUs, the TPS is lower for each request. For example, I use 50VUs/sec, when I run single request as a test case, each of them can reach 50 TPS; when all 4 requests as a test case, I only got 20 TPSfor each of them. 1. I am wondering what is the issue here? Do I set the test case wrong? The current test seems not to reflect the true behavior on the server side. 2. If I am not doing it right, then what is the optimized way to set test cases to perform CRUD in ReadyAPI? Is there a regular way to do it? 3. how is that TPS calculated in ReadyAPI?? does it use (number of counts/test duration)? 4.BTW, the license I had is 250VUs, is this maybe an issue led by limitation of VUs? Thanks, Jess2 years agoPlace ReadyAPI QuestionsReadyAPI Questions599Views0likes0CommentsRe: Help: Load Testing - Unable to see the log of failed test step
Thanks for the reply! 1. My baseline testing was using single user, no issue 2. I tried gradually/spike, no matter which the response time is always extremely high at the end of testing, I suspected if there are threads not closed ...then I export the log. 14:30:21,922 ERROR [errorlog] com.eviware.soapui.support.scripting.ScriptException: Error in SubmitListener.beforeSubmit com.eviware.soapui.support.scripting.ScriptException: Error in SubmitListener.beforeSubmit at com.eviware.soapui.eventhandlers.support.DefaultSoapUIEventHandler.invoke(DefaultSoapUIEventHandler.java:31) ~[ready-api-soapui-pro-3.20.0.jar:3.20.0] at com.eviware.soapui.eventhandlers.support.AbstractEventHandlerMetaData.invokeHandlers(AbstractEventHandlerMetaData.java:80) [ready-api-soapui-pro-3.20.0.jar:3.20.0] at com.eviware.soapui.eventhandlers.support.AbstractEventHandlerMetaData.invokeHandlers(AbstractEventHandlerMetaData.java:61) [ready-api-soapui-pro-3.20.0.jar:3.20.0] at com.eviware.soapui.eventhandlers.impl.EventHandlersSubmitListener.beforeSubmit(EventHandlersSubmitListener.java:36) [ready-api-soapui-pro-3.20.0.jar:3.20.0] at com.eviware.soapui.impl.wsdl.WsdlSubmit.notifyListenersBeforeSubmit(WsdlSubmit.java:165) [ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.impl.wsdl.WsdlSubmit.run(WsdlSubmit.java:123) [ready-api-soapui-3.20.0.jar:3.20.0] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] at java.lang.Thread.run(Thread.java:831) [?:?] Caused by: org.apache.xmlbeans.impl.values.XmlValueDisconnectedException at org.apache.xmlbeans.impl.values.XmlObjectBase.check_orphaned(XmlObjectBase.java:1258) ~[xmlbeans-3.1.2-sb-fixed.jar:?] at com.eviware.soapui.config.impl.AbstractRequestConfigImpl.getCredentials(Unknown Source) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.environmentspec.AbstractRequestConfigAdapterImpl.getCredentialsConfig(AbstractRequestConfigAdapterImpl.java:27) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.environmentspec.AbstractRequestConfigAdapterImpl.getDefaultEnvironmentAuthProfile(AbstractRequestConfigAdapterImpl.java:101) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.environmentspec.AuthProfileHolderConfigAdapterImpl.getAuthProfileAsIs(AuthProfileHolderConfigAdapterImpl.java:99) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.environmentspec.AuthProfileHolderConfigAdapterImpl.getAuthProfile(AuthProfileHolderConfigAdapterImpl.java:110) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.environmentspec.DefaultAuthProfileHolder.getAuthProfile(DefaultAuthProfileHolder.java:56) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.impl.support.AbstractHttpRequest.getSelectedAuthProfile(AbstractHttpRequest.java:683) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.impl.support.AbstractHttpRequest.getLegacyAuthType(AbstractHttpRequest.java:748) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.impl.support.AbstractHttpRequest.getAuthType(AbstractHttpRequest.java:804) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.impl.support.AbstractHttpRequestInterface$getAuthType.call(Unknown Source) ~[?:?] at Script1.run(Script1.groovy:8) ~[?:?] at com.eviware.soapui.support.scripting.groovy.SoapUIGroovyScriptEngine.runAndGetResult(SoapUIGroovyScriptEngine.java:111) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.support.scripting.groovy.SoapUIGroovyScriptEngine.run(SoapUIGroovyScriptEngine.java:97) ~[ready-api-soapui-3.20.0.jar:3.20.0] at com.eviware.soapui.support.scripting.groovy.SoapUIProGroovyScriptEngineFactory$SoapUIProGroovyScriptEngine.run(SoapUIProGroovyScriptEngineFactory.java:98) ~[ready-api-soapui-pro-3.20.0.jar:3.20.0] at com.eviware.soapui.eventhandlers.support.DefaultSoapUIScript.invoke(DefaultSoapUIScript.java:42) ~[ready-api-soapui-pro-3.20.0.jar:3.20.0] at com.eviware.soapui.eventhandlers.support.DefaultSoapUIEventHandler.invoke(DefaultSoapUIEventHandler.java:29) ~[ready-api-soapui-pro-3.20.0.jar:3.20.0] ... 10 more I have a piece of code in the project event, which helps to refresh token. I did not see anything wrong after code review...3 years agoPlace ReadyAPI QuestionsReadyAPI Questions1.5KViews0likes0CommentsHelp: Load Testing - Unable to see the log of failed test step
Hi team, I was running load testing for my endpoints. When I have VUs increased, I noticed there are a bunch of errors, but the transaction error log shows empty on Request & Response which makes the debug very difficult. I am not sure if this is my server error or ReadyAPI's problem(running on a local laptop). The transaction log panel looks like this: Error in the performance log: I have configured by following this page:https://support.smartbear.com/readyapi/faq/why-do-i-get-empty-requests-and-responses-in-the-t/ but still not working... Could you please give some advice? This is an quite urgent issue, thanks! Jess3 years agoPlace ReadyAPI QuestionsReadyAPI Questions1.6KViews0likes7Comments