Test Execution never finishes While executing test cases Parallel ?

Question

Hi,trying to trying to run test cases in parallel and&nbsp;Test Execution never shows as finished&nbsp;Here detailed Problem description:CSV Input Data File-1: GoogleHostList.csvwww.google.comwww.google.com.uawww.google.co.uk&nbsp;CSV Input Data File-2: SearchStringsInputData.csvTest AutomationAPI Automationweb Service Testing&nbsp;Objective:For each ‘Host Name’ in Input data File-1 &nbsp;, I need to perform search operation for all search strings in input data file -2.&nbsp;Note: My actiual project is different and it takes(per host and per input value) 2 mins for each set of data.&nbsp;I have 50 hosts and 10 different input values need to test for each host. Then my total test time will go 50*10*2=1000 minutes;&nbsp;If I can run 50 test cases in parallel, then I can complete total test in 20 mins.&nbsp;If I do this search operation sequentially it may take more time and I decided to clone test case into multiple test cases(Equals to number of hosts) and then loop each test case for all given in SearchStrings csv &nbsp;data file-2.&nbsp;For this I created&nbsp; SOAPUI project in the following structure:Project StrutucreMaster test case is a template test case and this will be &nbsp;used replicated/cloned for number of hosts available in &nbsp;HostList.csv file.&nbsp;Project Structure after cloning after completionTest Case Replicator groovy script:Reads CSV Input Data File-1: GoogleHostList.csvFinds the Number of HostsClones Master Test Case into Number of Hosts timesUpdates Each Cloned Test Case PropertiesRun Them in Parallel.&nbsp;For example, if my CSV Input Data File-1 Contains 3 rows (3 Different Hosts Names) thenTest Case Replicator groovy script Clones the master test case into 3 Copies as below:www.google.comwww.google.com.uawww.google.co.uk&nbsp;Then Replicator script updates the Test Case level ‘hostName’ property in all four test cases and then starts them parallel execution mode.All three cloned test cases are running very fine.But test SOAPUI projects is not marking as completed even after the test cases are finished.If we look at execution status at project level, Test Progress bar hangs at 'TestCaseReplicator' Groovy step forever.&nbsp;Project Level Run StatusIf we look at the test progress at Test Suite level, TestCaseReplicator Groovy step progress bar reached to 100% and Marked as completed, but at project level still hangs at TestCaseReplicator Groovy step.Test Suite Level Run Status&nbsp;By design SOAPUI disables the log during the parallel execution.&nbsp;Even I &nbsp;tried via command line option using testRunner same issue there as well.&nbsp;Also this problem blocking next clean-up suite for ever.&nbsp;How to solve this problem?&nbsp;Anybody can give quick solution for this?&nbsp;Sample project &nbsp;and sample input data files are attached to reproduce the issue.&nbsp;I am using windows 10 Pro 64 bit Machine.&nbsp;Tried on SOAPUI Open source as well as Ready API Latest Version&nbsp;

nmrao · Answer

Ok.Here is a sample project which I did few days back and it executes test suites in multi-threaded way from within a Groovy script.May be it would be helpful, have look at it. You may also implement as you need based on that.Note that it is not using soapui's multi threading.https://github.com/nmrao/sample-soapui-projects/tree/master/hybridExecutionHere is the original threadhttps://community.smartbear.com/t5/SoapUI-NG/How-to-setup-TestSuite-Priority-for-a-Project-with-multiple/m-p/143629/highlight/true#M32415

nmrao · Answer

livevox084,Thank you for the details, will go thru and can see if I can come up with some concrete inputs.However, here is quick feedback on running tests in Parallel.1. Be careful while running tests in parallel. Because:a. it consumes the resources of local machine where soapui is running. It directly depends on the number of test cases. If a suite contains 50 cases, and the suite is started in parallel will start 50 threads, I guess. Need to see if that machine is capable.b. It also impacts on the server that soap calls.I am not really sure if soapui does the thread pooling internally and not really expert in multi thread coding, know only very little.2. May be you need to consider running limited threads and after completing reassign the threads to do the next assignment. I mean use of thread pool. It may increase some time, but better than never finishing.

nmrao · Answer

By the way, what version of soapui are your using? Because, the project shows version 6.0.0 where as the latest released version is 5.3.0.Please clarify.

livevox084 · Answer

Hi ,&nbsp;I tested on Ready API 1.3.1, Ready API2.0 and SOAPUI 5.3.0.With&nbsp; all above versions I see the same problem.&nbsp;Now I come for threading issue, leave about fifty threads, it is not working for even three threads.I am sure SOAPUI is capable of running multiple threads becoz it allows to run test cases and test suites in&nbsp; parallel mode.&nbsp;My Application under test is capable of handling more than than 50 threads ,absolutely there is no limitation from application side.&nbsp;Let me know if anything else required.&nbsp;Thanks,Rajendra Prasad.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;

livevox084 · Answer

Thankyou Rao,You are really great.I will implement my project as per sample you given .let you know the results.&nbsp;Thanks you soooo much for your timely help.&nbsp;-Rajendra

Forum Discussion

Test Execution never finishes While executing test cases Parallel ?

9 Replies

Related Content

Execution Plan

Executing test scripts in Test Execute

Execute Scenario from AfterFeature function

Headless execution

Execution Plan

Recent Discussions

clone TestSuite fails when there are more project with the same name

Will SOAP UI 5.6.1 work with JDK 8

SOAP Request works in SoapUI, but not in C# code

How to configure Swagger in Paas to use it in Oracle APEX instance.

log4j1.x vulnerability