Test Runner bat via Octopus Deploy

Question

I'm using Octopus Deploy to run a SOAPUI smoketest at the end of an installation. Im using Test Runner bat to start the whole process via Powershell :

cmd.exe /C "C:\Program Files\SmartBear\SoapUI-5.2.1\bin\TestRunner.bat" -sUK1 "-Dsoapui.properties.UK1=C:\temp\[client]\SOAP\UK1-Quote-UK1.properties" "C:\temp\[client]\SOAP\UK1-Quote-Smoke-soapui-project.xml" >C:\temp\[client]\SOAP\SOAPlogging.txt

The log output is as follows :

------------

del %TEMP%\jfxrtpath
set CLASSPATH=%CLASSPATH%;%JFXRTPATH%

rem JVM parameters, modify as appropriate
set JAVA_OPTS=-Xms128m -Xmx1024m -Dsoapui.properties=soapui.properties "-Dsoapui.home=%SOAPUI_HOME%\"

if "%SOAPUI_HOME%\" == "" goto START
set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.libraries="%SOAPUI_HOME%ext"
set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.listeners="%SOAPUI_HOME%listeners"
set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.actions="%SOAPUI_HOME%actions"

:START

rem ********* run soapui testcase runner ***********

More?

------------

However when run in Powershell directly, everything runs as expected, all tests pass, the output file is generated showing that everything has been successful.

I don't think this is a SOAPUI issue, but im hoping someone has seen the same issue and has a resolution.

Thanks

Jon

jonv · Accepted Answer

SOAPUI was throwing up a UI screen about usage statistics that was preventing Octopus Deploy from continuing on running the TestRunner.bat.

The solution was :

Run Octopus Deploy tentacle manually

Execute the Octopus Deploy steps for TestRunner.bat, This displays the usage statistics screen, click OK

Start up SOAPUI, file > preferences > UI Settings, Disable usage statistics - Check. Click OK.

The long term solution will be to save the preferences file and load it into TestRunner when the test is executing, but I haven't done this yet.

nmrao · Answer

Not really have any idea about Octopus.But soapui projects can be executed from command line using testrunner utility which you did already.What happened? did it run or any errors?

jonv · Answer

What im using to determine success at the moment is the output that I redirect to an output file.

When the run fails the output hangs with the following .,

rem ********* run soapui testcase runner ***********

More?

The "More?" makes me feel like its waiting for an input and therefore is hanging indefinitely until it gets the input.

nmrao · Answer

Does the octopus generate any log for the executions?

jonv · Answer

There's not much more info from Octopus logs :&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp; == Running: Step 40: SOAPUI Tests - clone (1) ==&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp; Running: ***** Web Server11:23:35&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Octopus Server version: 3.13.6+Branch.master.Sha.f00cbbf5c6ace477cb8d9e1b458f1cf5c3b32cc611:23:35&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Environment Information:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; OperatingSystem: Microsoft Windows NT 6.2.9200.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; OsBitVersion: x64&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Is64BitProcess: True&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CurrentUser: NT AUTHORITY\SYSTEM&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MachineName: [Octopus server]&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ProcessorCount: 4&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CurrentDirectory: C:\Windows\system32&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TempDirectory: C:\Windows\TEMP\&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; HostProcessName: Octopus.Server11:23:35&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Executing script on '***** Web Server'11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Octopus Deploy: Calamari version 3.7.65+Branch.master.Sha.8097779b7c3b6ad3a96e52107d4727c40e9b307e11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Environment Information:11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; OperatingSystem: Microsoft Windows NT 6.1.7601 Service Pack 111:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; OsBitVersion: x6411:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Is64BitProcess: True11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CurrentUser: CORP\[Accont]11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MachineName: [machine name]11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ProcessorCount: 111:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CurrentDirectory: C:\Octopus\Work\20170602102336-30311:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TempDirectory: C:\Users\ncbcdevwebservice\AppData\Local\Temp\11:23:36&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; HostProcessName: Calamari11:23:37&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Executing 'C:\Octopus\Work\20170602102336-303\Script.ps1'11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Value11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ----&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -----11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CLRVersion&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2.0.50727.548511:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; BuildVersion&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 6.1.7601.1751411:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; PSVersion&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2.011:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; WSManStackVersion&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2.011:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; PSCompatibleVersions&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; {1.0, 2.0}11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SerializationVersion&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1.1.0.111:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; PSRemotingProtocolVersion&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 2.111:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; PowerShell Environment Information:11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; OperatingSystem: Microsoft Windows NT 6.1.7601 Service Pack 111:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; OsBitVersion: x8611:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CurrentDirectory: C:\Octopus\Work\20170602102336-30311:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CurrentLocation: C:\Octopus\Work\20170602102336-30311:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TempDirectory: C:\Users\ncbcdevwebservice\AppData\Local\Temp\11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; HostProcessName: powershell11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; TotalPhysicalMemory: 4193848 KB11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; AvailablePhysicalMemory: 2503948 KB11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Removing any previous SOAPUI test results.11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SOAPUI Execution.11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; del %TEMP%\jfxrtpath11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; set CLASSPATH=%CLASSPATH%;%JFXRTPATH%11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; rem JVM parameters, modify as appropriate11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; set JAVA_OPTS=-Xms128m -Xmx1024m -Dsoapui.properties=soapui.properties "-Dsoapui.home=%SOAPUI_HOME%\"11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; if "%SOAPUI_HOME%\" == "" goto START11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.libraries="%SOAPUI_HOME%ext"11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.listeners="%SOAPUI_HOME%listeners"11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.actions="%SOAPUI_HOME%actions"11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :START11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; rem ********* run soapui testcase runner ***********11:23:39&nbsp;&nbsp; Info&nbsp;&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; More? SOAPUI Execution - Finished - Exit code : 255.11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Updating manifest with output variables11:23:39&nbsp;&nbsp; Verbose&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Updating manifest with action evaluated variables11:23:39&nbsp;&nbsp; Error&nbsp;&nbsp;&nbsp; |&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; No SOAPUI test results available.&nbsp;&nbsp;&nbsp;Interestingly enough another user had the same issue as me.&nbsp;https://community.smartbear.com/t5/SoapUI-Open-Source/Can-t-execute-script-by-using-testrunner-bat-via-a-webportal/m-p/143221#M24240

gjc · Answer

HiI have a similar problem.We are also intending to use SoapUI as part of a CI solution. But we are using SoapUI to run MockServices so that we can perform an end to end test and get a known responses from a MockService.&nbsp;I am executing mockservicerunner.bat from a C# class that executes the batch file mockservicerunner.bat using the Process class.&nbsp;I am also getting the error that you had.&nbsp;My output(see below)also shows that the mockservicerunner appears to stop with the More? prompt.I have checked the SoapUI 'Disable Usage Statistics' checkbox as you suggested, but for me this has made no difference.&nbsp;When I run mockservicerunner from a batch file with the same arguments the MockService is started successfully, see below.&nbsp;16:25:13,662 INFO [SoapUIMockServiceRunner] MockService started on port 8088 at path [/mockBizTalkOnRampServiceEndpoint]16:25:13,820 INFO [SoapUIMockServiceRunner] Started 1 runnerPress any key to terminate...&nbsp;Do you think that I am getting the error becuase SoapUIMockServiceRunner blocks while it is running the MockService, "Press any key to terminate....". Could this give the same effect that you had when SOAPUI was throwing up a UI screen about usage statistics?If it is that then I am not sure how to resolve the problem.Any help gratefully received as I am making no progress with this issue.&nbsp;This is the output I get from the failing execution:&nbsp;Received from standard out:del %TEMP%\jfxrtpath | /&gt;Received from standard error: | /&gt;Received from standard out:set CLASSPATH=%CLASSPATH%;%JFXRTPATH% | /&gt;Received from standard out: | /&gt;Received from standard out:rem JVM parameters, modify as appropriate | /&gt;Received from standard out:set JAVA_OPTS=-Xms128m -Xmx1024m -Dsoapui.properties=soapui.properties "-Dsoapui.home=%SOAPUI_HOME%\" | /&gt;Received from standard out: | /&gt;Received from standard out:if "%SOAPUI_HOME%\" == "" goto START | /&gt;Received from standard out: set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.libraries="%SOAPUI_HOME%ext" | /&gt;Received from standard out: set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.listeners="%SOAPUI_HOME%listeners" | /&gt;Received from standard out: set JAVA_OPTS=%JAVA_OPTS% -Dsoapui.ext.actions="%SOAPUI_HOME%actions" | /&gt;Received from standard out: | /&gt;Received from standard out::START | /&gt;Received from standard out: | /&gt;Received from standard out:rem ********* run soapui loadtest runner *********** | /&gt;Received from standard out: | /&gt;Received from standard out:More? | /&gt;Received from standard out: | /&gt;&nbsp;Many thanks,Geoff

Forum Discussion

Test Runner bat via Octopus Deploy

10 Replies

Related Content

Deploy Slave Project

UI (browser) testing via Gitlab runner

Octopus Deploy and Smartbear

getting the tfs BuildNumber when running the ReadyAPI command line on Octopus

UI (browser) testing via Gitlab runner

Recent Discussions

clone TestSuite fails when there are more project with the same name

Will SOAP UI 5.6.1 work with JDK 8

SOAP Request works in SoapUI, but not in C# code

How to configure Swagger in Paas to use it in Oracle APEX instance.

log4j1.x vulnerability