We are building a new experience for our SmartBear Community.
This site is now read-only. You can still browse and search as usual. Learn More
This site is now read-only. You can still browse and search as usual. Learn More
Forum Discussion
Solved
TestExecute + Jenkins
Hi guys!
I'm trying to integrate Test Execute with Jenkins to test the UI of my .NET application.
I am using a slave machine which gets the project from SVN and afterwards, in the build step (which is not required for my app), I run a batch command which starts the test suite with TestExecute.
The issue is that after the batch command is executed, Jenkins says that the project is finished but in fact the tests are just starting to run and I don't know when the tests are finished or what is the progress of the test execution (~15h long).
I have two questions:
1. Is there any way in which I could keep the Jenkins "bullets" flashing until TestExecute finishes to run the test suite?
2. Is there any way in which I could write the progress (I already have a progress determination system setup) in Jenkins' console output while the test suite is running?
I really need to do this, so if you have any ideas please don't hesitate to post them.
Thanks a lot,
Sergiu
I'm trying to integrate Test Execute with Jenkins to test the UI of my .NET application.
I am using a slave machine which gets the project from SVN and afterwards, in the build step (which is not required for my app), I run a batch command which starts the test suite with TestExecute.
The issue is that after the batch command is executed, Jenkins says that the project is finished but in fact the tests are just starting to run and I don't know when the tests are finished or what is the progress of the test execution (~15h long).
I have two questions:
1. Is there any way in which I could keep the Jenkins "bullets" flashing until TestExecute finishes to run the test suite?
2. Is there any way in which I could write the progress (I already have a progress determination system setup) in Jenkins' console output while the test suite is running?
I really need to do this, so if you have any ideas please don't hesitate to post them.
Thanks a lot,
Sergiu
- Hi Sergiu,
I don't know the contents of your batch file, but hope that the following might help:
start /wait "TestExecute" "<TestProject.pjs>" /testOptions
(the /wait option should postpone batch execution until TestExecute completes)
15 Replies
- Why don't you just have the testexecute command?
e.g.
testexecute C:\Testing\TestComplete\Project.pjs /run /project:TestProject /unit:Control /routine:RemoteTest /exit /ns /SilentMode - > Can you set the TestExecute flag to NOT open the results and see what happens?
To do this, just start TestExecute, right-click on its icon in the tray, click Options menu item and for the Log entry clear the Activate After Run option (or something like that - don't have TE at hand at the moment). - Hi guys,
Just wanted to let you know that SmartBear support gave me a hint to solve this and it worked!
I just added my tested app's process to the process filter and set it to 'Use only selected processes' and TextExecute.exe terminated on time.
The issue was that I had the option 'Use only tested apps' set up but I have another app which syncs data with the server and this app does not exit, it stays in sys tray....probably TE was waiting for it too.
I've also setup my Jenkins job to run this batch:
start /wait TestExecute.exe "C:\Jenkins\workspace\MY_PROJECT\IProject.pjs" /run /exit /SilentMode /DoNotShowLog /ForceConversion /ns
and it works great!
Thanks again for all you help, I really appreciate it!
-Sergiu - Hi Sergiu,
I don't know the contents of your batch file, but hope that the following might help:
start /wait "TestExecute" "<TestProject.pjs>" /testOptions
(the /wait option should postpone batch execution until TestExecute completes) - Hi Alexei,
I'm using the option "Execute Windows batch command" in the build step from Jenkins and it looks like this:
@ECHO OFF
CLS
tasklist /fi "imagename eq TestExecute.exe" |find ":" > nul
if errorlevel 1 ( taskkill /f /im TestExecute.exe )
start TestExecute.exe "C:\Jenkins\workspace\MY_PROJECT\IProject.pjs" /p:"Poject_Name" /r /e
@ECHO OFF
CLS
I've included /wait like this:
@ECHO OFF
CLS
tasklist /fi "imagename eq TestExecute.exe" |find ":" > nul
if errorlevel 1 ( taskkill /f /im TestExecute.exe )
start /wait TestExecute.exe "C:\Jenkins\workspace\MY_PROJECT\IProject.pjs" /p:"Poject_Name" /r /e
@ECHO OFF
CLS
But this isn't working as I would like:
The Jenkins "bullet" is flashing but it keeps flashing even if the test run is completed and the .MHT file generated by TestExecute is displayed on screen.
Is there some exit code thrown by TestExecute after an execution is finished (when the MHT report is displayed) which I can catch and wait for it somehow using a batch command?
Thanks for the quick reply,
Sergiu - Hi Nick,
I've used this set of commands:
cd "C:\Program Files\SmartBear\TestExecute 9\Bin"
testexecute "C:\Jenkins\workspace\MY_PROJECT\Project.pjs" /run /project:"Poject_Name" /exit /ns /SilentMode
But I'm experiencing the same issue as with Alexei's idea.
I don't understand why is it still waiting for something instead of finishing...
Thanks for the quick reply,
Sergiu - What's in the Jenkins console for the last run?
- Hi Nick,
It looks like this:
<SVN update stuff>
C:\Jenkins\workspace\MY_PROJECT>cd "C:\Program Files\SmartBear\TestExecute 9\Bin"
C:\Program Files\SmartBear\TestExecute 9\Bin>testexecute "C:\Jenkins\workspace\MY_PROJECT\Project.pjs" /run /project:"Poject_Name" /exit /ns /SilentMode
*
It looks like the commands executed successfully (I was conneted with the machine via remote desktop and the tests started to execute, then finished, displaying the mht file with results).
But the "loading" image (*) was still displayed and the "bullets" were still flashing.
Any ideas why?
Thanks,
Sergiu - Does the Jenkins job finish when you close the browser?
Can you set the TestExecute flag to NOT open the results and see what happens? - Hi Alexei, Nick,
I've tried closing the mht file after the tests finish and I've also disabled the "Activate after test run" log option from TE but it's the same thing.
I've tried both cmd options: the start /wait TestExecute.exe and the testexecute one but it's the same, the "bullet" keeps flashing even if the tests finish and the report isn't displayed.
I've notices something strange: after the test run completes the TestExecute.exe process is still active but there is noTestExecute in system tray.
Isn't it supposed to close? Maybe it hangs on something.
Is there a forced close option for it? It seems that /exit or /e doesn't do the job.
Thanks,
Sergiu
