Forum Discussion

vlad230's avatar
vlad230
Contributor
12 years ago

TestExecute + Jenkins

Hi guys!



I'm trying to integrate Test Execute with Jenkins to test the UI of my .NET application.



I am using a slave machine which gets the project from SVN and afterwards, in the build step (which is not required for my app), I run a batch command which starts the test suite with TestExecute.



The issue is that after the batch command is executed, Jenkins says that the project is finished but in fact the tests are just starting to run and I don't know when the tests are finished or what is the progress of the test execution (~15h long).



I have two questions:



1. Is there any way in which I could keep the Jenkins "bullets" flashing until TestExecute finishes to run the test suite?



2. Is there any way in which I could write the progress (I already have a progress determination system setup) in Jenkins' console output while the test suite is running?



I really need to do this, so if you have any ideas please don't hesitate to post them.



Thanks a lot,

Sergiu

  • AlexKaras's avatar
    AlexKaras
    12 years ago
    Hi Sergiu,



    I don't know the contents of your batch file, but hope that the following might help:

    start /wait "TestExecute" "<TestProject.pjs>" /testOptions

    (the /wait option should postpone batch execution until TestExecute completes)
  • nicktulett's avatar
    nicktulett
    Contributor
    12 years ago
    Why don't you just have the testexecute command?



    e.g.



    testexecute C:\Testing\TestComplete\Project.pjs /run /project:TestProject /unit:Control /routine:RemoteTest /exit /ns /SilentMode
  • AlexKaras's avatar
    AlexKaras
    Champion Level 3
    12 years ago
    > Can you set the TestExecute flag to NOT open the results and see what happens?



    To do this, just start TestExecute, right-click on its icon in the tray, click Options menu item and for the Log entry clear the Activate After Run option (or something like that - don't have TE at hand at the moment).
  • vlad230's avatar
    vlad230
    Contributor
    12 years ago
    Hi guys,



    Just wanted to let you know that SmartBear support gave me a hint to solve this and it worked!



    I just added my tested app's process to the process filter and set it to 'Use only selected processes' and TextExecute.exe terminated on time.



    The issue was that I had the option 'Use only tested apps' set up but I have another app which syncs data with the server and this app does not exit, it stays in sys tray....probably TE was waiting for it too.



    I've also setup my Jenkins job to run this batch:

    start /wait TestExecute.exe "C:\Jenkins\workspace\MY_PROJECT\IProject.pjs" /run /exit /SilentMode /DoNotShowLog /ForceConversion /ns

    and it works great!



    Thanks again for all you help, I really appreciate it!



    -Sergiu

  • AlexKaras's avatar
    AlexKaras
    Champion Level 3
    12 years ago
    Hi Sergiu,



    I don't know the contents of your batch file, but hope that the following might help:

    start /wait "TestExecute" "<TestProject.pjs>" /testOptions

    (the /wait option should postpone batch execution until TestExecute completes)
  • vlad230's avatar
    vlad230
    Contributor
    12 years ago
    Hi Alexei,



    I'm using the option "Execute Windows batch command" in the build step from Jenkins and it looks like this:



    @ECHO OFF

    CLS

    tasklist /fi "imagename eq TestExecute.exe" |find ":" > nul

    if errorlevel 1 ( taskkill /f /im TestExecute.exe )

    start TestExecute.exe "C:\Jenkins\workspace\MY_PROJECT\IProject.pjs" /p:"Poject_Name" /r /e

    @ECHO OFF

    CLS



    I've included /wait like this:



    @ECHO OFF

    CLS

    tasklist /fi "imagename eq TestExecute.exe" |find ":" > nul

    if errorlevel 1 ( taskkill /f /im TestExecute.exe )

    start /wait TestExecute.exe "C:\Jenkins\workspace\MY_PROJECT\IProject.pjs" /p:"Poject_Name" /r /e

    @ECHO OFF

    CLS



    But this isn't working as I would like:

    The Jenkins "bullet" is flashing but it keeps flashing even if the test run is completed and the .MHT file generated by TestExecute is displayed on screen.



    Is there some exit code thrown by TestExecute after an execution is finished (when the MHT report is displayed) which I can catch and wait for it somehow using a batch command?



    Thanks for the quick reply,

    Sergiu

  • vlad230's avatar
    vlad230
    Contributor
    12 years ago
    Hi Nick,



    I've used this set of commands:




    cd "C:\Program Files\SmartBear\TestExecute 9\Bin" 
    testexecute "C:\Jenkins\workspace\MY_PROJECT\Project.pjs" /run /project:"Poject_Name" /exit /ns /SilentMode

    But I'm experiencing the same issue as with Alexei's idea.



    I don't understand why is it still waiting for something instead of finishing...



    Thanks for the quick reply,

    Sergiu
  • vlad230's avatar
    vlad230
    Contributor
    12 years ago
    Hi Nick,



    It looks like this:



    <SVN update stuff>


    C:\Jenkins\workspace\MY_PROJECT>cd "C:\Program Files\SmartBear\TestExecute 9\Bin" 

    C:\Program Files\SmartBear\TestExecute 9\Bin>testexecute "C:\Jenkins\workspace\MY_PROJECT\Project.pjs" /run /project:"Poject_Name" /exit /ns /SilentMode
    *
     
    It looks like the commands executed successfully (I was conneted with the machine via remote desktop and the tests started to execute, then finished, displaying the mht file with results).

    But the "loading" image (*) was still displayed and the "bullets" were still flashing.

    Any ideas why?

    Thanks,
    Sergiu

  • nicktulett's avatar
    nicktulett
    Contributor
    12 years ago
    Does the Jenkins job finish when you close the browser?



    Can you set the TestExecute flag to NOT open the results and see what happens?
  • vlad230's avatar
    vlad230
    Contributor
    12 years ago
    Hi Alexei, Nick,



    I've tried closing the mht file after the tests finish and I've also disabled the "Activate after test run" log option from TE but it's the same thing.



    I've tried both cmd options: the start /wait TestExecute.exe and the testexecute one but it's the same, the "bullet" keeps flashing even if the tests finish and the report isn't displayed.



    I've notices something strange: after the test run completes the TestExecute.exe process is still active but there is noTestExecute in system tray.



    Isn't it supposed to close? Maybe it hangs on something.



    Is there a forced close option for it? It seems that /exit or /e doesn't do the job.



    Thanks,

    Sergiu