Command line arguments in Jenkins plugin
We have just replaced our old home-grown Jenkins integration with the new 'official' SmartBear Jenkins-TestComplete integration. I find it very easy to work with and it has made our Jenkins integration more 'flashy' and easy to work with for people who are not working with the test system on a daily basis. One feature of our old setup was not possible to reproduce in the new. We sometimes need to run the test on branches of the code (other than the master branch). In our SUT this can be specified in the URL and in the old integration we called TC/TE with a command line argument to specify the branch (if different from master). Unfortunately the new Jenkins integration does not allow for arguments. Adding a field in the UI where you can specify a command line parameter to TestComplete/TestExecute would be nice. This field of course has to allow for variables, so you can pass the information round. This problem can of course be solved in other ways (e.g. dumping the information in a file or environment variable on the slave in Jenkins and read it in TC/TE), but we find our current implementation the most satisfactory. If someone has suggestions on how to implement an alternative, we will be glad to hear them. Yours, Søren Harder, QA engineer, Zmags
New Jenkins TestComplete Plugin Released to publish MHT reports in JUnit format
Hi, I am Fernando Miguélez and I have been a user of TestComplete and TestExecute for almost a year. We use those both to test mainly Flex applications. We use Jenkins actively to continuously build and deploy software but also to perform integration (unit) and functional (with TestComplete/TestExecute) testing. We have been looking forward to hearing from an official Jenkins plugin so TestComplete/TestExecute tests could be more maneageable. Our daily functional tests are generated in MHT format and it takes a lot of manual intervention to figure out what happened with every functional group (we have to download it and open int in Internet Explorer that we happen to use only for that, Firefox or Chrome are our preferred browsers). After waiting for so long and after gathering some experience with Jenkins development I decided to create my own Jenkins plugin. Today I would like to proudly announce the availability of new Jenkins Plugin: TestComplete xUnit Plugin. Just look for it in "Manage Plugins" option of your Jenkins installation. This plugin basically converts MHT TestComplete/TestExecute reports into JUnit format that Jenkins can interpret and handle, so you can benefit from quick failure list review, tendency graphs, failure history, etc. I am not affiliated with Smartbear and my release happened to coincide in time with official release of official TestComplete Jenkins Plugin. My plugin is lighter and only applies to publishing. Official Jenkins Plugin from Smartbear is a full blown plugin to directly invoke TC/TE from Jenkins but leaves small room for customizations. In our case we already had set up our integration with Jenkins by means of many tweaks (batch scripts, Jenkins slaves setup, execution rules, etc.) so we only needed the reporting part. Thus if you start out with a fresh Jenkins integration you may prefer to go with official plugin, but if you happen to come from an existing integration my plugin could be more helpful. I hope you enjoy it. ;-)
How do we get test execute working with a jenkins slave service on a windows machine?
We now use the test complete pluggin for jenkins (which is awesome), but have not figure out how to get it working with a jenkins slave installed as a service. Until now, the way we get tests to launch is by starting a vm and logging in. A batch job starts a jenkins swarm slave and leaves the cmd window open while running. We disconnect (not log off) for the environment to run tests utilizing test execute. Now with the pluggin, there is an option to 'run interactively' and specify a user there. I expected that I could install the jenkins slave as a service, and with credentials entered (and me not having a session) that TE would execute using the new option. Test execute does launch this way, but doesnt appear to do anything. Why is the "run interactive mode" ignored? Error: TestComplete] Selected TestComplete/TestExecute installation: Type: TE, Version: 11.11.1064.11, Path: "C:\Program Files (x86)\SmartBear\TestExecute 11\bin\TestExecute.exe" [TestComplete] [WARNING] The node is connected via Java Web Start (JNLP). In this mode, the "Run interactive user session" property of the TestComplete Test step is ignored. TestComplete (or TestExecute) will work in the current user session. [TestComplete] Launching the test runner. $ "C:\Program Files (x86)\SmartBear\TestExecute 11\bin\TestExecute.exe" D:\jenkins-Slave\workspace\DEV-8.10_Rollups_Perf\FLOWCAL_Regression_Test_Perf
How to get reporting at test step level instead of test case level what surefire currently provides
I am running my test via jenkins and i have surefire plugin which generates xml reports in my workspace. But this report has run status of all test suites and all test cases. Each test case will have failed test step information too. I want a way by which i can have run status of each test step whether failed or passed. Can some one help here if we can do this with surefire plugin or with some other way/plugin. Thanks a lot.Jenkins exit code result
im using TC plugin thur pipeline running in interactive mode, my setup is i run a series of project. I need to get the result of each project run by getting the exit code on each project that run do make additional steps depend on the requirement. I used the /exportSummary to try to parse the result but for some reason this is not working.Health-check for SOAP UI Pro in continuous integration with Jenkins
Hello, Most of tools dispose of “health check” routine that verify that everything is OK before starting the CI pipeline. So before executing the SoapUI tests in Jenkins I want to verify that : - TestRunner of ReadyAPI is available - Licences are available in sufficient quantity - Each component of the testing tool is ready to use Maybe it is very simple and I just have to run a blanc test, maybe the control is stricter and I can run some of health-check procedure. So the point is : - What are the best-practices you have observed in IC integration ? What is your advice ? - Does the health-check procedure exists and how to run it ? Thanks a lot :) Mohamed.Test runner exit code: -10 (Unable to create a user session).
Hello! I have a CI environment with jenkins where I'm trying to configure TestExecute to run functional testes. I have three machines that I want to use as jenkins slaves. I had succes in prepare one of those machines and in this case, the tests are running fine, but, in the other ones, I'm getting the error message "Test runner exit code: -10 (Unable to create a user session)." and I have no more ideas how to proceed. Additional informations: The jenkins is configured by jenkinsfile. The test stages are defined like this: def cred = 'TESTECOMPLETE_CRED' if ("${env.NODE_NAME}" == "SkyOne_QA"){ cred = 'TESTECOMPLETE_CRED_SKYONE' } stage('Test Run Persona') { testcompletetest actionOnErrors: 'MAKE_FAILED', actionOnWarnings: 'MAKE_UNSTABLE', launchType: 'lcProject', project: 'nsjPersona', suite: 'TestesFuncionais.pjs', useTCService: true, credentialsId: cred } In one of those 3 machines, the tests are running perfectly. In both the jenkins slave agents are installed as a service and the testcomplete service have permissions to run in interactive session. Finally, I saw the document with instructions about how to prepare a machine to run tests. I tried to cunfigure those two machines like the document says, but I had no success. I hope you can help-me with this. Thanks a lot!
