Forum Discussion

Anonymous's avatar
Anonymous
12 years ago

Jenkins integration - request for input

Dear testers

it is well known that Jenkins is used widely to automate builds and some test activities, even though it is not explicitly designed to support test automation execution. People write their own plugins for that system anyway. 

We know that quite a number of TestComplete users implemented their own versions of Jenkins plugins for TestComplete. 

We may consider developing a standard TC integration plugin for Jenkins. In order for us to understand what is needs to be, we invite you to continbute to this thread with desctipions of what such integration should provide and what kind of usage scenarios you are looking for.



Full disclaimer - we do not use Jenkins in the TestComplete QA team, thus we don't have a first hand usage experience with this tool in the QA / test automation context.



If you are curious, we use a home grown system built around ABS and are developing the next generation of the test automation system, with support for virtual test labs, private and public clouds.

17 Replies





  • 1. Jenkins slave on remote machine co-located with TestExeceute

    2. Jenkins slave as windows service, but still able to trigger TestExecute

         there are os-limitations on users and access to ui

    3. TestExecute to generate html-results, linked from Jenkins



    or 

    4. Jenkins master to trigger remote TestExecute, Jenkins to receive html-result
  • We are currently using TC and TE triggered from Jenkins.

    Issues we've run into are:

    A) Input to STDOUT for Jenkins to show progress in real time.

    B) TE to wait for license to be freed from another TE 



    Since A) doesn't work, a hanged test can be detected only by logging in on the test machine to see what is going.

    At the end of the test we copy results with HTML-publisher-plugin. If something goes wrong and the results are not published, we have no idea what happened.



    We run tests as matrix job in Jenkins on multiple slaves. Since B) doesn't work, we need to separate setup parts from test jobs and hack around with semaphores. This is really unreliable.



    Thank you.
  • dla's avatar
    dla
    New Contributor
    Hi Smartbear,



    Is Smartbear's Jenkins plugins for TestComplete
    available for download yet?  If so where?



    Thanks.