Forum Discussion

khenzel's avatar
khenzel
New Contributor
12 years ago

TestComplete + MS Release Management Automation

Hi All,



I'm currently deciding on a automated deployment solution and i'm strongly considering TFS + Release Management 2013.  One of my main considerations, however, is if TC works with Release Management as an automated test platform in the deployment process.  Has anyone worked with this before?



Release management allows for addition of tools which can then be configured with various actions, so at very least i know i can add in the executable and execute a test plan via command line arguments, however i'm not sure if i can get TC to communicate back to Release Management if there is a failure.



Am i on the right track here, and is it possible to get the software to dynamically communicate for a successful test pass/fail scenario in sequence of my deployment template inside Release Management?



Thanks in advance,



Kevin H.

3 Replies

  • AlexKaras's avatar
    AlexKaras
    Icon for Champion Level 1 rankChampion Level 1
    Hi Kevin,



    Unfortunately, I am not familiar with Release Management 2013, so I cannot provide you with the exact answer, but I am pretty sure that it should be possible to integrate TestComplete with it.

    What is possible with TestComplete:

    -- It is possible to start TestComplete from the command line and command it to execute some given test or set of tests;

    -- It is possible to start TestComplete as an automation COM object and command it to execute some given test or set of tests;

    -- When test is over, TestComplete returns an exit code that indicates whether the test log contains errors/warnings or not;

    -- TestComplete provides a means (test events) that make you possible to write a code that does something (e.g. communicates to your release management system) when an error or warning is going to be posted to the test log.



    I don't have TestComplete's help system at hand, so I cannot provide you with the exact links to the topics that describe the mentioned functionality, but I hope that you will be able to find these topics either in the local TestComplete's help system or online at http://support.smartbear.com/viewarticle/63445/?st="0".
  • maximojo's avatar
    maximojo
    Frequent Contributor
    I was curious about this as well and found this help page. There's even an example batch file to handle show how to various exit codes.



    http://support.smartbear.com/viewarticle/56560/




    TestComplete.exe provides the following exit codes, which report on the results of the last test:








































    Exit Code

    Description

    0

    The last test did not produce errors or warnings.

    1

    The last test results include warnings but no errors.

    2

    The last test results include errors.

    3

    The test cannot be run because of an error. Some typical errors are:



    • The project (or project suite) path is specified incorrectly.





    • The specified project (or project suite) cannot be opened because the current user does not have appropriate permissions for this.





    • There are no selected test items to be run.





    • A test item refers to an unavailable test (for example, a keyword test or script routine that does not exist, or a project item that is unavailable because the needed plug-ins are disabled or not installed).





    • A project item file does not exist (for example, it could have been deleted, renamed or moved to another folder).





    • The script contains a syntax error.





    The test engine also returns the code 3, if you run a project or project suite and the test was stopped with a call to the Runner.Stop method within the OnStartTest event handler. In this case, TestComplete considers the test was unable to start.



    4

    The test run was stopped by the timeout specified with the /Timeout command-line argument. For more information, see the Terminating Tests on Timeout topic.

    1000

    Unable to launch TestComplete, because another instance of TestComplete is already running, or because TestExecute is running.

    -1

    Unable to launch TestComplete because the license check has failed and TestComplete cannot obtain a license. You can find information on TestComplete licensing in TestComplete 10 Licensing Guide that is shipped with TestComplete.








    Tip:

    Inspect the Error.log or Silent.log files to get more information on the possible reasons of the license check failure. For more information on these files, see the description of the /SilentMode and /ErrorLogcommand-line arguments in the TestComplete Command Line topic.


    To resolve licensing problems, please use the Licensing Troubleshooter on our web site:



    Licensing Troubleshooter





  • khenzel's avatar
    khenzel
    New Contributor


    Thank you for the replies.



    I found this article:



    http://support.smartbear.com/viewarticle/57246/



    that looks like i can import TC10 test cases in to MS Test Manager 2013.  I'm still piecing together how Release Management calls its testing during deployment, but it looks like it may work hand-in-hand with Test Manager 2013.

     



    That said, if i was to follow the guide above to import a TC test script, and set it up to somehow execute this test script in my test plan, would that not accomplish what i need to do here without the need to go through a command line COM call?



    Thoughts?