Can Test Complete Integrate with Team Foundation Server

Hi Aneez,

Also, if Test Complete is able to integrate with TFS if a suite is failed, can it automatically log a bug in TFS.

TestComplete can integrate with TFS in several ways. As for integration with TFS as an issue-tracking system, please refer to the first section of the "Working With Issue-Tracking Systems" help topic - it leads to detailed information about how to create TFS issues from within TestComplete manually and automatically.

Hi Mike thanks for your reply.



Acceptance Tests question TFS / Test Complete:



Therefore if were to create Acceptance Tests in TFS, could we then use Test Complete to automate those Acceptance tests so that we can Automate by Product Features.



Please see attached as a visual with regards to what we are trying to achieve.



With Kind Regards,

Aneeez Nabi.

Another question we need absolute clarification on is the following:





This is what we found that Test Complete can do with TFS:



Need to download MSSCCI in order to integrate with TFS.

and can only log bugs or errors from TC to TFC, but can not read Acceptance Tests from TFS to

Test Complete?





Can you confirm whether the above is true?



Or are we wrong in our findings that that Test Complete integrated with TFS can read Acceptance Tests for us to automate our product features?

Hi Aneez,



> [...] Test Complete integrated with
TFS can read Acceptance Tests for us to automate our product features?



I think that this and your other questions need to be clarified because personally I am not sure what do you mean by the 'can read' phrase and the like.

Anyway:

-- Yes, it is possible to create automated tests in TestComplete for your application and execute these tests when building the application by TFS means;

-- Yes, it is possible to create manual Tests in TestComplete (even based on your acceptance tests, as I believe it is possible to extract the contents of acceptance tests from TFS via some code) and execute then them manually (as the name implies);

-- Yes, it is possible to post issues to TFS directly from TestComplete;

-- Yes, it is possible to Check-in/check-out test code to/from TFS directly from TestComplete with the help of MSSCCI provider;

-- No, TestComplete cannot automatically automate your acceptance tests - you'll have to do this yourself;

-- No, it is not possible to link automated tests to your acceptance tests so that when you start some acceptance test the corresponding automated test is executed instead. But probably it is possible to create a code that will mark the acceptance test as passed/failed according to the results of the corresponding automated test. However, personally I do not see any reason for this as you can organize your TestComplete tests (both Manual and automated) using TestItems means (build-in functionality of TestComplete) into Acceptance, Smoke, Full Functional, Performance, etc. groups and execute them according to your needs. Even from within TFS during the build.



Please provide more detailed use case(s) on what do you need if the above does not answer your questions.

Hi Alexei,



Many thanks for your reply.



I guess to simplify:





Say I have a set of Steps and the Expected Result:





1. Log into WPF / Expected Result: Log in Successful -

Aim/What I'm trying to achieve is:

- Can the automation with use of Test Complete be done in a way where I can mark them as pass and fail whils recording the automation?



2. Click on My Timesheets / Expected Result: Pop up window for My Timesheets opens.

- Can the automation with use of Test Complete be done in a way where I can mark them as pass and fail whils recording the automation?

Hi Aneez,



TestComplete (TC) is a test automation tool with a very limited test management functionality. (For the test management see, for example, ALMComplete at http://smartbear.com/products/software-development/application-lifecycle-management-tool) That means that TC can execute automatically some actions sequence (either programmed, or recorded or represented as a Manual Test) and log the result of execution. That's all. While you can use its test log posting functionality, this is not what I would consider seriously, but rather expect that it is test management tool that should be able to pick up test results reported by different test runners.

Some test management tools (e.g. ALMComplete, devTest, etc.) are already TC-aware and has a functionality that makes it possible to 'link' TC test to some test description managed by this tool, execute TC test when user starts test in the tool, pick-up reported result from TC log and report the test as passed or failed. Some tools (e.g. TeamCity) do not have the above functionality and you will have to setup some custom actions to make them possible to access results of the test done by TC.



AFAIK, TFS can internally manage only unit and manual tests in its own format and does not allow to link external test runner to there tests. TestComplete can be integrated with TFS (see relevant help topics - http://support.smartbear.com/viewarticle/12192/ and others) with test results reported within TFS's Test Results pane. So, if I got you right, you will have to migrate your TFS-based acceptance tests to TC-based automated tests.

Hi Aneez,



I might not correctly understand your question, so the below might be not what you was asking, but anyway:

-- I think that you should go through TestComplete help topics that describe TestItems concept and how tests can be organized with the use of TestItems;

-- You can create two top-level TestItems groups in TestComplete project, name them, for example, 'Acceptance Tests' and 'Smoke Tests' and add relevant tests as their children in order to get test sets that you need. Note, that the same test can be linked to different TestItems, so this does not require you to duplicate the tests itself.

-- Alternatively, you can create two different TestComplete projects, one for acceptance tests and another one for smoke tests, add the relevant script units as existing ones to these projects (see help for how to do this), create relevant TestItems in each project and link tests to TestItems. Again, the above actions do not require test code duplication, as all script units are added to the projects as already existing ones.

-- Considering that the acceptance test you presented as a sample is a set of manual actions, i.e. a manual test, it should be quite easy to create the same Manual Tests in TestComplete project(s) and execute these Manual Tests instead of Visual Studio ones. Note, that the latest versions of TestComplete make it possible to replace the steps of Manual Test with the automation code. This gives you an opportunity to automate the test not in whole, but step after step. For example, it is possible to leave initial steps of the test as a manual ones if the start of the tested application can be difficult to automate (e.g. application on start may or may not ask for a license, the path to some database with connection parameters, look for the smartcard inserted into reader, etc.) and leave it to the tester to put the application into required initial state. Then, upon pressing the Next button on the Manual Test form, the automated test will be executed that will do some complex or lengthy actions automatically (for example, create 1000 orders, post them and generate required stock and bookkeeping documents). Then, again, some verification action might be done manually (e.g. check printed documents) by the tester. Later, when you are done with automation of the main functionality, you can proceed with, for example, automation of application's launch and, when done, replace relevant manual steps in Manual Tests with automation code.

-- Results of TestComplete tests should be reported and accessible from within Visual Studio and thus be available in reports generated by TFS.

Hi,



Can we integrate Seapine TestTrack Pro with TestComplete.



Regards,

Sand...

Hi Sandeep,



Well, TestComplete does not provide built-in integration features for this tool. However, it is possible to launch and control TestComplete/TestExecute from external tools via the command line or via COM. Please see the "TestComplete Command Line" and "Working With TestComplete via COM - Overview" help topics for more information.