Hi Masha,
Thank you for your concern, I appreciate.
Not sure if you meant about my last reply, but I can still reply to you (althought I do not work with Mathijs) and share my thoughts.
In general I am very satisfy of TestComplete/TestExecute. With QAComplete, I am not entirely satisfy since I have not been able to use the automation features fully. Probably due to their limits and time. I feel QAComplete is still more dedicated to manual testing than automated testing.
Regarding my project, it is now delivered with a full setup TestComplete, TestExecute, Automated Testing Bridge complete setup and QAComplete configured to retrieve the test results from the test runs (with the old legacy feature)
I d like to focus on QAComplete now.
The new functionalities regarding test automation (Under Test Library, Automations tab with Test Schedules, Hosts) in QAComplete do not satisfy me. I lke the intention to separate schedules and host, but this is cumbersome to use compare to the old legacy features.
Correct me if I am wrong, you need to import "manually" ZIP file of the project suite (pjs/mds files) for each test you want to run according to the Test Schedules you setup. Therefore when any test change in your test suite you need to upload a new ZIP file.
How do you manage the changes of your project suite without needing packaging every time your project suite.
In the help document (page 163 in PDF file of QAComplete) stands "Pack your TestComplete test projects or project suites to a .zip archive. You can store the TestComplete projects on a shared network folder or website. You can also upload the files directly to your Tests in the Test Library."
Does this mean I don t need to zip my project suite? This might be the solution.
Also the old legacy features (Under Test management --> Automation) where it was possible to "Start Now" the test suites was useful, because you were able to verify at any time whether the bridge btw QA and TC was working (without waiting for the scheduled time you set up). The new features do not allow this anymore.
My wish would be that the Test agent/Automated Bridge Testing could synch between TestComplete project suites located on a shared folder and populate automatically the Test library in QAComplete. Then we could choose the test suite/project suite to run from QAComplete ( and not prepare your test suite in advance in TC) and gets the related test results under Test Management -> automation. The integration btw TC and QAComplete is not finished and new features/updates might come. You probably know.
Regarding the displayed test results, the defined numbers of nbr tests/passed/failed are unclear (still under Test Management -> automation). I am not able to understand what they represent after executing the test runs. In TC, the test logs display 1 pass for 1 test case. While in QAComplete, it says 10 passed for 10 tests whereas I ran only 1 test case. I could not find today an answer to a post I sent in another topic (
http://smartbear.com/forums/f68/t91862/differences-between-number-of-tests-executed-by/)I wish to be able to use QAComplete more, but I am not working anymore in the project. And my guess is that with time, this project will increase with new test cases. And the management of the test automation with QAComplete might not be easy. The new features introduce in some ways new ways of working with QAComplete that needs to be learned. I am not enough experienced with the QAComplete and the Automation features to conclude whether this is good or not. But I am confident it is getting there.
Another discussion would be how to execute a single test case which has parameters from QAComplete instead of specify a whole pre-configured project suite with only one test case included.
Voila!
This was maybe a long feedback and lessons learned from this project. but I think working with the Smartbear products was very interesting and enriching. I d like to continue in the future. Dont hesitate to contact me if needed ;-)
