Running tests by tag name in specific order
Hello, I will be running my suite of tests in a CI/CD pipeline (Jenkins) but I realized from the documentation that running tests by tag name (following the CLI commands) does not guarantee the tests will be run in a certain order. (Note:The tests that match the specified tag will be run in an arbitrary order.) While trying to find a workaround to this inconvenience, I realized that it does indeed follow a specific order. The order is given by how the test files are sorted in the file script.tcscript. So, for whoever needs to run their tests using tag names, and also wants to run a "pre-step test" or something like that, all you have to do is open that file on any text editor, and move the row where your test file is, up to the place first place, or at whichever place you want it to be executed. Example: # Assuming all tests have the tag "@Smoke" <folder name="MaiGroup"> <folder name="Group1"> <child name="TestMethod1" key="ZZZZ-YYYYY-VVVVV}" path="File1.js" /> <child name="TestMethod2" key="ZZZZ-YYYYY-VVVVV}" path="File2.js" /> <child name="TestMethod3" key="ZZZZ-YYYYY-VVVVV}" path="File3.js" /> </folder> </folder> # Test run for the @Smoke tag will look like: TestMethod1 TestMethod2 TestMethod3 ----------------------------------------------------------- # Now, if we want to run TestMethod3 first, all we have to do is open the script.tcscript file and move the TestMethod3 to the first place: <folder name="MaiGroup"> <folder name="Group1"> <child name="TestMethod3" key="ZZZZ-YYYYY-VVVVV}" path="File3.js" /> <child name="TestMethod1" key="ZZZZ-YYYYY-VVVVV}" path="File1.js" /> <child name="TestMethod2" key="ZZZZ-YYYYY-VVVVV}" path="File2.js" /> </folder> </folder> # And now, the test run for the @Smoke tag will look like: TestMethod3 TestMethod1 TestMethod2 ----------------------------------------------------------- Hope this helps someone, and maybe the TestComplete team can now update the documentation. Regards.
Session Creator commandline arguments goes lenghty
In my current setup to execute tests from CICD on dedicated VDi machine, we are using session creator utility. I am able to run it using powershell command. However when it comes to maintenance the command line to trigger session creator utility with all the arguments it becomes very lengthy and i don't have success in concatenating all the arguments into one and use it in command line. & $TC_SessionCreatorPath RunTest /UserName:$TestAccountUser /Password:$TestAccountPassword /UseActiveSession /ScreenResolution:$TC_ScreenResolution /ProjectPath:$TC_ProjectPath /p:$TC_ProjectName /tags:$Tags /arg:/pv:browser=$TC_Browser /arg:/pv:update_zephyr=$Zephyr_flag /arg:/pv:zephyrscale_token=$Zephyr_Token /AccessKey:$AccessKey there are still lot more arguments i need to include in the commadline. My ask is how do i put all the arguments into a variable and pass the variable in the command line after 'RunTest'
SessionCreator Execution Logs
Hi there, Does SessionCreator.exe output any execution or operational logs? I'm running it on Azure on nodes in a pool. For some reason I can't figure out, one of the tasks times out, because (I think) SessionCreator/TE has crashed. When I connect to the node myself, I can see the last test that was ran from a log I am writing to during project suite execution, but I can't see why it stopped/crashed, as there has been no mht log produced. The Event Viewer also has no information at the time that the last test ran, which is around where I am expecting SessionCreator/TE to have crashed. Thanks! :)Request for Enhanced Command Line Option to Generate Single HTML Log File in TestExecute/TestCmplete
Hi, when we use the following command line: "C:\ProgramFiles (x86)\SmartBear\TestExecute 15\x64\Bin\TestExecute.exe" "C:\Users\USridhar\Documents\TestComplete15 Projects\ProjectSuite3\ProjectSuite3.pjs" /run /p:TestProject1 /exportLog:"E:\Testing\Test6.html" /e We are receiving multiple .html files, but we need only a single HTML file named Test6.html. We prefer not to use .mht files as they are not compatible with Chrome and Firefox.
Problem using TestExecute in dynamic CI pipeline runner using id-based authentication
Hello. We only have smartbear ids, and no access keys. The CI process spawns new test vms, installs our product, and installs TestExecute with the -SLM flag. If I install and log into TestComplete on one of these dynamically created vms I can use testexecute to run our tests. However, I'm having a really hard time getting those tests to run with just TestExecute on the dynamically created runner vms from our Jenkins Controller. I have TestComplete installed and logged in on the Jenkins controller, but neither the TestComplete Support plugin nor a batch script running TestExecute works without installing TestComplete on the ci runner. I've tried SessionCreator, but again it needs TestComplete installed and logged-in on for a specific user on the remote runner for that to work. How are you supposed to use TestExecute on dynamic runners with id-based authentication without installing TestComplete on the runners as well?
Disable the TextComplete\TestExecute update dialoge automatically (without GUI interaction)
Dear Community, I would like to install TestComplete\TestExecute automatically and then call it via the command line to test certain things. The problem I have is the update dialogue. This appears later and interrupts my test. Dialogues can be suppressed with the /SilentMode parameter, but unfortunately, the following call does not work for me with the latest 15.x.x but worked with latest version of 14.x.x with the following parameters. "C:\Program Files (x86)\SmartBear\TestComplete 15\x64\Bin\TestComplete.exe" "C:\TestCompleteProjects\my_solution.pjs" /run /p:Clone_Me /t: "KeywordTests|Main" /SilentMode /ForceConversion /exit Without the "/SilentMode" parameter, everything works perfectly, but the update dialogue appears later. My questions are: - Can I automatically (without disabling it manually in the settings) deactivate the update check without the /SilentMode parameter? - Is it possible to update automatically without the update dialogue appearing? - Why does my call with the /SilentMode parameter not work? Many thanks in advance. Andreas
Stop Resetting preferences when doing an update!!
I don't understand why Testcomplete still changes preferences when an update is installed. This frequently costs me valuable time since certain preferences make the program not launch. In particular the "Enable Support for Testing Windows Store Applications". This preference gets turned on every single time an update is installed. I have reported it many times over the years to support and I don't understand why it is still being done. Do Windows store applications even exist anymore? Why does TC insist on this being turned on? Why not default it to off? Having this feature turned on requires elevated privileges in order to launch TC projects from the cmd line or using task scheduler. If the feature is on all tasks will fail to launch meaning no tests are ran. The problem is caused by storing this preference data in a file in the install directory here: "C:\Program Files (x86)\SmartBear\TestComplete 15\x64\Bin\TestComplete.exe.manifest" This is bad practice and I am not sure why only some preferences are stored in this manifest file while the rest are stored in the correct user specific appdata location. What can be done to fix this? Thanks.