Hello,I hit on problem related to speed of executing tests with using TestComplete as well as TestExecute tools. This issue exists only on one machine and on second everything behaves correctly. I don't know why, but on first machine every operation takes almost 5 times more time than on the second machine. Moreover configuration of both machines is almost identical - physical machine, Windows Server 2008 R2 Standard, TestComplete and TestExecute in version 9.31, 16 GB of RAM. The only difference is in processor model. The first machine has Intel Xeon X5650@2.67GHz and the second one has Intel Xeon E5620@2.40GHz.According to above description the only difference is in processor model but this difference is minimal and I think it shouldn't have any impact on performance during test execution.Can anyone give me any clue what can be wrong on the first machine?On the first machine TC and TE tools were reinstalled but it didn't help at all. It doesn't matter whether I run tests in TC or TE on the first machine - operations are executed very slow in relation to the second machine (the same project, the same scripts).Regards,Michał

Hi Michał and all,I located the file that caused the slow down of testing. It was a project name file *.mds located in the project catalog. I have created new Project Suite and New Project and put there all of Scripts, KeywordTests, NameMapping, Stores and TestedApps (without copying *.mds and *.mds.tcLS files). I have run tests and observed a significant acceleration of executions. One test took about 20 seconds! I copied the "fast" *.mds file to my original suita and tests are still executing fast.I looked at the files *.mds (before and after operations which I mentioned) and what I saw is that the "slower" file contains a lot of nested tags: <Node name="test data"> <Node name="child list"> <Node name="item0000000000"> ... </Node> </Node> with changing the item number through file. "Fast" *.mds file has only one of this tag.I think it is probably conected with Test Items (http://support.smartbear.com/viewarticle/56313/)Greetings,Konrad

I performed also tips which are described on http://support.smartbear.com/articles/testcomplete/test-playback-performance-tips/ but nothing has changed.Regards,Michal

Hi Michal, Do you execute the same project on both machines? Compare project settings on each computer.

Hi Tanya,Yes, I run exactly the same project on both machines.

Hi Michal,the softwares like .NET framework, java or antivírus (and others) are in the same version and configuration in both machines?

TestComplete and TestExecute performance problem

16 Replies

konrad_pastucha
11 years ago
Hi Michał and all,

I located the file that caused the slow down of testing. It was a project name file *.mds located in the project catalog. I have created new Project Suite and New Project and put there all of Scripts, KeywordTests, NameMapping, Stores and TestedApps (without copying *.mds and *.mds.tcLS files). I have run tests and observed a significant acceleration of executions. One test took about 20 seconds! I copied the "fast" *.mds file to my original suita and tests are still executing fast.

I looked at the files *.mds (before and after operations which I mentioned) and what I saw is that the "slower" file contains a lot of nested tags:

        <Node name="test data">

           <Node name="child list">

               <Node name="item0000000000">

               ...

                </Node>

           </Node>

with changing the item number through file. "Fast" *.mds file has only one of this tag.

I think it is probably conected with Test Items (http://support.smartbear.com/viewarticle/56313/)

Greetings,

Konrad
michal_klimek
Occasional Contributor
11 years ago
I performed also tips which are described on http://support.smartbear.com/articles/testcomplete/test-playback-performance-tips/ but nothing has changed.

Regards,

Michal
TanyaYatskovska
SmartBear Alumni (Retired)
11 years ago

Hi Michal,

Do you execute the same project on both machines? Compare project settings on each computer.
michal_klimek
Occasional Contributor
11 years ago
Hi Tanya,

Yes, I run exactly the same project on both machines.
gabriel_henriqu
Occasional Contributor
11 years ago
Hi Michal,

the softwares like .NET framework, java or antivírus (and others) are in the same version and configuration in both machines?
MadsNygaard
Occasional Contributor
11 years ago
Do you have an equal amount of logs in the project on both machines? I've observed a massive hit in TC responsiveness, if too many logs are kept.
michal_klimek
Occasional Contributor
11 years ago
I've tried to run the same project on both machines without any history in logs. In my case it doesn't matter whether I have or not have any logs in project - the result is the same and massive delay in test execution is visible. Moreover on machine where problem doesn't occure more processes are running, including antivirus application and it works much faster. I will try to reinstall everything on this machine including OS and I let you know if it helps.
hlalumiere
Regular Contributor
11 years ago
You mention the physical machine configuration, but are you running TC in a VM on that machine, or directly on the physical host? If it's a VM are they clones of each other? How about their configuration? 1 or 2 VCPUS? How many hard disks and what kind?
michal_klimek
Occasional Contributor
11 years ago
Both environments are standing on physical machines (Windows and TC are installed on physical machines), so there is no virtualization. Disks are pretty fast in these machines. First machine uses SAS 450GB 15K, second machine uses SAS 146GB 15K.
hlalumiere
Regular Contributor
11 years ago
What about non-testcomplete benchmarks? Can you reproduce the performance issue outside of Test Complete at all?