Forum Discussion
leandropoblet
10 years agoFrequent Contributor
Hi all,
second time writting this post (don't try to attach files and go back.... forum is not intelligent enough to save the text)
All right so I run this really easy and fast tests on different scenarios to measure how bad TestExecute performs and here are the results. It's basically testing the login system of our application, not big deal in terms of difficulty.
Attached you'll find the actual screenshots in case you want to double check.
TC_Run_1_All_Plugins:
TC_Run_2_Used_Plugins_Only:
Now TestExecute:
TE_Run_1_Win7_VM_1:
TE_Run_2_Win8_VM:
TE_Run_3_Win7_VM_2:
I'm really looking forward to receive some explanations on what's going on here. If this is the kind of performance we'll get from now well.... I don't know
Please share more results so we can compare.
Cheers,
Leandro
second time writting this post (don't try to attach files and go back.... forum is not intelligent enough to save the text)
All right so I run this really easy and fast tests on different scenarios to measure how bad TestExecute performs and here are the results. It's basically testing the login system of our application, not big deal in terms of difficulty.
Attached you'll find the actual screenshots in case you want to double check.
TC_Run_1_All_Plugins:
TestComplete v10.20 running with all plugins (default installation)
It took: 11m 40.220s to complete the 189 steps
TC_Run_2_Used_Plugins_Only:
TestComplete v10.20 running with just the used plugins to measeure how much plugins affect performance
It took: 11m 15.737s to complete the 189 steps
This means we got a performance improvement of 30 seconds let's say every 10 minutes. Not too bad. Not good either
Now TestExecute:
TE_Run_1_Win7_VM_1:
TestExecute v10.20 running on a VM (Win7, 1 core, 2gb RAM enough for our purposes)
It took: 2h 20m 21.473s to complete the 189 steps
Awful result. More than 2 hours more to complete the same tests.....
TE_Run_2_Win8_VM:
TestExecute v10.20 running on a VM (Win8, 1 core, 2gb RAM enough for our purposes)
It took (grab a seat): 3h 17m 18.843s to complete the 189 steps
This is by any means an acceptable result.
One more thing: no unnecessary plugins where used of this test
TE_Run_3_Win7_VM_2:
TestExecute v10.20 running on a VM (Win7, 2 core, 2gb RAM on an i7 build)
It took: 2h 17m 33.604s to complete the 189 steps
I'm really looking forward to receive some explanations on what's going on here. If this is the kind of performance we'll get from now well.... I don't know
Please share more results so we can compare.
Cheers,
Leandro