cancel
Showing results for 
Search instead for 
Did you mean: 

Test Execute load time

SOLVED
Highlighted
Occasional Contributor

Test Execute load time

Hi,


We're trying to use Test Execute to run some smoke tests everytime a new build is available from developers to make sure some functionality are still working. The problem is, we are experiencing a huge overhead when starting the Test Execute application. We also noticed the same thing with Test Complete where it takes about 5 mins to open up our project.

 

I just want to understand what's causing this large load time overhead. Is it the number of keyword tests? or the number of scripts? or the size of our name mapping? 

 

Thanks for anyone who can shed light to this mystery

1 ACCEPTED SOLUTION

Accepted Solutions
Occasional Contributor

Re: Test Execute load time

We did try the suggestions there but it decreased runtime not the load time. For now we've decided to make a minimized version of the KeywordTests file so non essential KWTs (those not being used by non developers) would no longer need to be loaded.

 

Thanks everyone for the suggestions!

8 REPLIES 8
Community Hero

Re: Test Execute load time

How many keyword tests do you have?  I have, in my project, something like 300-400 and it loads within a minute (less, usually).  So, this tells me something is happening on load.  Have you tried reducing the number of logs stored in the project?


Robert Martin
[Community Expert Group]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Extensions available
Occasional Contributor

Re: Test Execute load time

We have about 1300 keyword tests. I did try the clearing the logs and it didnt reduce the loading time much. 

 

So I currently have some theories on why its slow:

the massive amount of KWTs

the massive amount of Scripts that we have

the large namemapping

the way we structured organization of the KWTs and the Scripts (we try to separate them into folders)

Community Hero

Re: Test Execute load time

Are you using the visualizer or the NameMapping image capture?  It could be, also, that these are bogging down the load as well.  You could try clearing these out.


Robert Martin
[Community Expert Group]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Extensions available
Community Hero

Re: Test Execute load time

Hi,

 

Another possible option is if your test project is located remotely somewhere on the network shared drive.

 

Regards,
Alex
[Community Expert Group]
____
[Community Expert Group] members are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Postings made by [Community Expert Group] members
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
[Community Expert Group] signature is used with permission by SmartBear Software.
http://smartbear.com/forums/f83/t86934/community-experts/
================================
Occasional Contributor

Re: Test Execute load time

We don't save images in the Namemapping but I did see that we have folders under Visualizer in the KeywordTests folder. Can I delete those things? or do they get used during test execution.

 

@AlexKaras we have all the files locally so i don't think that's a problem.

 

I made a script to clean up the KWTs only retain those necessary for smoke tests and did see a drastic improvement with the load time. I'm guessing the sheer number of KWTs might really be the cause.

Community Manager

Re: Test Execute load time

Hi @wmtan01,

 

Could you please refer to the Enhancing TestComplete Performance article. It shares best practices to set up TestComplete projects.

 

Does it help?

---------
Tanya Gorbunova
SmartBear Community Manager

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓
Occasional Contributor

Re: Test Execute load time

We did try the suggestions there but it decreased runtime not the load time. For now we've decided to make a minimized version of the KeywordTests file so non essential KWTs (those not being used by non developers) would no longer need to be loaded.

 

Thanks everyone for the suggestions!

Community Manager

Re: Test Execute load time

Thanks for sharing your solution with us, @wmtan01!

---------
Tanya Gorbunova
SmartBear Community Manager

Did my reply answer your question? Give Kudos or Accept it as a Solution to help others.↓↓↓↓↓
New Here?
Join us and watch the welcome video:
6 / 7 API Testing Mistakes Video
Top Kudoed Authors