cancel
Showing results for 
Search instead for 
Did you mean: 

TestComplete scalability vs Appium

SOLVED
allenj2020
Contributor

TestComplete scalability vs Appium

Hello all,

 

I'm a long time TestComplete desktop user, but we're developing a companion mobile app for the first time.

I'm in the early stages of researching automation options.

 

Appium seems to be the industry leader and is supported by many cloud based device farms for scripting, it looks like it can scale to any level needed and do parallel test execution, but the setup is complex and the learning curve is steep.

TestComplete Mobile is tempting as it will allow us to easily write new mobile tests using our existing test framework and knowledge, but I'm concerned about the long term scalability if we want to quickly run tests on multiple devices in the future.  At the moment it seems to be limited to just physical connected device(s)?

This will be fine in the short term, but I don't want to get a couple of years into a full implementation, decide we want to do parallel testing on multiple physical/virtual/cloud devices at once, and find out we can't do it.

 

Does anyone have any experience or comments on the scalability of TestComplete Mobile?

Will it support, or are there plans to support:

a) Multiple physical devices on the same machine.

b) Cloud based device farms.

b) Automated or semi automated device configuration (e.g. deploy the app and run the test).  If this can be done with external setup scripts that's OK.

d) Emulators (e.g. launched from Android Studio) - low priority but could be occasionally useful.  I'm not as interested in the Chrome simulation capability as it also requires a Web module license which we don't have.

 

Thanks for any input you may have!

Allen

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
AlexKaras
Community Hero

Re: TestComplete scalability vs Appium

Hi Allen,

 

> Will it support, or are there plans to support:

Obvious note : this is a user forum and none of us is informed about development plans. You may contact Support directly via the https://support.smartbear.com/message/?prod=TestComplete form and wonder if they can provide any piece of information.

 

Nevertheless:

-- Multiple physical devices on the same machine are supported but in sequential execution mode (i.e. tests can be executed on only one device at a time);

-- Cloud device farms are not supported. (Yet?). Though AWS cloud itself is supported - search https://support.smartbear.com/articles/testcomplete/ page for the 'Cloud' word - there are 5+ articles on the topic;

-- Application deploy (installation) to device is supported;

-- Android emulators are supported.

 

P.S. With TestComplete it is possible and not complex to create tests that interact with both desktop and mobile. E.g. do something in mobile and process the result in desktop. This is something that obviously cannot be implemented with Appium.

 

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================

View solution in original post

6 REPLIES 6
Marsha_R
Community Hero

Re: TestComplete scalability vs Appium

There's a lot of information here

https://smartbear.com/product/testcomplete/mobile-testing/

 

and an email contact at the bottom of that page for questions

AlexKaras
Community Hero

Re: TestComplete scalability vs Appium

Hi Allen,

 

> Will it support, or are there plans to support:

Obvious note : this is a user forum and none of us is informed about development plans. You may contact Support directly via the https://support.smartbear.com/message/?prod=TestComplete form and wonder if they can provide any piece of information.

 

Nevertheless:

-- Multiple physical devices on the same machine are supported but in sequential execution mode (i.e. tests can be executed on only one device at a time);

-- Cloud device farms are not supported. (Yet?). Though AWS cloud itself is supported - search https://support.smartbear.com/articles/testcomplete/ page for the 'Cloud' word - there are 5+ articles on the topic;

-- Application deploy (installation) to device is supported;

-- Android emulators are supported.

 

P.S. With TestComplete it is possible and not complex to create tests that interact with both desktop and mobile. E.g. do something in mobile and process the result in desktop. This is something that obviously cannot be implemented with Appium.

 

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================

View solution in original post

tristaanogre
Community Hero

Re: TestComplete scalability vs Appium

If you purchase a license to use the Environment Manager via TestComplete, then you have access to multiple hardware devices that you can execute tests on.  However, I DON'T know if that will work for custom mobile applications.  I think it only supports web applications displayed on mobile devices.


Robert Martin
[Hall of Fame]
Please consider giving a Kudo if I write good stuff
----

Why automate?  I do automated testing because there's only so much a human being can do and remain healthy.  Sleep is a requirement.  So, while people sleep, automation that I create does what I've described above in order to make sure that nothing gets past the final defense of the testing group.
I love good food, good books, good friends, and good fun.

Mysterious Gremlin Master
Vegas Thrill Rider
Extensions available
AlexKaras
Community Hero

Re: TestComplete scalability vs Appium

Great note, Robert!

https://crossbrowsertesting.com/ is what Robert talked about. (Though I am also not sure if they support regular, non-web applications...)

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================
allenj2020
Contributor

Re: TestComplete scalability vs Appium

Thanks Alex, that's good information about the device support.  

 

I'm already doing parallel execution of the desktop application tests with multiple test machines, it would be interesting to push the boundaries and see if having 2-3 physical devices or emulators on each host could be made to work.

 

Our application will be a pure Android and iOS app, not web based, so I don't think the cross browser testing ability will be helpful.

 

I would still be curious to hear from any users doing multi-device testing with TestComplete Mobile.

But based on the information so far it sounds promising enough to move ahead with a trial.

 

Thanks.

Allen

AlexKaras
Community Hero

Re: TestComplete scalability vs Appium

Any time, Allen 🙂

 

I remember that @nginoza did a lot of mobile testing with TestComplete. Maybe he can provide some comments as well...

Regards,
  /Alex [Community Hero]
____
[Community Heroes] are not employed by SmartBear Software but
are just volunteers who have some experience with the tools by SmartBear Software
and a desire to help others. Posts made by [Community Heroes]
may differ from the official policies of SmartBear Software and should be treated
as the own private opinion of their authors and under no circumstances as an
official answer from SmartBear Software.
The [Community Hero] signature is used with permission by SmartBear Software.
https://community.smartbear.com/t5/custom/page/page-id/hall-of-fame
================================
New Here?
Join us and watch the welcome video:
Announcements
Top Kudoed Authors