I would like to have a tool that can be provided with mobile apk file or website main page, and automaticaly be able to:
1. scan all pages + elemants on the apk / html web pages for existence.
2. detect js form and performs random data generation + validation per form object and execution.
it will be also nice to have the ability to automaticly run these test on cross platforms..
Well, the only, probably, area where Selenium excels TestComplete is Selenium's ability to run tests in native iOS and Android environments. Maybe it is possible to have some runtime engine like TestExecute that will be able to be executed in iOS and/or Android (and Linux, but there is already similair idea) and run TestComplete's tests for, at least, WebView and, hopefully, native browsers (well, all after all, Selenium can do this...).
Right now when I use record script, it will record based on the axis like click(10,9),
but I would like to have tool which record based on the object name or any other parameter, like for say button click it should take button name and record script for clicking on the button.
I would invision this to be an application that could traverse the entire tested application and click every button, open every form, and effectively perform a "smoke test" looking for exceptions without any scripts being written or recorded. I believe this would be possible by scanning the application for valid control types (buttons, check boxes, etc) and remembering which it had clicked before, then returning the main form of the application to traverse previously unclicked controls. It would take a while to run such an extensive test but I think very valuable in desktop testing.
I think the most embarrassing thing for any testing department is to have previously working features of their product suddenly stop working with the latest build.
Using TestComplete daily, I would really like to see a companion tool that would allow to do visual testing. No more Name Mapping just simple visual recognition.
The test developer would only have to take partial screenshot that the test would find and act on. Something like Sikuli.
A visual tool that allows writing scripts. Then a command line tool that allows passing in parameters to run the script eg; various search phrases or login details. Finally ability to extractg fields/text from page. I really need this product.
As a free solution, this one should be simple, efficient and easy to use.
Writing Test: it should be only working by recording manual tests/actions. No code or algorithms here.
Test Management: Each Test is added to a simple project hierarchy (not a project suite), no visible NameMapping, Script, KeywordTest...
Running Test: Only run one test or the whole project.
Logs results: no details just:
- Failed : Picture + additional information + datetime of the first failure encouter in the test.
However this solution should concern a lot of user then should be able to test at least Desktop and Web.
Smartbear is famous for creating different types of automation tool.
Smartbear has tools to test functional , API , Load Test , Performance Test but I have not seen a tool to test database in detail.
So smartbear should create new seperate tool to perform database testing. The ideal should be like below :
0) Take savepoint/ snapshot / state of database (save it as savepoint-1) (SQL , SYBASE , ORACLE , SQLITE , POSTGRESQL etc.
1) Using this automation tool user perform some actions on GUI (at the backend it performs some database changes)
[Here user can also create different DML queries or PLSQL procedures or functions , to perform DML operation , which will change values witout GUI]
2) When user saves the project , it creates a another snapshot of database(savepoint-2) . & the original database is rollbacked to the savepoint-1
3) When user presses Run button , it performs the same steps & check the database status with savepoint-2
Please provide additional features where user can perform DML operations.
Also , I would like to see a mobile app , which connects to a PC , this app can be used to see the ren result history or progress / status of the automation run.
What I would like to see is a tool that discovers the network, my machines, my vm's, my ip setup, my dns setup and visualises it for me and lets me test it, for example: What happens if machine with IP: 137.325.1.1 fails (network card shutdown), will my website still be running?
This should also work with containers like Docker, rocket and amazon and azure endpoints.
TestComplete and other smartbrear products are dominating windows environment/users but it is yet to became friendly with Linux environment.
So SmartBear should develop a tool which does testing for applications developed for Linux environment.
Also to add to it further , Python Script should be incorporated with this tool.
I will name this tool as SmartPy.
SmartPy will/may take time to became as strong as TestComplete , but It will be strong once it is up and running.
Hope to see SmartPy very soon.
Since , I have seen lots of posts on forum about "comparisons".... I would like to see SmartComparator tool which compares Images in different format (In visual format) , pdf files , registry file comparator (before & after any application installation) , folder comparator etc. Now I can not recall all the things
I feel , this tool should compare anything... anything, what user wants to compare.
I would like to name this tool as SmartComparator or MasterComparator.
The user should be given a chance to store/map the complete object tree.
If he uses this option, it would validate the existing(stored) map against the applications's current map and spit out the missing objects.
This would be very useful in case of applications where the hierarchy might change. The hierarchy changes are usually found when a test fails or objects aren't present during runtime. This can save us a lot of time too.
Video game development at it's core is still just software development. Having a TestComplete style tool that integrates with popular game engines (Unit, Unreal, etc...) to perform runthrough/smoke tests of games would be a great time and money saver.
The biggest hurtle would likely be performance, but if that can be worked out user input could be scripted and recorded by testers to run full regressions on Beta and RC builds of video games.
Being able to determine if our PDFs that are dynamically filled contain the proper info and also are actualy the right form when the web pages pop them up on the screen.
Being able to compare a PDF document sans the pre-fill data to the new PDF and ignore the info we inputted would be nice too.