To extend the composite project functionality and improve the way ReadyAPI’s XML-files can be version controlled I would like an option to save without property values. Ideally this option can be enabled/disabled for properties defined at Test Step, -Case, -Suite and -Project level with a checkbox.
Currently there is only the option to ‘discard values on save’, which is only available on Test Step level. Discarding values on save can be quite cumbersome if you need the values making changes/corrections while still wanting to save often. This could mean that you need to rerun the whole project after a change is saved, which in my case may take more than half an hour.
At this time I’m still using the ‘discard values on save’ option by lack of alternatives. This also means that all properties in the project must be defined at step level, the only place where this option is available. This in turn means we cannot use functionality like the ‘Run Test Case’ Test Step as this uses properties on Test Case level, which is a real shame.
In my opinion just running and saving the ReadyAPI project should not change the project XML. As this currently does happen it creates hundreds of changes and merge conflicts without any functional changes in the ReadyAPI project.
Testrunner.sh currently supports the -T option, which allows users to specify which tagged test cases they want to run. However, there is not a flag that allows the user to specify which tags to ignore in your test run.
For example, if I tagged test cases with "prototype" I could run only those tests with that specific tag using -T"TestCase prototype". However, if I wanted to run all tests but exclude the prototype tags I currently don't have the ability to do that. Maybe a new tag, or addition of ! into the flag would work?
-T"TestCase !prototype" <----- where ! prefix specifies not to run tests with prototype flag
This could even be expanded further where the -T option would support both inclusive and exclusive tags.
Ex: -T"TestCase prototype !ignorethese" <---- run all tests that have the prototype flag, but don't run those that have ignorethese flag
It would be useful if we add an extra "Suite Group", or "Suite Categories" level in the SoapUI test case hierarchy for organizing test suites. This would be a parent of Test Suite. This way you could collapse.expand categories of test suites. This should be an optional level, so that those who just want test suites wouldn't need to have the extra layer of categories.
Reasoning for it's usefulness:
Currently, in each project, we organize tests by test suite, and test case. There is no broader category than test suite. In a situation where you have multiple APIs that while might mostly be independent, but that do also have interaction with each other, it would be handy to have them all be in a single project.
However, if each API itself needs several test suites for testing it, then having multiple APIs in a single project isn't great for organizing your test suites, since they're all in a flat structure at the test suite level. That's one reason for keeping the APIs in different projects, so that you can expand only the test suites for the given API, without seeing a bit list of all the other API's test suites.
The most common usage for Suite Groups/Categories would likely be to organize test suites by each API in the project, but their would certainly be other categories that people would come up with.
With the release of ReadyApi 2.0 GetData behavior was changed and we are NOT impressed.
This means that ANY TestSuite, TestCase etc. with names longer than 16 characters all look a like, making it impossible to be efficient as new functionality forces us to MouseOver to be able to find the correct TestCase name.
Please at least make the GetData Columns resiazeable, so we can see the names of our TestSuites and TestCases again!
See attached file.
Currently the Conditional GOTO accepts values from executed previous step (Soap response or JDBC) step only.
To enable execution flow control in a test case, parameters read from an input data source can be passed and interrogated in a Conditional GOTO. This feature is not currently provided in Ready API resulting in users having to code the logic in Groovy.
I would like to be able to add a test step that just holds text notes. It wouldn't get executed, it would just be a place to record comments.
Currently, I use a Groovy Script test step and comment everything out. That works but it would be nice to have a cleaner way. (I could use the description for a test case, but I never see those descriptions unless I think to go and look for them.)
Provide an option to also list the Test Steps within each Test Case in the JUnit report. Or provide a way to drill down on each Test Case if needed, by default it can still only show Test Case results. This will be greatly benefit for reporting under a Continuous Integration system.
Can we, and if so how, use something like intellisense on a custom groovy library?
So if we have created some utility functions and keep them in a script folder, or library, can we then reference those scripts and their methods intelligently from a groovy test step?
The following feature requests seem too small to have their own feature request, so i decided to collect them in a single post.
One feature that would be very useful would be to alter the "look" of a testcase/testsuite in the Navigator showing there are unsaved changes on a testcase/testsuite.
Presently there does not appear to be any discernible difference shown to let you know there are unsaved changes in a testcase or testsuite. Unfortunately I have fallen foul of this issue where my machine has lost power prior to me saving and I didn't appreciate how many unsaved changes I had in flight..... and by default the autosave feature isn't enabled.
Thank you in advance.
Hi, it would be nice if Data Sources can be used for the whole project. Right now it is limited to the test case level.
It would be useful to have Test Suite tagging, similar to the Test Case tagging which is already available.
This would be especially useful when using the TestRunner through the command line and being able to supply Test Suite tags.
When I close ReadyAPI, I'm prompted with a dialog box asking if I really want to edit. This box appears regardless of whether I've made any changes, or if I have the auto-save project option enabled (which I do).
I request that this prompt be removed, or at least be optional via a user preference. It's silly to have to confirm an action I am deliberately taking and an annoyance when using ReadyAPI constantly. Few applications work this way and certainly not ones that can automatically save user changes, which is the main reason you would want a confirmation on exit. If users do it by accident, there is an easy solution: just start ReadyAPI back up.
Would be helpful & efficient if there was a simpler way to compare datasources, especially when working with large data sets where multiple calls to db/json wouldnt be practical.
Scenario - Taking the results of a jdbc query & putting it into a datasource file. Then taking the results of a json query & putting that into a datasource file. Now compare the 2 datasource files to make sure the values match.
We have a SoapUI project (which I will call project "X" here) responsible for setting up the test environment prior to running regression tests. Project X takes some time to complete. If a test fails in X, we want to immediately terminate the project with failure. We do NOT want to continue executing tests in the project, as the goal is not to collect information from the tests but rather to set up infrastructure.
Currently Project X continues executing tests (setting up infrastructure) even when a failure has occurred. This wastes valuable lab time.
Request that an option be added to configure the project to immediately terminate on first failure. Default should be false, which is the current behavior.
Immediate termination does not mean messy termination -- SoapUI should update logs appropriately, update any generated JUnit-compatible report.xml to indicate that tests were skipped, release internal resources and terminate gracefully.
In the meantime we will try to approximate this behaviour through other means.
It will be nice to have the option to set generic assertion for all the API request in the project , or to select some of the APEs should have the same assertion .
meaning of generic assertion - The user will create the assertion and will have the option to set it the over API requests.
Motivation - I have hundreds of API requests, more then have of them have the same assertion ,so i need to copy paste them one by one.
Currently, if there is a custom Groovy script is running in soapUI Pro or ReadyAPI and it doing something complex, such as accessing some external APIs or resources, it is impossible to stop it in a reasonable amount of time.
There is not 'Stop" button available either, so it ends up "hanging" the application.
The only other way it would stop is by closing the ReadyAPI, but that's not only inconvenient but sometimes not advisable as it may not save the current project correctly.
I would like to suggest the development of a FTP/SFTP TestStep where I can FTP a generated DataSink file.
That will assist me greatly in automating an entire end to end process without the need for Groovy.
In SoapUI 5.1.2 (latest legacy version), Get Data dialog was very quick to use because it started with focus in current location from where it was called. So navigating to properties in the same test case (for example) was very quick. In current Ready API, there is some Get Data dialog which starts on Project level and user must navigate via project structure to the level where he called the dialog (usually test case). This is many times slower solution because when project is big, user must scroll in content or remember the path so he can use filter. Anyway in legacy dialog, I was able to reach property in three clicks, now it's like 10 click and lot of scrolling and seeking for my current path
You can compare how it looks in legacy SoapUI and new Ready API and in fact this is the only reason I am still with legacy system because work in it is much faster.
Please make possibility in Preferences to use legacy Get Data dialog OR add button that will navigate me to the current area and will fill Project, Test Suite and Test Case columns