When needing to reconfigure a Message content Assertion all the dynamic "Get Data" references are lost and are replaced by there value instead. It would be a great benefit to when a reconfigure of a message content assertion occurs that the current dynamic references remain or a prompt is displayed to the user whether they want to keep these references or not.
Would it be possible to add a name and/or description against an Event. Currently it only states whether it will run after a test case or a test suite. But we are getting to a point were we have multiple events in this list and its becoming harder to quickly understand what each event does. A simple name/description would make it much easier differentiate between each event and its function.
To extend the composite project functionality and improve the way ReadyAPI’s XML-files can be version controlled I would like an option to save without property values. Ideally this option can be enabled/disabled for properties defined at Test Step, -Case, -Suite and -Project level with a checkbox.
Currently there is only the option to ‘discard values on save’, which is only available on Test Step level. Discarding values on save can be quite cumbersome if you need the values making changes/corrections while still wanting to save often. This could mean that you need to rerun the whole project after a change is saved, which in my case may take more than half an hour.
At this time I’m still using the ‘discard values on save’ option by lack of alternatives. This also means that all properties in the project must be defined at step level, the only place where this option is available. This in turn means we cannot use functionality like the ‘Run Test Case’ Test Step as this uses properties on Test Case level, which is a real shame.
In my opinion just running and saving the ReadyAPI project should not change the project XML. As this currently does happen it creates hundreds of changes and merge conflicts without any functional changes in the ReadyAPI project.
Testrunner.sh currently supports the -T option, which allows users to specify which tagged test cases they want to run. However, there is not a flag that allows the user to specify which tags to ignore in your test run.
For example, if I tagged test cases with "prototype" I could run only those tests with that specific tag using -T"TestCase prototype". However, if I wanted to run all tests but exclude the prototype tags I currently don't have the ability to do that. Maybe a new tag, or addition of ! into the flag would work?
-T"TestCase !prototype" <----- where ! prefix specifies not to run tests with prototype flag
This could even be expanded further where the -T option would support both inclusive and exclusive tags.
Ex: -T"TestCase prototype !ignorethese" <---- run all tests that have the prototype flag, but don't run those that have ignorethese flag
With the release of ReadyApi 2.0 GetData behavior was changed and we are NOT impressed.
This means that ANY TestSuite, TestCase etc. with names longer than 16 characters all look a like, making it impossible to be efficient as new functionality forces us to MouseOver to be able to find the correct TestCase name.
Please at least make the GetData Columns resiazeable, so we can see the names of our TestSuites and TestCases again!
See attached file.
It would be useful if we add an extra "Suite Group", or "Suite Categories" level in the SoapUI test case hierarchy for organizing test suites. This would be a parent of Test Suite. This way you could collapse.expand categories of test suites. This should be an optional level, so that those who just want test suites wouldn't need to have the extra layer of categories.
Reasoning for it's usefulness:
Currently, in each project, we organize tests by test suite, and test case. There is no broader category than test suite. In a situation where you have multiple APIs that while might mostly be independent, but that do also have interaction with each other, it would be handy to have them all be in a single project.
However, if each API itself needs several test suites for testing it, then having multiple APIs in a single project isn't great for organizing your test suites, since they're all in a flat structure at the test suite level. That's one reason for keeping the APIs in different projects, so that you can expand only the test suites for the given API, without seeing a bit list of all the other API's test suites.
The most common usage for Suite Groups/Categories would likely be to organize test suites by each API in the project, but their would certainly be other categories that people would come up with.
Can we, and if so how, use something like intellisense on a custom groovy library?
So if we have created some utility functions and keep them in a script folder, or library, can we then reference those scripts and their methods intelligently from a groovy test step?
Provide an option to also list the Test Steps within each Test Case in the JUnit report. Or provide a way to drill down on each Test Case if needed, by default it can still only show Test Case results. This will be greatly benefit for reporting under a Continuous Integration system.
The following feature requests seem too small to have their own feature request, so i decided to collect them in a single post.
Currently the Conditional GOTO accepts values from executed previous step (Soap response or JDBC) step only.
To enable execution flow control in a test case, parameters read from an input data source can be passed and interrogated in a Conditional GOTO. This feature is not currently provided in Ready API resulting in users having to code the logic in Groovy.
One feature that would be very useful would be to alter the "look" of a testcase/testsuite in the Navigator showing there are unsaved changes on a testcase/testsuite.
Presently there does not appear to be any discernible difference shown to let you know there are unsaved changes in a testcase or testsuite. Unfortunately I have fallen foul of this issue where my machine has lost power prior to me saving and I didn't appreciate how many unsaved changes I had in flight..... and by default the autosave feature isn't enabled.
Thank you in advance.
Hi, it would be nice if Data Sources can be used for the whole project. Right now it is limited to the test case level.
I would like to be able to add a test step that just holds text notes. It wouldn't get executed, it would just be a place to record comments.
Currently, I use a Groovy Script test step and comment everything out. That works but it would be nice to have a cleaner way. (I could use the description for a test case, but I never see those descriptions unless I think to go and look for them.)
It would be useful to have Test Suite tagging, similar to the Test Case tagging which is already available.
This would be especially useful when using the TestRunner through the command line and being able to supply Test Suite tags.
When I close ReadyAPI, I'm prompted with a dialog box asking if I really want to edit. This box appears regardless of whether I've made any changes, or if I have the auto-save project option enabled (which I do).
I request that this prompt be removed, or at least be optional via a user preference. It's silly to have to confirm an action I am deliberately taking and an annoyance when using ReadyAPI constantly. Few applications work this way and certainly not ones that can automatically save user changes, which is the main reason you would want a confirmation on exit. If users do it by accident, there is an easy solution: just start ReadyAPI back up.
Would be helpful & efficient if there was a simpler way to compare datasources, especially when working with large data sets where multiple calls to db/json wouldnt be practical.
Scenario - Taking the results of a jdbc query & putting it into a datasource file. Then taking the results of a json query & putting that into a datasource file. Now compare the 2 datasource files to make sure the values match.
It will be nice to have the option to set generic assertion for all the API request in the project , or to select some of the APEs should have the same assertion .
meaning of generic assertion - The user will create the assertion and will have the option to set it the over API requests.
Motivation - I have hundreds of API requests, more then have of them have the same assertion ,so i need to copy paste them one by one.
We have a SoapUI project (which I will call project "X" here) responsible for setting up the test environment prior to running regression tests. Project X takes some time to complete. If a test fails in X, we want to immediately terminate the project with failure. We do NOT want to continue executing tests in the project, as the goal is not to collect information from the tests but rather to set up infrastructure.
Currently Project X continues executing tests (setting up infrastructure) even when a failure has occurred. This wastes valuable lab time.
Request that an option be added to configure the project to immediately terminate on first failure. Default should be false, which is the current behavior.
Immediate termination does not mean messy termination -- SoapUI should update logs appropriately, update any generated JUnit-compatible report.xml to indicate that tests were skipped, release internal resources and terminate gracefully.
In the meantime we will try to approximate this behaviour through other means.
I would like to suggest the development of a FTP/SFTP TestStep where I can FTP a generated DataSink file.
That will assist me greatly in automating an entire end to end process without the need for Groovy.