To extend the composite project functionality and improve the way ReadyAPI’s XML-files can be version controlled I would like an option to save without property values. Ideally this option can be enabled/disabled for properties defined at Test Step, -Case, -Suite and -Project level with a checkbox.
Currently there is only the option to ‘discard values on save’, which is only available on Test Step level. Discarding values on save can be quite cumbersome if you need the values making changes/corrections while still wanting to save often. This could mean that you need to rerun the whole project after a change is saved, which in my case may take more than half an hour.
At this time I’m still using the ‘discard values on save’ option by lack of alternatives. This also means that all properties in the project must be defined at step level, the only place where this option is available. This in turn means we cannot use functionality like the ‘Run Test Case’ Test Step as this uses properties on Test Case level, which is a real shame.
In my opinion just running and saving the ReadyAPI project should not change the project XML. As this currently does happen it creates hundreds of changes and merge conflicts without any functional changes in the ReadyAPI project.
Testrunner.sh currently supports the -T option, which allows users to specify which tagged test cases they want to run. However, there is not a flag that allows the user to specify which tags to ignore in your test run.
For example, if I tagged test cases with "prototype" I could run only those tests with that specific tag using -T"TestCase prototype". However, if I wanted to run all tests but exclude the prototype tags I currently don't have the ability to do that. Maybe a new tag, or addition of ! into the flag would work?
-T"TestCase !prototype" <----- where ! prefix specifies not to run tests with prototype flag
This could even be expanded further where the -T option would support both inclusive and exclusive tags.
Ex: -T"TestCase prototype !ignorethese" <---- run all tests that have the prototype flag, but don't run those that have ignorethese flag
With the release of ReadyApi 2.0 GetData behavior was changed and we are NOT impressed.
This means that ANY TestSuite, TestCase etc. with names longer than 16 characters all look a like, making it impossible to be efficient as new functionality forces us to MouseOver to be able to find the correct TestCase name.
Please at least make the GetData Columns resiazeable, so we can see the names of our TestSuites and TestCases again!
See attached file.
It would be useful if we add an extra "Suite Group", or "Suite Categories" level in the SoapUI test case hierarchy for organizing test suites. This would be a parent of Test Suite. This way you could collapse.expand categories of test suites. This should be an optional level, so that those who just want test suites wouldn't need to have the extra layer of categories.
Reasoning for it's usefulness:
Currently, in each project, we organize tests by test suite, and test case. There is no broader category than test suite. In a situation where you have multiple APIs that while might mostly be independent, but that do also have interaction with each other, it would be handy to have them all be in a single project.
However, if each API itself needs several test suites for testing it, then having multiple APIs in a single project isn't great for organizing your test suites, since they're all in a flat structure at the test suite level. That's one reason for keeping the APIs in different projects, so that you can expand only the test suites for the given API, without seeing a bit list of all the other API's test suites.
The most common usage for Suite Groups/Categories would likely be to organize test suites by each API in the project, but their would certainly be other categories that people would come up with.
The following feature requests seem too small to have their own feature request, so i decided to collect them in a single post.
When I close ReadyAPI, I'm prompted with a dialog box asking if I really want to edit. This box appears regardless of whether I've made any changes, or if I have the auto-save project option enabled (which I do).
I request that this prompt be removed, or at least be optional via a user preference. It's silly to have to confirm an action I am deliberately taking and an annoyance when using ReadyAPI constantly. Few applications work this way and certainly not ones that can automatically save user changes, which is the main reason you would want a confirmation on exit. If users do it by accident, there is an easy solution: just start ReadyAPI back up.
In SoapUI 5.1.2 (latest legacy version), Get Data dialog was very quick to use because it started with focus in current location from where it was called. So navigating to properties in the same test case (for example) was very quick. In current Ready API, there is some Get Data dialog which starts on Project level and user must navigate via project structure to the level where he called the dialog (usually test case). This is many times slower solution because when project is big, user must scroll in content or remember the path so he can use filter. Anyway in legacy dialog, I was able to reach property in three clicks, now it's like 10 click and lot of scrolling and seeking for my current path
You can compare how it looks in legacy SoapUI and new Ready API and in fact this is the only reason I am still with legacy system because work in it is much faster.
Please make possibility in Preferences to use legacy Get Data dialog OR add button that will navigate me to the current area and will fill Project, Test Suite and Test Case columns
We have a SoapUI project (which I will call project "X" here) responsible for setting up the test environment prior to running regression tests. Project X takes some time to complete. If a test fails in X, we want to immediately terminate the project with failure. We do NOT want to continue executing tests in the project, as the goal is not to collect information from the tests but rather to set up infrastructure.
Currently Project X continues executing tests (setting up infrastructure) even when a failure has occurred. This wastes valuable lab time.
Request that an option be added to configure the project to immediately terminate on first failure. Default should be false, which is the current behavior.
Immediate termination does not mean messy termination -- SoapUI should update logs appropriately, update any generated JUnit-compatible report.xml to indicate that tests were skipped, release internal resources and terminate gracefully.
In the meantime we will try to approximate this behaviour through other means.
It would be useful to have Test Suite tagging, similar to the Test Case tagging which is already available.
This would be especially useful when using the TestRunner through the command line and being able to supply Test Suite tags.
One feature that would be very useful would be to alter the "look" of a testcase/testsuite in the Navigator showing there are unsaved changes on a testcase/testsuite.
Presently there does not appear to be any discernible difference shown to let you know there are unsaved changes in a testcase or testsuite. Unfortunately I have fallen foul of this issue where my machine has lost power prior to me saving and I didn't appreciate how many unsaved changes I had in flight..... and by default the autosave feature isn't enabled.
Thank you in advance.
Hi, it would be nice if Data Sources can be used for the whole project. Right now it is limited to the test case level.
Can we, and if so how, use something like intellisense on a custom groovy library?
So if we have created some utility functions and keep them in a script folder, or library, can we then reference those scripts and their methods intelligently from a groovy test step?
Presently with an excel DataSink it's not possible to define column headers to the Excel file you're creating.
This can present challenges, as it did for me, this combined with the fact that you can't append to an existing Excel file meant all had to be done via CSV file go create the content you wanted, then read the CSV file back in and then DataSink back out to Excel.
It ended up being quite a long winded workaround to overcome product limitations.
It'd be fantastic to have that ability,
Thanks in advance.
When you have several requests that came to a ServiceV mock listener, and you're looking at them in the transaction log, it would be nice if as you looked at each one, that the tab that you selected when viewing a message (e.g. JSON or Raw) remained selected when you clicked on the next message to view, instead of always switching back to XML each time you click then ext message.
Please make ReadyAPI stop keeping what is selected in each of the views in sync with each other when switching between views (Projects, SoapUI, Secure, LoadUI, and ServiceV). It's more of a hindrance than a help.
Reasoning why disabling this syncing is desired:
When switching views, what we most often want is for the last thing selected in a particular view to REMAIN selected the next time we come back to that view after switching to another view.
Unfortunately, whenever we switch views and look at and open an item in it, the other views all select the same project behind the scenes. Then when we switch back to the previous view, we have to go and re-select the item we had left selected and open when we left the view.. This gets frustrating when we're going back and forth a lot between views and ReadyAPI keeps changing focus in each view.
Here is an example:
1. Open a workspace with multiple projects (call them Projects A and B)
2. Go to SoapUI and open Project A and open some test case/steps inside it
3. Go to ServiceV and give focus to a mock listener in Project B (perhaps run it and look at transaction log)
4. Go back to SoapUI and notice that Project B is now selected in the Navigator in the SoapUI project, instead of the the item that you had previously selected in step 2 above, though any opened items are still open, so not too bad... yet
5. Give focus to the opened test case/step in Project A
6. Now go back to Service V. Notice that Project A is now selected, instead of the mock service that you were working in and since ServiceV doesn't work with tabs the service isn't even open anymore. You have to go and re-selected again.
If you have to go back and forth a lot like above, it can get annoying.
Even if you undock your soapUI tests to put them in a different window and then go to Service V so that you can see both at the same time, whenever you go to the SoapUI items, ServiceV then changes it's focus. So there is no work-around.
I've never had any reason to want each of the views to stay synced in what project they have selected.
Would be helpful & efficient if there was a simpler way to compare datasources, especially when working with large data sets where multiple calls to db/json wouldnt be practical.
Scenario - Taking the results of a jdbc query & putting it into a datasource file. Then taking the results of a json query & putting that into a datasource file. Now compare the 2 datasource files to make sure the values match.
I would like to suggest the development of a FTP/SFTP TestStep where I can FTP a generated DataSink file.
That will assist me greatly in automating an entire end to end process without the need for Groovy.
It will be nice to have the option to set generic assertion for all the API request in the project , or to select some of the APEs should have the same assertion .
meaning of generic assertion - The user will create the assertion and will have the option to set it the over API requests.
Motivation - I have hundreds of API requests, more then have of them have the same assertion ,so i need to copy paste them one by one.
Provide an option to also list the Test Steps within each Test Case in the JUnit report. Or provide a way to drill down on each Test Case if needed, by default it can still only show Test Case results. This will be greatly benefit for reporting under a Continuous Integration system.
AFAIK for SoapUI versions up to 1.8.0, the calltestcase step only supports calling test cases within the same project.
We have hundreds of utility test cases in a large project with ~1000 application level test cases that use them. We also have another project containing tests that need to call the same utility test cases. Currently we have to maintain two copies of the utility test cases because the second project cannot call into the first.
Instead, we would like to have one SoapUI project containing the utility test cases, and multiple other projects containing the application level test cases that call into the utility tests. Then we would not need multiple copies of the utility test cases, which is a maintenance headache.
So we'd like to request a SoapUI enhancement to support calling test cases in other projects. That would reduce our maintenance efforts considerably.