Current state
Currently, the String generator allows to specify the length of the string and the string contents by character categories:
Letters – By default, this check box is selected.
Digits – By default, this check box is selected.
Spaces – By default, this check box is selected.
Punctuation marks – By default, this check box is selected.
The docs are here https://support.smartbear.com/readyapi/docs/testing/data-driven/types/generator/string.html .
Proposal
However, there are cases which need more precise string format. Regular expression would allow an elegant way to define the format.
I suggest to add an option to set a regular expression pattern. The String generator would follow the regex pattern instead of string length and the above mentioned character categories.
... View more
When sending in data and returning data from a Run Test Case step, each property is single line. This is fine for simple values, but not particularly user-friendly for structured data like JSON. The properties could be multi line with the possibility of scrolling. Currently, I need to copy the data out and use a tool to reformat the data so it is readable. Current: A quick mock-up of what it might potentially look like : We use Run Test Case for things like putting a wrapper round an API call, (with error handling, retry, filtering, mapping functionality etc.) so if an API changes we only need to change it in one place rather than in each test case. We pass the whole JSON payload in and the whole JSON Response back. (If for some reason it would break existing functionality then have an "enable multi-line" checkbox) ALTERNATIVLY: If not possible, then a button at the end of the table row to open the value in a new window (similar to a the Groovy Script run result-output):
... View more
Hi @MConneely ReadyAPI-3.46.1 When trying to delete a test suite which has multiple testcases, the tool is freezing and have to kill it from task manager to get it work. Can you please report it respective team or give me the link to open an issue. Thanks!!
... View more
@rorySB We as a big company need a folderstructure feature. We need to logical group testsuites! Our existing Testframework (Playwright) with Typescript Code is built like this: So we have API Auth. Tests Ressource Userstories (Testsuite) Mapping Sheet Tests (Testsuite) Failure Retests (Testsuite) Ressource Userstories (Testsuite) Mapping Sheet Tests (Testsuite) Failure Retests (Testsuite) Ressource Userstories (Testsuite) Mapping Sheet Tests (Testsuite) Failure Retests (Testsuite) This structure we cannot create with ReadyAPI We need this feature asap because otherwise it could be messy without folders. So pls pack this feat request in your next sprint! Best regards Kranael
... View more
See more ideas labeled with:
For the Smart Assertion tool to be useful, it must be possible to update current values without losing what is already configured. Currently if a piece of data changes, you have to reload the whole response, which causes the loss of all the previous configuration. Moreover, this makes cloning completely useless because if we clone a test, the configured Smart Assertion doesn't work anymore. You need to reload everything. When you have a lot of elements in your JSON response, and you assert the values against a data source, it's a lot of wasting time redoing what you have already done previously.
... View more
See more ideas labeled with:
Rather than relying on outside tools like jsoneditoronline, having the ability to compare expected response from current response would be very beneficial. A user must take the time to copy the expected and the current responses into jsoneditoronline to understand the differences when we have responses that are quite large. Add a new button to the JSONPath Match Assertion dialog to allow for direct comparison in the tool. (side by side view)
... View more
See more ideas labeled with:
Would be nice to have the branch name visible in the workspace, so you always directly know in what branch you are working. This decreases the chance of doing things in the wrong branch.
... View more
Hi Team, I have created a utility which will validate the saved response with new response for an api request how to achieve that 1) I will save the sample response which will be compared with response received at run time 2) The utility will generate all the json path for the new response generated and old saved response and store as list 3)it will iterate over any one list extract the content of each node by doing getstring(jsonpath) function and compare with node value received for saved response using same getstring(jsonpath) 4)it will validate the size if response with respect to saved response by asserting size of both the list 5)if user wants to ignore specfic jsonpath they can pass keyword as exclude it will that jsonpath and will not compare that path value if integrated with soapui/ready api feature it will save significant time in asserting response
... View more
Smart Assertions are very useful when having lots of data that need to be asserted. However currently there are a few issues that make it more difficult then it needs to be: 1. No Search Facility that allows quickly to jump to an item. 2. No conditional flow where assertions can be managed depending on some response details. 3. No facility to deal with lists that are unsorted and can be in a different order each time. 4. No facility to convert the Smart Assertions to Groovy Script which would make it useful as a tool to get a basic script with all the assertions that can be further edited to deal with special cases. Our responses contain hundreds of pieces of data that need to be evaluated. The Smart Assertions are great for quickly generating the assertions of a response but since we have many lists which don't arrive in a specific order, this does not work very well for us. If the Smart Assertions could recognise lists and pre-order them before assertion this would solve this problem and save us a lot of time. We also have an issue with repeated properties like for example version numbers that we only want to change once and then have it used in many places. However using a property only works as long as the data doesn't change. When data changes and we have to make a "Load from Transaction" again, those properties have to be added again. It would be nice to have something like an "Update from Transaction" that notices changes but doesn't overwrite existing items that haven't changed and preserves the properties being used. A differential dialog might be useful here when updating where we can see the changes, modify them if necessary or have them applied. Another great feature would be a conversion from Smart Asserts to Script. Other test applications that we use for desktop applications already can do this and it would be nice if SmartAPI also would be able to generate a script from the Assertions. This would help with situations where we need to have lots of special flows , loops and transformations of data but don't want to always have to write each assert from scratch.
... View more
See more ideas labeled with:
Currently, assertions for "API Connection" test steps can only be created in the test step itself. It would be better if the assertion test steps could be used for this. However, when selecting the test step to be tested, the "API Connection" test steps of the test case are not displayed.
... View more
Currently, gRPC cannot be updated and cannot be re-imported. This means that all API definitions must first be deleted and then the new API definition must be re-imported. Test cases that use the deleted and re-imported gRPC API will lose their test steps.
... View more
It would be nice to add a new feature "beautify" json body like in Postman
... View more
See more ideas labeled with:
Reference Issue - https://community.smartbear.com/t5/ReadyAPI-Questions/Ready-API-3-42-0-automatically-updates-projectVersion-every-time/m-p/240988/emcs_t/S2h8ZW1haWx8dG9waWNfc3Vic2NyaXB0aW9ufExBSklETVhHWkdEMTUxfDI0MDk4OHxTVUJTQ1JJUFRJT05TfGhL#M57307 projectVersion value changes everytime a project is saved. When trying to Pull changes from git, setting.xml needs to be committed first, but it re-appears again as a new change, which blocks pulling from git. The "Discard all changes", don't really discard the document.
... View more
See more ideas labeled with:
In Ready API, we can import API definition directly from SwaggerHub. When in a new version is available, I can't use the update definition feature to load the openAPi specs from Swaggerhub.
... View more
See more ideas labeled with:
The JIRA integration simplifies the creation of JIRA items (bugs, tasks, etc.) The JIRA integration now supports attaching a ReadyAPI project file or a log file (see picture below). It's quite difficult to add any other information from ReadyAPI, since the JIRA dialogue is a blocking pop up window. I would appreciate an option to attach the test step or test case report, including the request, response, and assertions results. As a tester, I would like to: execute a test step, test case or testsuite once the test is finished, click the JIRA button check include test report and create JIRA item The JIRA item would contain the test report in text format.
... View more
See more ideas labeled with:
If 'Filter By:' is selected to list FAIL only: When I open one, I would like to move thru the failures only when using the next/previous button. When I have an item highlighted in the list and uncheck filter, selected item stay selected and 'visible'. This would help to see previous and following steps executed.
... View more
See more ideas labeled with:
The Motivation The Smart assertions are pretty handy as they allow different rules to be set up. There is an option to assign a label, e.g., "Pet tag is present." by right-click on Assertion and selecting "Rename." The proposal Can you please also add the label in the assertion editor (create or edit assertion) so we can set the label straight away when creating the assertion?
... View more
See more ideas labeled with:
Current situation ReadyAPI DataGenerator provides different random values (random integer, email, name, city, etc.) I like this function since it creates nice test data. However, the random values are only accessible via DataGenerator DataSource. Proposal It would be great if we could use them in: REST, SOAP, and other requests Variable setup Groovy scripts etc. In ReadyAPI the random values could be available via: expansion e.g. ${#Random#FirstName} Get data function adding a Random category in the top level Implementation proposal Wrapping Java Faker (https://github.com/DiUS/java-faker ) would do the task. Java faker can be configured to use localized data (e.g. english names, spanish names, etc.) The faker provides a lot of interesting data useful for testing, just to name few of them: Address Animal App Artist Avatar Aviation Book Business Company Color File Finance Food Name Nation Number PhoneNumber and many more, including some funny categories like ChuckNorris.
... View more
Convert response time in milliseconds to seconds format in ReadyAPI
... View more
See more ideas labeled with: