How to best assert unordered results?
One of the great features of ReadyAPI are the Smart Assertions. They are really useful when dealing with large amounts of data and can be easily adjusted when there are some changes by using "Load f...
Forum Discussion
We understand that the smart assertions falling short of doing certain thing and there were posts to get the ReadyAPI team's attention. Let them come back.
Just curious about your use case. Would you please explain with your input sample and what is expected? Will see if there are other possibilities.
Our APIs return large lists of data that contain other lists of data that are taken from a database. The order is never guaranteed because of parallelism where data is pushed out as soon as they are available and also because the database itself returns data with no guarantee of order. This means that the root data can be unsorted as well as the leaf data. Right now to ensure that all data are asserted correctly it is necessary to do it in a script where we either can pre-order the results and evaluate them one by one or make conditional statements where we check the id and evaluate correspondingly. Some fields are expected to change over time like version numbers, we therefore evaluate them against a single property that we can change with each new version. Other fields do change at times during development and we therefore need a way to quickly adjust for that. If Smart Assertions would recognise Lists they could do the ordering based on a specified key. This would be ideal but unfortunately this feature doesn´t exist yet. They could be a little bit smarter in my opinion 😉
