Reprt of readyAPi
SOLVED- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-26-2020
09:36 PM
01-26-2020
09:36 PM
Reprt of readyAPi
Requirement of report -
1) request
2)response
3)why teststep pass
4)Why teststep fail
5)method
6)End point
7)Assertions
8)Testcase name
9)test suite name
please find attached for approach and follow that .
We need report in Pdf format.
How to write teardownscript and setupscript in readyAPI ?
Solved! Go to Solution.
Labels:
- Labels:
-
Reporting
6 REPLIES 6
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-28-2020
06:44 PM
01-28-2020
06:44 PM
Looks you have come up with approach and groovy script. What is the issue?
And why do you need all the above things in the report?
There couple of factors that needs to be considered.
- Who is the target audience for the report?
- Request and response can be collected easily. However, imagine the time that will be spend to generate and amount of memory required if there are thousands of tests. Why are these required if the tests are passed? Of course, for that good assertions to be in place so that the test is passed all the checks. The tool any way captures them if the test fails which might actually interested for the responsible engineer.
- When the test is failed it will have the end point details.
- The tool can generate the report in pdf format. Use testrunner utility to execute the tests with appropriate reporting options and these designed based on wide usage and standards. And the tool allows to customize the reports. Please try them before writing our own.
https://support.smartbear.com/readyapi/docs/testing/reports/getting-started.html
https://support.smartbear.com/readyapi/docs/testing/reports/index.html
Regards,
Rao.
And why do you need all the above things in the report?
There couple of factors that needs to be considered.
- Who is the target audience for the report?
- Request and response can be collected easily. However, imagine the time that will be spend to generate and amount of memory required if there are thousands of tests. Why are these required if the tests are passed? Of course, for that good assertions to be in place so that the test is passed all the checks. The tool any way captures them if the test fails which might actually interested for the responsible engineer.
- When the test is failed it will have the end point details.
- The tool can generate the report in pdf format. Use testrunner utility to execute the tests with appropriate reporting options and these designed based on wide usage and standards. And the tool allows to customize the reports. Please try them before writing our own.
https://support.smartbear.com/readyapi/docs/testing/reports/getting-started.html
https://support.smartbear.com/readyapi/docs/testing/reports/index.html
Regards,
Rao.
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-28-2020
08:18 PM
01-28-2020
08:18 PM
why do you need all the above things in the report?
There couple of factors that needs to be considered.
===>Its organization requirement.
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-28-2020
08:46 PM
01-28-2020
08:46 PM
I didn't expect an answer; rather introspect and discuss with the team and decide what is required and why. What are the shorts falls of using standard reporting and possible easy customization.
Regards,
Rao.
Regards,
Rao.
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-29-2020
04:41 AM
01-29-2020
04:41 AM
Hi @prajakta,
I appreciate you state the report fields you list are "required by your organisation", but as @nmrao said the list youve provided needs to be carefully considered.
An example of one of the reasons we're saying this is cos the list provided includes "reason test step fails" and "reason test step passes" as field attributes on the report.
The fact that youve included these attributes indicates the list has been put together by someone that is unfamiliar with soapui and in some ways testing itself.
Ignoring the fail option, youd never include a reason a step passes....it just passes so you dont worry about it. There'd be no added value in reporting the pass reason.
In regards to reason a step fails, its unlikely youd get this level of granularity in an execution report. You might include the failure itself (e.g. regex match failure, pattern [A-Z]{5}[0-9]{1}), but its unlikely youd get the full failure reason on the report saying "regex pattern facet restriction match failure due to invalid value 'Abcde99' for regex pattern [A-Z]{5}[0-9]{1}", due to the level of effort required and also this is dependent on the test tool itself. Its not impossible, but i believe its unlikely as i say due to the effort involved for little added value.
The above is just a single reason why we're saying you might want to go back to the person who suggested the report attributes and revisit what is essential and what attributes are just nice to have and go from there.
Ta
Rich
I appreciate you state the report fields you list are "required by your organisation", but as @nmrao said the list youve provided needs to be carefully considered.
An example of one of the reasons we're saying this is cos the list provided includes "reason test step fails" and "reason test step passes" as field attributes on the report.
The fact that youve included these attributes indicates the list has been put together by someone that is unfamiliar with soapui and in some ways testing itself.
Ignoring the fail option, youd never include a reason a step passes....it just passes so you dont worry about it. There'd be no added value in reporting the pass reason.
In regards to reason a step fails, its unlikely youd get this level of granularity in an execution report. You might include the failure itself (e.g. regex match failure, pattern [A-Z]{5}[0-9]{1}), but its unlikely youd get the full failure reason on the report saying "regex pattern facet restriction match failure due to invalid value 'Abcde99' for regex pattern [A-Z]{5}[0-9]{1}", due to the level of effort required and also this is dependent on the test tool itself. Its not impossible, but i believe its unlikely as i say due to the effort involved for little added value.
The above is just a single reason why we're saying you might want to go back to the person who suggested the report attributes and revisit what is essential and what attributes are just nice to have and go from there.
Ta
Rich
if this helped answer the post, could you please mark it as 'solved'? Also if you consider whether the title of your post is relevant? Perhaps if the post is solved, it might make sense to update the Subject header field of the post to something more descriptive? This will help people when searching for problems. Ta
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-29-2020
09:37 PM
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-29-2020
11:41 PM
01-29-2020
11:41 PM
Hi @prajakta,
The following article contains a Groovy example of how to generate a PDF/Excel/CSV type of report. You can play with this example to generate your own code:
---------
Tanya Yatskovskaya
SmartBear Community and Education Manager
Tanya Yatskovskaya
SmartBear Community and Education Manager
