In readyAPI which report setting helps enable metrics.xml result metrics file?
I readyAPI which report setting helps enable metrics.xml result metrics file? I have a composite projects, where some are creating metrics.xml report file where as some are not. Out of all report settings I don't see a clear difference in the projects. So looking for exact settings to be enabled to generate that metrics.xml file for composite project executions. Thank you!Solved24Views0likes1CommentDetailed Reports
I have a requirement like I need to work on 200+ test cases.I'm having huge no of data for each and every rows.So i have decided to go for to place all the data in an excel sheet. I have used 2 data sources for each request.One is for input and another one is for expected values.Input data source consists of all the inputs that needs to be passed to the post request and expected data source will consists of the expected values.I have added smart assertion to validate the response with actual response.The data source which contains expected values will supply the expected values to the smart assertions. Now my query is if any changes made to the request body it is very difficult to change the request body for all 200+ requests.So i have decided to have one data source loop which run the request as per the data that we have in input data source.But while using data source loop the request and response for each iteration is not displayed. How to make it displayed?30Views0likes3CommentsShow test suite name in gitlab tests reports
Hi community, we are using the readyapi testrunner via docker file in our gitlab ci/cd environment. In order to get a better view of the failled test runs, we edit the yaml using the command line parameters , so that the results not only show as lof file but also in the "tests" tab of the pipeline: unfortunately there seems to be no way to get the test suite name to be shown in the "suite" column does any body have an idea what could be missing in the yaml? variables: ..... COMMAND_LINE: " '-f./reports/' '-j' ./" run: .... stage: test script: - "/bin/sh -c $WORKING_FOLDER/EntryPoint.sh" artifacts: when: always reports: junit: reports/*.xml paths: - "./reports" expire_in: 1 week Thanks for your feedback in advance Regards39Views0likes1Commenthow to change test step name when save test results
Hi, I'm trying to save test result into a file with following scripts. def pName = context.currentStep.testCase.testSuite.project.name //get project name def pDate = new Date().format( 'yyyyMMdd' )//get current date def sDate = pDate.toString()//convert date to string def pTestSuite = context.currentStep.testCase.testSuite.name//get TestSuite name def pTestCase = context.currentStep.testCase.name//get TestCase name def filePath = 'E:/Data/Dean Ding/CRD files/CRD_results_test/'+pName+'_'+sDate+'/'+pTestSuite+'/'+pTestCase+'/'//compose the folder path File file = new File(filePath) if (!file.exists()) file.mkdirs()//create the destination folder fos = new FileOutputStream(filePath+ testStepResult.testStep.label + '.txt', true) pw = new PrintWriter( fos ) testStepResult.writeTo( pw ) pw.close() fos.close() but as my test step name contains symbols like : , " such special symbols which not accepted when create txt file due to naming convention, as there are more than 1000 cases it will take such long time to change my test step name,I found script to replace those symbols but don't know how to make it change when use above script to save test results. It will be much appreciated if anyone can provide the scripts.205Views0likes2CommentsBroken links in test results HTML generated by testrunner.bat
There are broken links in the HTML test results generated by testrunner.bat In Windows, using ReadyAPI version 3.48 How to reproduce: 1 - Create a project that has a period in its name (e.g. Project1.0) 2 - Run the tests through the commandline, using testrunner.bat with the flags -A -r -j -I -f <output file> "-RJUnit-Style HTML Report" -FXML <project file> 3 - Open the index.html on a browser There are broken links in the HTML (they can also be seen directly in the "frame" html files that have been generated in the test results output directory). The reason they are broken is that the period "." character in the project name (and corresponding directory now created in the test results directory) has been replaced with a "/".185Views1like1CommentSetting log level in ReadyAPI and TestRunner
Is there an official way to change the log level when running tests with ReadyAPI and TestRunner? The ReadyAPI docs on groovy scripts only mention using `log.info` to write output from scripts. I would love to be able to use `log.debug`, so that when running locally people can set their ReadyAPI instance to log debug logs but when running with TestRunner in CI we would limit logs to info only.Solved236Views0likes1CommentCustom Reports in the composite file structure, or must be in /bin?
Hello, I converted one of my ReadyAPI projects to composite format, and I noticed there was a "reports" subfolder. There's a big set of custom reports I've been using (jasper and other xml configuration files) that I've had to move into the different \bin report folder structures in the smartbear installation folder when setting up on a new computer. Is there a way when I import the composite project that ReadyAPI can use the reports in the composite folder structure? Or do I have to move everything into the /bin folder when I install on a new machine? I tried populating the report folders of the composite project but I didn't seem to have the option in ReadyAPI to use those custom reports.115Views0likes0CommentsReadyAPI test for Azure DevOps doesn't output log information on the fly
ReadyAPI test for Azure DevOps doesn't output log information on the fly, we have to wait minutes to get information We are trying two approaches to see which one fits our needs. Initially we had a CMD step with the following to execute our test: -f$(Common.TestResultsDirectory) "-RJUnit-Style HTML Report" -FXML "-ECI-Pipeline" "-TTestSuite Integration" "-TTestCase Integration" $(Build.SourcesDirectory) -email $(ReadyAPI.User) -password $(ReadyAPI.Pass) Then we tried the ReadyAPI step from Azure Marketplace but it's too long to start sending log information, is this expected? How long it should take for that step to give log information?247Views0likes2CommentsHow to store Azure pipeline ReadyAPI test results into a network shared path?
I created a pipeline to run ReadyAPI tests.I have used ReadyAPI test for Azure Devops extension andPublish Test Results step in my pipeline and configured the test results path to local path. If i use local path i can see the generated test results. But if i configure the network path in both the extensions, then the result is not generated in the network path. I am able to successfully open the network path in the Agent in which the pipeline tests are running. Still i dont see any files generated. How to properly configure network path for Test Results in the ReadyAPI Test for Azure Devops extension ?218Views0likes1Comment