Ask a Question

Custom results reporting with test step pass/fail

nburns
Occasional Contributor

Custom results reporting with test step pass/fail

Hello,

 

I am evaluating the ability to have automated test results posted to Zephyr Scale in Jira.  I can get a cycle to be created, placed in a folder of my choosing and mark a test case as pass/fail but I cant find any information on how to get steps in a test case to be marked as pass/fail.  Any assistance would be a great help.

 

Here is an example test results file:

 

{
    "version" : 1,
    "executions" : [ 
        {
            "result": "Failed",
            "testCase": {
                "key" : "ENG-T1"
            },
            "steps": [
                {
                    "result": "Passed"
                }
            ]
        },
        {
            "result": "Passed",
            "testCase": {
                "name" : "This is a test"
            }
        }
    ]
}
9 REPLIES 9
MisterB
Community Hero

Not sure if you've done so already but you could try the results from this search: Search - SmartBear Community

 

 

nburns
Occasional Contributor

I have but im not seeing any documentation on the available format of the results json file.  Do you have a link to some documentation on all the available fields for the results json file?

There is the API documentation but I guess you already have this link?

 

Zephyr Scale for Jira Cloud API (smartbear.com)

nburns
Occasional Contributor

Yes. I’m looking for documentation on the actual supported options INSIDE the file that is posted to the automation endpoint to see what is supported and possible to have in the file
nburns
Occasional Contributor

To be more specific, the documentation says a zip file with the custom results, but I do not see any link or full documentation as to what is supported for the file contents

 

nburns_0-1657222417729.png

 

MisterB
Community Hero

@josh42 might be able to help you with this one

josh42
Community Hero

I'm not too familiar with the cloud API, but have a look at the docs for the JUnit integration which is what the endpoint is for.

 

https://support.smartbear.com/zephyr-scale-cloud/docs/test-automation/junit-integration-and-similar....

https://support.smartbear.com/zephyr-scale-cloud/docs/test-automation/junit-integration-custom.html

 

Cheers

Josh

nburns
Occasional Contributor

I have seen all these, but still it seems very bad that SmartBear does not have some documentation to explain what the shape of the .json data can be and is parse as.  For eample, https://github.com/SmartBear/zephyr-scale-junit-custom-format-example/blob/main/zephyrscale_result.j....  In that json file it has some details in executions but what keys are supported?  What ones are not in that example that someone can leverage? 

MisterB
Community Hero

The SmartBear support team might be able to help you: Support Portal

cancel
Showing results for 
Search instead for 
Did you mean: