Forum Discussion
Yeah you're right. When using external test runs, results are not tied to the scenarios you wrote. Sorry, I missed that it was important in your initial request.
To get the link between both, you need to create a test run from your scenarios, and then export those tests to code skeleton using hiptest-publisher. Upon doing that, you'll see that it generates tests in your language. Each test contains a uid that identify them on the CucumberStudio side.
After executing your tests, you'll have a result file that contains the test results and the uid. Pushing it back to CucumberStudio will update the results in the test run.
To be able to generate a cucumber json result file, you should use a gherkin based framework like SpecFlow. Is it an option in your case?
If exporting to C# directly, when a test fails, it's hard to know at which step it was failing because this information is not present most of the time: we only have the test name, and the steps are test implementation details. It looks like you are able to get this information though as you wanted to use the API to update tests at the step level. Can you describe how you have this information?
Can you add support to add/update statuses of test steps? this will be great feature and we will move on your platform.
- cbliard4 years agoSmartBear Alumni (Retired)
remixtedi wrote:
Can you add support to add/update statuses of test steps? this will be great feature and we will move on your platform.
So we have just added this ability. You can find the relevant documentation on our REST API documentation
To explain it briefly: along with the status, status-author and description attributes, you can also add a step-statuses attribute. It must be an array of string. Each string is a status. Possible values are ‘passed’, 'failed’, 'wip’, 'retest’, 'blocked’, 'skipped’, 'undefined’.It then looks like this:RequestPOST https://studio.cucumber.io/api/projects/8194/test_runs/274529/test_snapshots/17761339/test_results HTTP/1.1Content-Type: application/json; charset=utf-8Accept: application/vnd.api+json; version=1access-token: xxxxxclient: xxxxxuid: christophe.bliard@hiptest.net{"data": {"type": "test-results","attributes": {"status": "passed","status-author": "Chris","description": "Allright!","step-statuses": ["passed", "undefined", "passed"]}}}Response{"data": {"type": "test-results","id": "218522447","attributes": {"created-at": "2021-03-04T13:16:18.426Z","updated-at": "2021-03-04T13:16:18.426Z","last-author": "christophe.bliard@smartbear.com","status": "passed","description": "Allright!","status-author": "Chris","step-statuses": ["passed","undefined","passed"],"test-snapshot-id": 17761339,"execution-environment-id": 178455},"links": {"self": "/test-results/218522447"},"relationships": {"test-snapshot": {"data": {"type": "test-snapshots","id": "17761339"}},"build": {"data": {"type": "builds","id": "1126746"}},"execution-environment": {}}},"included": [--truncated--]}And a screenshotHope that helps 🙂
Related Content
- 2 years ago
- 2 months ago
Recent Discussions
- 31 days ago
- 3 months ago
- 3 months ago
- 3 months ago
- 3 months ago