Coverage report filtering by issues and label?
Hi, I'm trying to generate a coverage report for automated tests against user stories. However, I need to filter both by jira issues and zephyr test cases. Not all user stories will be covered by auto tests - we add an 'auto-test' (jira) label to the stories we want to cover. Also, stories can be linked to both manual and auto tests cases - the auto test cases will have the 'auto-test' (zephyr) label. So I can use the 'filter by issues' option to show coverage of the user stories selected for automated coverage, but that will include manual test cases which I want to filter out. Or I can use the 'filter by label' which will show coverage of automated test cases, but this won't show any user stories selected for automation that have 0 coverage. Is there a way to combine these filters, to show coverage of auto tests against user stories marked for automation, including stories with 0 coverage?
Need more query parameters on Zephyr REST API
When can we expect the Zephyr REST API to be updated with additional query parameters? At the moment it only supports four, which is far too limited for practical use. Specifically, we need the ability to query by custom fields and labels. Right now, we’re forced to pull all available data and then filter it ourselves, which is both inefficient and significantly impacts response times. A more scalable approach would be to allow direct queries for the specific items we need, reducing unnecessary overhead and making the API far more usable at scale. I can see that there are (Next Gen) versions coming but they lack the query parameters that day to day users actually need to be efficient. Please fix this.
Use Zephyr Scale Cloud API to add existing test cases to and newly created test cycle.
I am attempting to do this via powershell script in teamcity but I am getting a 404 when it attempts to add the testcase to the testcycle. I cannot for the life of me figure out why it is not working. any help is appreciated. # ----------------------------- # Create test cycle # ----------------------------- try { $createResp = Invoke-RestMethod -Uri $TestCycleEndpoint -Method POST -Headers $headers -Body ($body | ConvertTo-Json -Depth 5) $testCycleKey = $createResp.key Write-Host "✅ Created Zephyr Scale test cycle: $testCycleKey (linked to $($env:ZS_LINKED_ISSUE))" } catch { $errResponse = $_.Exception.Response if ($errResponse -ne $null) { $reader = New-Object System.IO.StreamReader($errResponse.GetResponseStream()) $responseBody = $reader.ReadToEnd() Write-Error "❌ Failed to create Zephyr Scale test cycle: $($_.Exception.Message)`nResponse: $responseBody" } else { Write-Error "❌ Failed: $($_.Exception.Message)" } exit 1 } # ----------------------------- # Add mapped test cases to the cycle # ----------------------------- $cycleTestCases = @() foreach ($rxName in $TestCaseMapping.Keys) { $cycleTestCases += @{ testCaseKey = $TestCaseMapping[$rxName] } } $addCasesEndpoint = "https://api.zephyrscale.smartbear.com/v2/testcycles/$testCycleKey/testcases" $addCasesBody = @{ items = $cycleTestCases } try { Invoke-RestMethod -Uri $addCasesEndpoint -Method POST -Headers $headers -Body ($addCasesBody | ConvertTo-Json -Depth 5 -Compress) Write-Host "✅ Added $($cycleTestCases.Count) test cases into cycle $testCycleKey" } catch { Write-Error "❌ Failed to add test cases into cycle ${testCycleKey}: $($_.Exception.Message)" exit 1 }
Using Datasets
Where can I get more information on how to use Datasets in Zephyr for Jira (in the cloud). I defined a Dataset "Application Pages" and have a list of the pages in the application (Page 1, Page 2, etc). But I cannot find a way to add another column to that dataset to tie any additional information to those pages. AND when I add the dataset to a test case, it requires me to choose each entry in the dataset as a row to the table at the top of the test. I was expecting to be able to define a Dataset as a multidimensional object (table with multiple columns) like when I'm doing the "Custom Input" that is directly in the test case. Is there a way to do a table like that and have it shared across multiple test cases? Given the way that Datasets seem to be working, I'm not seeing the value of them vs just putting the Custom Input data in each test case. How are people using them? Thanks!
How to generate custom reports in Zephyr Scale filtered by folder, status, and label
Hi everyone, We have 4 teams, each maintaining their own test folder in Zephyr Scale. Every test case in these folders is accurately tagged with: Statuses: In Progress Completed Manual Blocked Labels: API_AUTOMATION UI_AUTOMATION MANUAL_TESTING What I need: Select a specific team’s folder. Generate status-based reports (e.g., Automated vs Manual percentage). Generate coverage reports (e.g., API vs UI coverage based on labels). Important notes: I’m not looking for execution results. I want to report on existing test cases and their current status/labels. I’ve tried Test Execution Results (List) and Summary reports with advanced filtering, but none give me the desired breakdown. Question: What’s the best way to customize or create a report in Zephyr Scale to achieve this? Is there a way to combine folder filter with status and label filters for a non-execution-based test case report? Thanks in advance for any guidance.
How to upload an attachment file to a test execution via Zephyr Scale Cloud REST API?
I'm trying to upload an attachment to a test execution in Zephyr Scale using the REST API. I’ve reviewed the official API documentation (https://support.smartbear.com/zephyr-scale-cloud/api-docs/), but I couldn’t find any relevant endpoint that supports uploading attachments. I have the following questions that I need help with: Does Zephyr Scale support uploading attachments to test executions via the REST API? If yes, what is the correct endpoint and request format? If not, is there any recommended workaround or alternative method to achieve this? Any help or clarification would be greatly appreciated. Thanks in advance!Set Environment When Uploading Test Execution Result to Zephyr
We are using Zephyr Test Managment and Automation for Jira Cloud. We were able to setup a test execution via Gitlab CI and upload the result to Zephyr via https://api.zephyrscale.smartbear.com/v2/automations/executions/custom. But one thing that we can't figure out is to set the environment where we did the execution. We've tried passing "environment", "environmentId", "environmentName", etc. But none of them works. Zephyr doesn't seem to recognize them. We can't seem to find any documentation about it as well. Here's what we tried so far: { "version": 1, "executions": [ { "source": "My Request", "result": "Failed", "testCase": { "name": "API response has status 200", "key": "TESTKEY-T123123", "environment": 3814706, "environmentId": 3814706, "environmentName": "QA" } } ] } And here's what we're always seeing in Zephyr: Can anyone shed some light as to how we can make it work?
Missing/Incomplete API Integrations
Hi, Maybe I have just missed something, but as far as I can tell the following is missing from the Scale Cloud API which is making it's usage a bit... challenging. You can only fetch test case versions, cannot create new ones Cannot create Parameters for Test Scripts Cannot fetch Custom Field definitions Paginated requests don't support basic searching (Bit pointless without it...) Can't search for test cases which have no parent folder Can't update Owner/Priority after creation (Could just be my integration being incorrect) There could be more, but could anyone tell me if I am losing my mind, or maybe just looking at old documentation? https://support.smartbear.com/zephyr-scale-cloud/api-docs/#section/Introduction Maybe if there is more missing you'd want to add it to this thread and I'll do a big support ticket. ThanksInfinite spinner for Test Cases view when editing a Test Cycle
After getting a generic error for saving current state of the Test Cycle sometimes I'm getting an infinite spinner on the Test Cases tab and nothing can resolve it - tried to close the tab, browser, tried to logout and re-login to Jira - the spinner is still present on Test Cases view of the Test Cycle Zephyr Scale on Jira Cloud
BDD - Gherkin Script - Unexpected error "Line should start with one of the following keywords:"
From today's morning, our team got a couple of errors in the previously valid BDD test cases. In all cases, the error message is the same: Line should start with one of the following keywords: Given, When, Then, And, But, *, or #. Interestingly, we have many similar tests for different endpoints, but errors appeared only in a few of them. Also, there are no new release notes on the Zephyr Scale, so what happened, and when will it be fixed?
