How to link automated test case results with existing test cases
I am using the A.T.O.M Test Automation plugin to import Test Results in one test cycle. The Test Automation Framework is Robot Framework and the output result in in the XUnit XML Format. I am able to "Upload" the XML report as a Task and execute it. It is marked as "SUCCESS". The existing Test Case in Jira is "AMPAND-123", so we expected this test case to be marked as PASSED/FAILED. However the execution created a new Issue in Jira AMPAND-2041 and marked it as PASSED instead of using the existing AMPAND-123 issue. 1. What should we modify to stop creating new test cases when executing uploaded results? (result-xunit.xml) 2. Is it possible to import results from RobotFramework test Report? (example output.xml)2.7KViews0likes3CommentsWhere do I report a bug that is messing up Zephyr?
Yeah, this was a difficult topic to phrase. I'm not looking for how to create a bug in the programme. I'm looking for a way to tell the makers of Zephyr that there's a bug in their programme. This was a virtually impossible thing to find just by googling, as you can imagine.😂 I'll attach two screenshots, of the first and second problem. As you can see in "zephyr bug.jpg", "Learn more" is covering Traceability Matrix, which is not click-able. The menu also got stuck so I couldn't scroll down to Integrations etc. The menu unlocked itself after I refreshed the page a couple of times and it became scrollable again, but while "Learn more" got positioned marginally better, the overall text got even more messed up (zephyr bug2.jpg). Still can't click Traceability. Am I not supposed to be able to click Traceability Matrix? Even if that's the case, it shouldn't get overlapped by "Learn more". None of this should overlap this way. I'll attach a screenshot of the second problem, too.1.6KViews0likes2CommentsCypress - Zephyr integration | Gitlab CI pipeline
Hi, I have an automation suite which is hosted in Gitlab. I have schedules and they are running periodically. I wanted to have them in our test management system which is Zephyr Squad Cloud. In the documentation, I have seen that Junit format is supported and Cypress has capability to generate Junit report. But I am having problems with uploading some reports if they contain failure and if their name has some special chars like (underscore _, which is not listed under banned chars for JQL restrictions) I am wondering if any of you have such an integration. Here is the video: (124) Using Zephyr for Jira within CI/CD Pipelines - YouTube1.4KViews0likes0CommentsUsage of REST API in Zephyr Squad Server
Hi, I am trying to use the Rest API provided by the product "Zephyr Squad - Test Management for Jira Data Center Version 6.2.3". I have installed a Jira+Zephyr test instance to write a script to upload test results from a proprietary test automation framework. Basically I just want to upload logfiles and screenshots and alike as a prove of evidence for test execution. I am aware that Jira and Zephyr is moving from on-premise into cloud. The productive version of the Zephyr Squad Server we are using is: Zephyr for Jira - Test Management for JIRA (Server) 6.1.1 I must confess that I am not very clear with the different version/editions avaliable on-premise as well in the cloud. My understanding is that both mentioned Zephyr versions offer a REST API. My questions are: - where to start, i.e. is there getting started example how to generate credentianls for one of the two mentioned zephyr versions (6.1.1, 6.2.3) and execute a api call? Invoking: http://localhost:8080/jira/rest/zapi/latest results in 404 - when ends support for "Zephyr for Jira - Test Management for JIRA (Server) 6.1.1" I know the first question is not very specific, I am just confused where to get the information due to the different product versions. Just need a hint. Best regards, RaphaelSolved1.4KViews0likes3CommentsZephyr Issue with Traceability Matrix (not filtering)
I link a Test to every Bug and User Story There are 17 tests (17 executions) in my Test Cycle that is nested under “Unscheduled” But when I select the traceability matrix and filter with the cycle I want (the one with 17 tests), I expect to see the 17 User Stories/Bugs linked to the 17 tests that were executed, but it grabs 278 User Stories/Bugs. So I think this is a Zephyr issue with traceability matrix. The Matrix is supposed to show the mapping between a requirement to a test to an execution to a defect, but when filtering by cycle it shows me requirements not related to the cycle. Thanks! -Frieda1.4KViews0likes4CommentsTest Metrics for a project
Good morning all, I am having trouble figuring out why when I look at the test metrics the "Test Executions By Tester" is showing blank. I am not fully sure if I missed a setup to track this information but within the "executions" part of the test metrics there are names under the "Executed" column. Any and all help would be appreciated.1.2KViews0likes1CommentTest Automation task only uses file extension to determine validity of file contents
I have found a bug in the Test Automation task with Upload for the Test Automation Type Prerequisites: working JIRA project with Zephyr Squad active; junit file from a test automation output saved with a ".junit" file extension (valid xml inside) Steps To Repro: 1) Login to JIRA as a valid user for the project 2) Navigate to the Test Automation and Create a New Task 3) Setup the Task with "Upload" for the Automation Type and the ".junit" file selected as the input * other data is unimportant 4) Execute the Task Actual Results: Task will fail with the vague error, "Found invalid file format. Please provide valid file to import with respect to configured framework." Expected Results: Task should run without error since the internals of the file are valid xml (i.e. load the file into your parser to see if exceptions occur rather than assuming the file extension says anything about the file contents) Testing has shown that if you rename the ".junit" to ".xml" that the Task will execute without error. Apparently the file attaching on this site suffers from the same bug 🙂1KViews0likes0CommentsZephyr for Jira: Test execution report in dashboard based on folders
Hi, We want to display status of test execution per test folder rather than per test cycle. It does not seem to be possible using out of the box gadgets from Zephyr for Jira? For some strange reason only possible to see the bar-chart based on test cycle. Has anyone found a workaround for this? Of ofcourse we could make a bunch of test cycles instead of folders, but that is really not a workaround we want to use if at all possible. We can also export to excel, but this requires manual effort and will not provide realtime status to our stakeholders. Hope someone found a solution of it's on it's way from Zephyr. This should really be part of standard reporting. Thanks1KViews4likes0Commentscicd automation integration script returns 500 Error in input
Hi, I'm trying to send test junit test results to JIRA using the provided integration script:https://support.smartbear.com/zephyr-squad-cloud/docs/continuous-integration/integration-script.html When the script runs, the response to the curl request is "status":500,"error":"Internal Server Error","message":"Error in input","path":"/api/v1/automation/job/saveAndExecute" The call to saveAndExecute does create the automation task in JIRA, but when i try to execute manually I receive the error: "Found invalid file format. Please provide valid file to import with respect to configured framework." The results file that I am uploading via the script uploads and executes manually without issue.994Views0likes1Comment