Each time I run a Jenkins pipeline I get a new testcase in Zephyr. I want it to add execution to the existing testcase. This happens when I predefine a testcase and when I allow Zeereporter to create the first test case. Occasionally it will add results to one testcase for a little while and then make a new testcase. How do I fix this?
Jenkins plugin for Zephyr will try to reuse testcases in repository if they are present in same folder hierarchy and have same name but each run will create a different cycle phase and different execution.
This is not the behavior that I am seeing. I get a new phase for each execution (Annoying). In each phase i have new new testcase that is identical to the other testcase with the exception of the ID. I currently have 10 testcases produced by the pipeline and each one has one execution. I should have one testcase with 10 executions.
Images are of too low resolution, hard to make out anything meaningful.
I can see that there are lot of folders in execution tab which are cycle phases that Jenkins plugin will create on each run, it is normal behavior of plugin.
What is it showing is that every single run create a new automation phase under the same cycle. Since this is automation I will have thousands of phases pretty quickly. The othe images show each testcase under those phases and shows that each one is identical except for the testcase ID and it show s that they is only one execution on each. It means that as the Jenkins job run for each code check in by I develop I will get a new test case with only one execution and a new phase also. If I look at metric I will look like I have hundreds of testcases when I really only have one testcase with hundreds of executions.
Where does zeeReporter look for testcases to match up with? In ZBot you can define this in the folder watcher.