New/Improved Testing Results Report based on a Release
Requesting a new Testing Results Report that provides the following: Contains a drop-down list of the Releases for the applicable QAComplete project. Once a Release is selected, the report lists the Requirements linked to the selected Release. Under each linked Requirement, the report lists the Test Cases (Test ID & Title) linked to the applicable Requirement(s). For each Test Case listed, the Test Results are included that only pertains to the Release selected. Via "Legacy Reports", "Adhoc-Detail", "Requirements Report", we can generate the above report except it doesn't support item #4. I submitted a support ticket (Case #00235269) but was told it was unlikely any future work will occur in the Legacy Report section. As such I request the capability of creating this report in the Reports UI but I need your votes to make it happen. Our organization is deeply committed with the capability of linking Requirements to Releases and linking Test Cases to the applicable Requirements. In fact, we've included the above report as part of our SDLC making it a required deliverable before a service request can be completed. We purchased QAComplete because this functionality (Requirements Traceability) supported our objective in a new Test Management tool. Overall, QAComplete supports this functionality but from our perspective falls short in acccurately reporting it. Thank you for your consideration.
In Serenity Report not showing all the scenarios outline test cases mentioned in feature file
Issue:In scenario outline i have 3 test cases but in serenity report its showing only last test executed case only not all the cases the issue coming to 3.2.4 for serenity 2 version working good I am using serenity 3.2.4 with above depencies and also using cucumber jvm parallel plugin 5.0 the cucumber jvm parallel plugin it will generate a runner classs for each scenario like Paralle01IT, Paralle02IT and the fail safe plugin will run this generated parllell runner classes wheere i run this command mvn clean verify -D Tags="@Venki" through Intellij terminal <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>net.serenitybdd.starter</groupId> <artifactId>serenity-cucumber5-smoketests</artifactId> <version>1.0.0-SNAPSHOT</version> <packaging>jar</packaging> <name>Sample Serenity BDD project using Cucumber</name> <properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> <serenity.version>3.2.4</serenity.version> <serenity.maven.version>3.2.4</serenity.maven.version> <serenity.cucumber.version>3.2.4</serenity.cucumber.version> <cucumber.version>5.5.0</cucumber.version> <encoding>UTF-8</encoding> <tags></tags> <parallel.tests>1</parallel.tests> <webdriver.base.url></webdriver.base.url> </properties> <!-- <repositories>--> <!-- <repository>--> <!-- <snapshots>--> <!-- <enabled>false</enabled>--> <!-- </snapshots>--> <!-- <id>central</id>--> <!-- <name>bintray</name>--> <!-- <url>https://jcenter.bintray.com</url>--> <!-- </repository>--> <!-- </repositories>--> <!-- <pluginRepositories>--> <!-- <pluginRepository>--> <!-- <snapshots>--> <!-- <enabled>false</enabled>--> <!-- </snapshots>--> <!-- <id>central</id>--> <!-- <name>bintray-plugins</name>--> <!-- <url>https://jcenter.bintray.com</url>--> <!-- </pluginRepository>--> <!-- </pluginRepositories>--> <dependencies> <!-- <dependency>--> <!-- <groupId>ch.qos.logback</groupId>--> <!-- <artifactId>logback-classic</artifactId>--> <!-- <version>1.0.13</version>--> <!-- </dependency>--> <!-- - To use Cucumber 4, exclude the old Cucumber 2 cucumber-core dependency from the serenity-core dependency - and include the Cucumber 4 cucumber-java and cucumber-junit dependencies. --> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-core</artifactId> <version>${serenity.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-junit</artifactId> <version>${serenity.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-cucumber</artifactId> <version>${serenity.cucumber.version}</version> <scope>test</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>com.github.temyers</groupId> <artifactId>cucumber-jvm-parallel-plugin</artifactId> <version>5.0.0</version> <executions> <execution> <id>generateRunners</id> <phase>generate-test-sources</phase> <goals> <goal>generateRunners</goal> </goals> <configuration> <featuresDirectory>src/test/resources/features</featuresDirectory> <cucumberOutputDir>target/cucumber-parallel</cucumberOutputDir> <outputDirectory>${project.build.directory}/generated-test-sources/</outputDirectory> <plugins> <plugin> <name>junit</name> <extension>xml</extension> <outputDirectory>target/</outputDirectory> </plugin> </plugins> <glue> <package>stepdefinitions</package> </glue> <tags> <tag>@Venki</tag> </tags> <strict>true</strict> <parallelScheme>SCENARIO</parallelScheme> <!-- <customVmTemplate>src/test/resources/runnertemplate/runner.vm</customVmTemplate>--> </configuration> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-surefire-plugin</artifactId> <version>3.0.0-M5</version> <configuration> <skip>true</skip> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-failsafe-plugin</artifactId> <version>3.0.0-M5</version> <configuration> <forkCount>1</forkCount> <reuseForks>true</reuseForks> <includes> <include>**/*IT.class</include> </includes> </configuration> <executions> <execution> <goals> <goal>integration-test</goal> <goal>verify</goal> </goals> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.8.1</version> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupId>net.serenity-bdd.maven.plugins</groupId> <artifactId>serenity-maven-plugin</artifactId> <version>${serenity.maven.version}</version> <configuration> <tags>${tags}</tags> </configuration> <dependencies> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-core</artifactId> <version>${serenity.version}</version> </dependency> </dependencies> <executions> <execution> <id>serenity-reports</id> <phase>post-integration-test</phase> <goals> <goal>aggregate</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project>
Plan vs Executed & Execution Analysis gadget does not filter out the status which is not selected
As a User when I configure the Gadget Plan vs Executed and Execution analysis with only few status it is considering all status and showing them in others I would like to see only what status is filtered inDashboard gadget for Cross project reporting for Test Automation
Currently there is no way easily report on an entire project, most gadgets are release based. It would be helpful to be able to make these dashboard gadgets report data for the entire project, to be able to compare automation efforts across entire projects - Test Automation Status - Test Automation Distribution
Support filtering gadgets by custom fields
Currently, there's no capability to filter gadgets by specific custom fields. As a user, I need the ability to filter by custom fields to comply with my company's use of custom fields across all projects. Specifically, this would be important for the "Test Execution by Cycle" and "Test Execution Snapshot" gadgets. OLD ID:- ZENT-I-250
