New/Improved Testing Results Report based on a Release
Requesting a new Testing Results Report that provides the following: Contains a drop-down list of the Releases for the applicable QAComplete project. Once a Release is selected, the reportlists the Requirements linked to the selected Release. Under each linked Requirement, the reportlists the Test Cases (Test ID & Title)linked to the applicable Requirement(s). For each Test Case listed, the Test Results are included that only pertains to the Release selected. Via "Legacy Reports","Adhoc-Detail", "Requirements Report", we can generate the above report except it doesn't supportitem #4. Isubmitteda support ticket (Case #00235269) but was told it was unlikely any future work will occur in the Legacy Report section. As such Irequest the capability of creating this report in theReports UI but I need your votes to make it happen. Our organization is deeply committed withthe capability of linkingRequirements to Releases and linking Test Cases to the applicable Requirements. In fact, we've includedthe above report as part of our SDLCmaking it a requireddeliverable before a service request can be completed. We purchased QAComplete becausethis functionality (Requirements Traceability)supported our objective in a new Test Management tool.Overall, QAComplete supports this functionality but from our perspective falls short inacccurately reporting it. Thank you for your consideration.
In Serenity Report not showing all the scenarios outline test cases mentioned in feature file
Issue:In scenario outline i have 3 test cases but in serenity report its showing only last test executed case only not all the cases the issue coming to 3.2.4 for serenity 2 version working good I am using serenity 3.2.4 with above depencies and also using cucumber jvm parallel plugin 5.0 the cucumber jvm parallel plugin it will generate a runner classs for each scenario like Paralle01IT, Paralle02IT and the fail safe plugin will run this generated parllell runner classes wheere i run this command mvn clean verify -D Tags="@Venki" through Intellij terminal <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>net.serenitybdd.starter</groupId> <artifactId>serenity-cucumber5-smoketests</artifactId> <version>1.0.0-SNAPSHOT</version> <packaging>jar</packaging> <name>Sample Serenity BDD project using Cucumber</name> <properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> <serenity.version>3.2.4</serenity.version> <serenity.maven.version>3.2.4</serenity.maven.version> <serenity.cucumber.version>3.2.4</serenity.cucumber.version> <cucumber.version>5.5.0</cucumber.version> <encoding>UTF-8</encoding> <tags></tags> <parallel.tests>1</parallel.tests> <webdriver.base.url></webdriver.base.url> </properties> <!-- <repositories>--> <!-- <repository>--> <!-- <snapshots>--> <!-- <enabled>false</enabled>--> <!-- </snapshots>--> <!-- <id>central</id>--> <!-- <name>bintray</name>--> <!-- <url>https://jcenter.bintray.com</url>--> <!-- </repository>--> <!-- </repositories>--> <!-- <pluginRepositories>--> <!-- <pluginRepository>--> <!-- <snapshots>--> <!-- <enabled>false</enabled>--> <!-- </snapshots>--> <!-- <id>central</id>--> <!-- <name>bintray-plugins</name>--> <!-- <url>https://jcenter.bintray.com</url>--> <!-- </pluginRepository>--> <!-- </pluginRepositories>--> <dependencies> <!-- <dependency>--> <!-- <groupId>ch.qos.logback</groupId>--> <!-- <artifactId>logback-classic</artifactId>--> <!-- <version>1.0.13</version>--> <!-- </dependency>--> <!-- - To use Cucumber 4, exclude the old Cucumber 2 cucumber-core dependency from the serenity-core dependency - and include the Cucumber 4 cucumber-java and cucumber-junit dependencies. --> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-core</artifactId> <version>${serenity.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-junit</artifactId> <version>${serenity.version}</version> <scope>test</scope> </dependency> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-cucumber</artifactId> <version>${serenity.cucumber.version}</version> <scope>test</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>com.github.temyers</groupId> <artifactId>cucumber-jvm-parallel-plugin</artifactId> <version>5.0.0</version> <executions> <execution> <id>generateRunners</id> <phase>generate-test-sources</phase> <goals> <goal>generateRunners</goal> </goals> <configuration> <featuresDirectory>src/test/resources/features</featuresDirectory> <cucumberOutputDir>target/cucumber-parallel</cucumberOutputDir> <outputDirectory>${project.build.directory}/generated-test-sources/</outputDirectory> <plugins> <plugin> <name>junit</name> <extension>xml</extension> <outputDirectory>target/</outputDirectory> </plugin> </plugins> <glue> <package>stepdefinitions</package> </glue> <tags> <tag>@Venki</tag> </tags> <strict>true</strict> <parallelScheme>SCENARIO</parallelScheme> <!-- <customVmTemplate>src/test/resources/runnertemplate/runner.vm</customVmTemplate>--> </configuration> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-surefire-plugin</artifactId> <version>3.0.0-M5</version> <configuration> <skip>true</skip> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-failsafe-plugin</artifactId> <version>3.0.0-M5</version> <configuration> <forkCount>1</forkCount> <reuseForks>true</reuseForks> <includes> <include>**/*IT.class</include> </includes> </configuration> <executions> <execution> <goals> <goal>integration-test</goal> <goal>verify</goal> </goals> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.8.1</version> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupId>net.serenity-bdd.maven.plugins</groupId> <artifactId>serenity-maven-plugin</artifactId> <version>${serenity.maven.version}</version> <configuration> <tags>${tags}</tags> </configuration> <dependencies> <dependency> <groupId>net.serenity-bdd</groupId> <artifactId>serenity-core</artifactId> <version>${serenity.version}</version> </dependency> </dependencies> <executions> <execution> <id>serenity-reports</id> <phase>post-integration-test</phase> <goals> <goal>aggregate</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project>
Plan vs Executed & Execution Analysis gadget does not filter out the status which is not selected
As a User when I configure the Gadget Plan vs Executed and Execution analysis with only few status it is considering all status and showing them in others I would like to see only what status is filtered inDashboard gadget for Cross project reporting for Test Automation
Currently there is no way easily report on an entire project, most gadgets are release based. It would be helpful to be able to make these dashboard gadgets report data for the entire project, to be able to compare automation efforts across entire projects - Test Automation Status - Test Automation Distribution
Support filtering gadgets by custom fields
Currently, there's no capability to filter gadgets by specific custom fields. As a user, I need the ability to filter by custom fields to comply with my company's use of custom fields across all projects. Specifically, this would be important for the "Test Execution by Cycle" and "Test Execution Snapshot" gadgets. OLD ID:- ZENT-I-250
