Forum Discussion

Slavek's avatar
Slavek
New Contributor
12 years ago

maven-soapui-pro-plugin duplicate results in jenkins

Hi, I have problem that when I use maven-soapui-pro-plugin and run my test there are in last results duplicated results see attached picture. Is it bug, or can anybody help me with this dupicity?



POM file with maven-soapui-plugin:
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <groupId>automated-tests</groupId>
  <artifactId>jenkins-smoke-test</artifactId>
  <version>4.0.2-SNAPSHOT</version>
  <packaging>pom</packaging>
  <name>jenkins-smoke-test</name>
  <build>
    <plugins>
      <plugin>
        <groupId>eviware</groupId>
        <artifactId>maven-soapui-plugin</artifactId>
        <version>4.5.1</version>
        <configuration>
          <projectFile>${basedir}/jenkins-test-soapui-project.xml</projectFile>
          <testSuite>jenkins1</testSuite>
          <outputFolder>${basedir}/target/surefire-reports</outputFolder>
          <junitReport>true</junitReport>
          <exportwAll>false</exportwAll>
          <printReport>false</printReport>
          <testFailIgnore>false</testFailIgnore>
        </configuration>
        <executions>
          <execution>
            <phase>process-test-classes</phase>
            <goals>
              <goal>test</goal>
            </goals>
          </execution>
        </executions>
      </plugin>
    </plugins>
  </build>
  <pluginRepositories>
    <pluginRepository>
      <id>eviwarePluginRepository</id>
      <url>http://www.eviware.com/repository/maven2/</url>
    </pluginRepository>
  </pluginRepositories>
</project>




POM file with maven-soapui-pro-plugin:
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <groupId>automated-tests</groupId>
  <artifactId>jenkins-smoke-test</artifactId>
  <version>4.0.2-SNAPSHOT</version>
  <packaging>pom</packaging>
  <name>jenkins-smoke-test</name>
  <build>
    <plugins>
      <plugin>
        <groupId>eviware</groupId>
        <artifactId>maven-soapui-pro-plugin</artifactId>
        <version>4.5.1</version>
        <configuration>
          <projectFile>${basedir}/jenkins-test-soapui-project.xml</projectFile>
          <testSuite>jenkins1</testSuite>
          <outputFolder>${basedir}/target/surefire-reports</outputFolder>
          <junitReport>true</junitReport>
          <exportwAll>false</exportwAll>
          <printReport>false</printReport>
          <testFailIgnore>false</testFailIgnore>
        </configuration>
        <executions>
          <execution>
            <phase>process-test-classes</phase>
            <goals>
              <goal>test</goal>
            </goals>
          </execution>
        </executions>
      </plugin>
    </plugins>
  </build>
  <pluginRepositories>
    <pluginRepository>
      <id>eviwarePluginRepository</id>
      <url>http://www.eviware.com/repository/maven2/</url>
    </pluginRepository>
  </pluginRepositories>
</project>


  • Slavek's avatar
    Slavek
    New Contributor
    12 years ago
    Hi,
    Jenkins version: Jenkins 1.466.2

    Output folder:


    I've seen you use the "testSuite" parameter? Do you have the same issue without using it?
    Yes same issue without this parameter


    You have a typo in a parameter you use: "exportwAll" whereas you should use "exportAll"
    I don't think it impacts the test run (as exportAll is set to false by default)
    Thanks I update this parameter but no change in report...
  • redfish4ktc2's avatar
    redfish4ktc2
    Super Contributor
    12 years ago
    ok, I'm back (my account has been deleted >:( )

    To summarize what I previously posted
    * you see tests twice in Jenkins because with the pro plugin an junit html report is also generated and before generating the html report, soapui generates an additional xml files (report.xml) that contains tests result (see viewtopic.php?f=2&t=3703&p=13801&hilit=report+junit+html#p13801)
    * as a workaround, you can rename/move the file after running soapui tests to avoid jenkins considering it as a regular junit result file
    * i'm going to add a feature in maven-soapui-extension-plugin that will let us disable html report generation when running the pro plugin (see https://github.com/redfish4ktc/maven-so ... /issues/45)
  • AlexRa's avatar
    AlexRa
    New Contributor
    12 years ago
    I am currently facing the same problems with the maven-soapui-pro-plugin.
    Unfortunately I couldn't manage the deletion of the test results before they get analyzed by Jenkins. It seems like Jenkins is analyzing it directly after the creation by the soap ui maven plugin:


    SoapUI 4.5.1-SNAPSHOT TestCaseRunner Summary
    -----------------------------
    Time Taken: 27572ms
    Total TestSuites: 3
    Total TestCases: 16 (1 failed)
    Total TestSteps: 178
    Total Request Assertions: 52
    Total Failed Assertions: 2
    Total Exported Results: 178

    00:32:58,119 INFO  [SoapUIProTestCaseRunner] Created report at file:/D:/tmp/jenkins/workspace/BackendIntegrationTest/target/soap-ui-reports/SecurityRestService1/index.html
    [JENKINS] Zeichne Testergebnisse auf
    [INFO] 
    [INFO] --- maven-soapui-pro-plugin:4.5.1:test (SecurityRestService2) @ BackendIntegrationTest ---
    soapUI Pro 4.5.1 Maven2 TestCase Runner

    ...


    Does anyone know how to configure the Jenkins test result analyzation?

    @redfish4ktc2: When will you create the next release of your maven plugin extension? Unfortunately your SNAPSHOP repository is empty...
  • redfish4ktc2's avatar
    redfish4ktc2
    Super Contributor
    12 years ago
    AlexRa
    My bad, i forgot to deploy a snapshot, I'll try to do it this week end and will ping you back when it is done
    I plan to release 4.5.1.4 next week
  • redfish4ktc2's avatar
    redfish4ktc2
    Super Contributor
    12 years ago
    AlexRa I've just deployed a new snapshot of maven-soapui-extension-plugin, built from commit 61ddb5994351c8939d0e9cb1c9eb88fc9b1269a6
    Tell me if it is ok for you
  • redfish4ktc2's avatar
    redfish4ktc2
    Super Contributor
    12 years ago
    AlexRa
    Nice if it works, I will ping you here when the release will be on central.

    Last: if you want to use a maven project in Jenkins, you have to configure the plugin with the following (jenkins will process the xml junit result files)
    <outputFolder>${basedir}/target/surefire-reports</outputFolder>
  • Dino's avatar
    Dino
    New Contributor
    8 years ago

    Hi there,

     

    Still having this issue with ready-api-maven-plugin.

    Not sure i did understand the use of <junitHtmlReport>true</junitHtmlReport> or false.

     

    I'm looking for a parameter to say " I don't want report.xml to be generated"

     

    Thanks