Problem generating project report via testrunner in Jenkins

[ecsmmek]

Hi,

I'm trying to generate a project report via testrunner in a shell script in Jenkins but somehow it doesn't seem to create the actual report in the target folder.

It is a "normal" soapUI project, i.e not a composite project that is run.

The odd part is that it does generate both "Data Export" and "JUnit-Style HTML Report" reports.

This is the row generating the different types of reports. The two first examples below are working

bin/testrunner.sh -R"JUnit-Style HTML Report" -f$SOAPUI_HOME/logs_$USER/$test \

bin/testrunner.sh -R"Data Export" -FMXL -f$SOAPUI_HOME/logs_$USER/$test \

However, the below example trying to generate a project report does not create any report

bin/testrunner.sh -R"Project Report" -FXML -f$SOAPUI_HOME/logs_$USER/$test \

The path to the report folder is the same. It's only the type of report that differs.

Tried a few different approaches with different arguments (flags) without any luck. 

Tried to shift the " characters, e.g. "-RProject Report" in order to mimic the "original" testrunner command line generated i ReadyAPI.

Tried to add .xml to the target folder, i.e. -f$SOAPUI_HOME/logs_$USER/$test.xml but that didn't work either

Any ideas?

I'm using ReadyAPI 2.6.0 locally and version 2.5.0 is installed on the Jenkins server.

Best regards

Mathias

[TanyaYatskovska]

@community, any ideas

@nmrao, @msiadak, @avidCoder ?

[msiadak]

I haven't attempted a project level report yet, but I can give that a shot today. I've been working with Jenkins and reports so I'll see what I can figure out and will report back. 🙂 

[nmrao]

@ecsmmek 

Couple of things:

1. Is this problem happening for the first time?

2. Is this specific to this project?

3. Were you able to get the required report out side the jenkins? i.e., pure commandline execution.

Just to isolate the nature of the issue.

[ecsmmek]

@nmrao 

Hi, see answers below.

1) We have previously been able to generate JUnit reports with a similar command (as described above) on Jenkins

2) Not isolated to this particular project. We have several projects executing via testrunner and none of them generate project reports

3) I've managed to generate the desired report locally on my windows machine running testrunner

Today we're upgrading from ReadyAPI 2.5.0 to ReadyAPI 2.6.0 on the Jenkins server. I'll run some additional tests after this is done.

[ecsmmek]

@msiadak 

Hello,

Any luck from your side?

Best regards

Mathias

[nmrao]

Thanks.

If the reports are generated from command line testrunner, then there is no reason jenkins can't generate the report provided the same command is run from the build step.

[ecsmmek]

Hi,

We just upgraded to version 2.6.0 on our Jenkins machine and unfortunately the problem still remains.

It is practically the same executing command used for all three types of reports:

This command does not generate a project report from within a Jenkins unix machine

bin/testrunner.sh -R"Project Report" -FXML -f $SOAPUI_HOME/logs_$USER/$test

But below commands generate JUnit resp Data Export reports. The only thing that differs between them is the type of report

bin/testrunner.sh -R"Junit-style HTML Report" -FXML -f $SOAPUI_HOME/logs_$USER/$test

bin/testrunner.sh -R"Data Export" -FXML -f $SOAPUI_HOME/logs_$USER/$test

Am I missing some argument needed to generate project reports or is it simply not possible to generate them on unix machines running Jenkins?

Best regards

Mathias

[nmrao]

Is license copied to the unix machine where jenkins is used?

You mentioned the command. But, what type of report you were trying to generate and it fails? Junit or PDF?

[ecsmmek]

Hi,

Yes, we're using floating licenses on the Unix machine.

We're trying to generate a Project Report in XML format. -R"Project Report" -FXML

Also tried Project Report in PDF format but that didn't work either.

Best Regards

Mathias