xUnit report to hudson

804 views
Skip to first unread message

Taisto Tammi

unread,
Jun 14, 2011, 3:55:32 AM6/14/11
to robotframework-users
Ugh

I did try to configure the Jenkins to display test run results by
using xUnit plugin. But I always get this error:
[xUnit] [INFO] - [UnitTest-1.4 (default)] - 1 test report file(s) were
found with the pattern 'target/robotframework/report.xml' relative to
'/xx/yy/hudson-home/jobs/Hydrostatic/workspace' for the testing
framework 'UnitTest-1.4 (default)'.
[xUnit] [ERROR] - The plugin hasn't been performed correctly: None of
the test reports contained any result

When I open the report.xml file, I can see lot of test cases and
results. Also I have configure the xUnit Logger to the Jenkins.

Has anyone else configured the xUnit plugin for Jenkins successfully
and perhaps would know solution to this problem?

Selber, Heiko (NSN - DE/Berlin)

unread,
Jun 14, 2011, 11:06:34 AM6/14/11
to god...@gmail.com, robotframework-users
Why don't you use the robotframework plugin?

https://wiki.jenkins-ci.org/display/JENKINS/Robot+Framework+Plugin

I don't think that the xUnit plugin supports robotframework reports. At
least it's not on the list of supported frameworks:

https://wiki.jenkins-ci.org/display/JENKINS/xUnit+Plugin

Heiko

Ugh

--
You received this message because you are subscribed to the Google
Groups "robotframework-users" group.
To post to this group, send email to
robotframe...@googlegroups.com.
To unsubscribe from this group, send email to
robotframework-u...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/robotframework-users?hl=en.

Taisto Tammi

unread,
Jun 14, 2011, 12:21:38 PM6/14/11
to Selber, Heiko (NSN - DE/Berlin), robotframework-users

Ugh

Well, actually I am using Robot plunging. Perhaps I did ask a wrong question. My jobs in Jennings are small modules of the product  that I am testing (SUT). And in the end I have lot of jobs in the Jenkins.

How could I make an report, to visualize the testing status of the product. I did hope that xUnit would resolve my problem to combine the Robot output to a single report. I did try Robot historical reporting tool (2) but it did not resolve my problem. 

In the Robot user guide (1), it says that xUnit is kind a supported. But does not say how it is done.

(1) http://robotframework.googlecode.com/hg/doc/userguide/RobotFrameworkUserGuide.html?r=2.5.7#xunit-compatible-result-file
(2) http://robotframework.googlecode.com/hg/doc/userguide/RobotFrameworkUserGuide.html?r=2.5.7#historical-reporting-tool

-Tatu

On Jun 14, 2011 6:06 PM, "Selber, Heiko (NSN - DE/Berlin)" <heiko....@nsn.com> wrote:

Pekka Klärck

unread,
Jun 14, 2011, 5:17:20 PM6/14/11
to god...@gmail.com, Selber, Heiko (NSN - DE/Berlin), robotframework-users
2011/6/14 Taisto Tammi <god...@gmail.com>:

>
> Well, actually I am using Robot plunging. Perhaps I did ask a wrong
> question. My jobs in Jennings are small modules of the product  that I am
> testing (SUT). And in the end I have lot of jobs in the Jenkins.
>
> How could I make an report, to visualize the testing status of the product.
> I did hope that xUnit would resolve my problem to combine the Robot output
> to a single report. I did try Robot historical reporting tool (2) but it did
> not resolve my problem.

If you want a single report, you can use `rebot` tool that is
installed with Robot automatically:
http://robotframework.googlecode.com/hg/doc/userguide/RobotFrameworkUserGuide.html?r=2.5.7#post-processing-outputs

You get the xunit output with --xunitfile option e.g. like `pybot
--xunitfile xunit.xml my_tests.txt`.

Cheers,
.peke
--
Agile Tester/Developer/Consultant :: http://eliga.fi
Lead Developer of Robot Framework :: http://robotframework.org

Taisto Tammi

unread,
Jun 15, 2011, 4:03:06 AM6/15/11
to Pekka Klärck, Selber, Heiko (NSN - DE/Berlin), robotframework-users
Ugh

If I select the test tags correctly, the rebot will solve my problem. I
did not see the rebot tool, thx for help.

I have the report.xml output file in the folder and based on the Jenkins
console output is seems to find the report.xml file:

1 test report file(s) were found

But based on the console output some sort of error seems to happen:

[xUnit] [ERROR] - The plugin hasn't been performed correctly: None of
the test reports contained any result

I was just wondering, have any of you used this pluging to report the
combined test results. If you did what configuration options did use...
Or is this a question to the XUnit plugin developer?

-Tatu

Pekka Klärck

unread,
Jun 15, 2011, 9:17:01 AM6/15/11
to Taisto Tammi, Selber, Heiko (NSN - DE/Berlin), robotframework-users
2011/6/15 Taisto Tammi <god...@gmail.com>:

>
> But based on the console output some sort of error seems to happen:
>
> [xUnit] [ERROR] - The plugin hasn't been performed correctly: None of
> the test reports contained any result
>
> I was just wondering, have any of you used this pluging to report the
> combined test results. If you did what configuration options did use... Or
> is this a question to the XUnit plugin developer?

I have tested that Hudson's XUnit plugin works with outputs you get
from Robot with --xunitfile option. Are you sure you do use this
option? XUnit plugin doesn't understand Robot's normal output file.

Taisto Tammi

unread,
Jun 16, 2011, 3:51:33 AM6/16/11
to Pekka Klärck, Selber, Heiko (NSN - DE/Berlin), robotframework-users
Ugh

Yes, I have configured the xUnit plugin to read the report.xml output file. Which contains line like these:
<testcase classname="Tests.Valid displacement callculation when empty mass is used" time="2" name="When mass.empty and mass@tank are send then valid displacement is received">
</testcase>


But to get the xUnit plugin working, one has to configure the Job in the Jenkins and enable: Publish testing tools result report

Then press Add and select from a list which type of xUnit report (AUnit, BoosTest and so on) is used by the plugin. Because Robot is not in the list perhaps my selection of the xUnit report type is wrong? What type of the report one should use?

The Custom Tool requires also a Custom Stylesheet to work, so that did not work. At least I do not have stylesheet for Robot xUnit report.

-Tatu
Reply all
Reply to author
Forward
0 new messages