Display of job results

[christop...@googlemail.com]

Hi,

I am building and testing a C/C++ application on Windows with jenkins using declarative pipeline and a bit of scripts in a library.

I am using these tools:

cppcheck

googletest

robotframework

ranorex

I am using warnings-ng for the compiler warnings, taskscanner and cppcheck and I am pretty happy with the output and results display of these part.

I am using the robotframework plugin for the robotfamework output. Well, it's a little different with a different style but all-in-all a good display with everything you need: everything in one place, good integration with all information provided by robotframework.

My worst problem results from the unittests and ranorex as I only found the xunit plugin to read the input.

First issue:

the xunit test results are located far away from all the other outputs at the very bottom of the job display. Even below the job list.

Second issue: I'd like to separate results of Unit-Tests and acceptance tests but did not find a way (yet?). xUnit is mixing all tests in one big list. When I step into a test, I only have the name of the step that executed the test.

Third issue: for Ranorex I'd like to have the pdf report as part of the test result as well. At the moment it's far away in the artifacts without any direct link (or embedded like with robotframework).

Any recommendations how I can improve that situation? Is there a way to realize some of these ideas:

- customize position of a plugin output in the job view

 - split display of xunit test results per tool?

 

What about the ranorex plugin itself? I do have a number of ranorex test executables and these are called by a script from the build system. I do not want to replicate a list in jenkins scripts. That's why I don't like to use the ranorex plugin here.

Thanks for reading up to here and many thanks in advance for any advice!

Regards,

Christoph

[Ullrich Hafner]

Am 01.02.2022 um 22:27 schrieb 'christop...@googlemail.com' via Jenkins Users <jenkins...@googlegroups.com>:

[...]

Any recommendations how I can improve that situation? Is there a way to realize some of these ideas:

- customize position of a plugin output in the job view

This is one of the major drawbacks of Jenkins UI in the moment and there is no workaround available yet. We started a new plugin that tries to solve this problem with https://muuri.dev on a new page but this promising approach still needs to be implemented for the old views.

 

 - split display of xunit test results per tool?

This is also not possible right now. I am using this approach in the warnings plugin and plan to make this concept available for coverage data as well. But for unit tests this is not planned yet. I’m also not sure if that information actually is so helpful: if a test fails then I am not really not that interested in which suite it failed.  

 

What about the ranorex plugin itself? I do have a number of ranorex test executables and these are called by a script from the build system. I do not want to replicate a list in jenkins scripts. That's why I don't like to use the ranorex plugin here.

Thanks for reading up to here and many thanks in advance for any advice!

Regards,

Christoph

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/5c0dc622-e9c0-498b-9d8d-8bac93caace6n%40googlegroups.com.

[christop...@googlemail.com]

Thank you very much for the reply.

I'd totally agree when we'd talk about unit test results alone. However Ranorex is a GUI-test tool used for integration or acceptance tests that only outputs its results in junit file format.

OK, I'll live with it for the moment.