[Blue Ocean] Test reporting UI

[James Dumay]

Hi all,

I just wanted to share some very early mockups of what the test reporting interface could look like in Blue Ocean. I believe it would be great if we had a standard interface for all test report types but plugin developers would be free to add their own custom UI via extension points. 

Very keen to get your feedback and particularly from those involved in test reporting plugins.

https://invis.io/6M7GY7Q8T 

https://invis.io/6H7GY6EQF 

Thanks,

James

[Robert Collins]

One thing that stands out - or rather, I couldn't see it - was the
job? As a data point, in OpenStack we run the same test in many
contexts. so without knowing the job, just seeing that TestX failed is
somewhat context free.

Being able to group and mine to see what jobs TestX failed in would be cool to.

e.g.
TestX [JobA, JobB]

as one view, and

JobA
+ TestX
...
JobB
+ TestX

as another.

-Rob

[James Dumay]

Nice to see you, Rob :)

Thats a great use case. You only see a single one of these screens per FreeStyle job however if you are using Jenkins Pipeline we could group it by parallel node. How do you stitch together your pipeline?

[Robert Collins]

On 31 May 2016 at 08:39, James Dumay <jdu...@cloudbees.com> wrote:
> Nice to see you, Rob :)

Likewise :)

> Thats a great use case. You only see a single one of these screens per FreeStyle job however if you are using Jenkins Pipeline we could group it by parallel node. How do you stitch together your pipeline?

Its a fairly massive Jenkins Job Builder setup.
http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs

-Rob

[Tom Fennelly]

On Tuesday, May 31, 2016 at 2:13:29 AM UTC+1, Robert Collins wrote:

Its a fairly massive Jenkins Job Builder setup.
http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs

Hey Rob.

And how does the test reporting appear for this?

[James Dumay]

Individual freestyle jobs will show up as different jobs in Blue Ocean with their own test tab on the result and there are no plans to aggregate multiple freestyle jobs as Pipelines.

Have you investigated using Pipeline?

[Robert Collins]

On 1 June 2016 at 13:23, James Dumay <jdu...@cloudbees.com> wrote:
> Individual freestyle jobs will show up as different jobs in Blue Ocean with
> their own test tab on the result and there are no plans to aggregate
> multiple freestyle jobs as Pipelines.
>
> Have you investigated using Pipeline?

I don't know :) - OpenStack's infra team encountered scaling issues
with Jenkins which led to deploying a cluster of Jenkins in a
federated setup, and most/all of the reporting is done through adding
comments to the code review in Gerrit, since Jenkins is treated as a
helper service essentially - many of the OpenStack contributors would
never even look at Jenkin's UI.

-Rob

[James Dumay]

Gotcha. You're not the first to mention a Gerrit centric workflow. Are you using any Gerrit plugins for Jenkins?

[Robert Collins]

On 1 June 2016 at 13:32, James Dumay <jdu...@cloudbees.com> wrote:
> Gotcha. You're not the first to mention a Gerrit centric workflow. Are you
> using any Gerrit plugins for Jenkins?

I believe the handoff to Gerrit is done entirely via Zuul events.

-Rob

[Robert Sandell]

Cool, are there any thoughts on showing "trend" graphs somewhere?

/B

--
You received this message because you are subscribed to the Google Groups "Jenkins Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/a578bed7-580f-43f5-84af-c87100aa06f9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Robert Sandell

Software Engineer

CloudBees Inc.