[JIRA] (JENKINS-38442) View sequential stages in the pipeline visualization graph

177 views
Skip to first unread message

domagoj.smoljanovic@oradian.com (JIRA)

unread,
Aug 1, 2018, 5:05:05 AM8/1/18
to jenkinsc...@googlegroups.com
Domagoj Smoljanovic commented on Story JENKINS-38442
 
Re: View sequential stages in the pipeline visualization graph

I see that the above PR is merged but issue is still in progress. Is this still being worked on?

When done will it support nested parallels (parallel in parallel)? As shown on pipeline_mockup.png ? Because with version 1.3.1 it still doesn't do that.

 

Thanx
Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v7.10.1#710002-sha1:6efc396)

jmcdonald@cloudbees.com (JIRA)

unread,
Aug 1, 2018, 5:15:05 AM8/1/18
to jenkinsc...@googlegroups.com

AFAIK there's no plan to support nested parallels at the moment.

daniel.kurzynski@sap.com (JIRA)

unread,
Aug 1, 2018, 5:22:04 AM8/1/18
to jenkinsc...@googlegroups.com

We really need that feature. Currently, we have two levels of parallelization and the visualization in BlueOcean is totally broken. Really, looking forward to supporting at least two level of parallelization (parallel within parallel).

mathias.hasselmann@meiller.com (JIRA)

unread,
Aug 1, 2018, 6:25:05 AM8/1/18
to jenkinsc...@googlegroups.com

I might be mistake as I don't have numbers, but the parallel pipeline described in https://jenkins.io/blog/2018/07/02/whats-new-declarative-piepline-13x-sequential-stages/ seems a pretty common use-case for pipelines. It might be the most natural and most common pipeline even. Therefore at least this kind of pipeline should get appropiate visualiation, IMHO.

gertvdijk+jenkins@gmail.com (JIRA)

unread,
Aug 14, 2018, 4:28:29 AM8/14/18
to jenkinsc...@googlegroups.com
Gert van Dijk updated an issue
 
Jenkins / Story JENKINS-38442
Change By: Gert van Dijk
Attachment: jenkins-weird-masked2.png

gertvdijk+jenkins@gmail.com (JIRA)

unread,
Aug 14, 2018, 4:34:05 AM8/14/18
to jenkinsc...@googlegroups.com
Gert van Dijk commented on Story JENKINS-38442
 
Re: View sequential stages in the pipeline visualization graph

First of all, I really like nested sequential stages, because I use a build tool already running things in maximum parallel (bazel), I don't want to run things with parallel stages which will be blocking on the Bazel server anyway.

However, I noticed a very annoying visualization issue when a sub-stage has FAILED (due to a failed step): the parent stage is marked SUCCESS. I would assume the failed state would propagate up to its parent.

It not only hides the error in the graph and makes it's hard to spot where in the pipeline the error occurred, it also hides the existence of the sub-stage. In the screenshot below, the "Code Style" stage has multiple sub-stages, that got somehow merged with its parent in this view, but the steps shown are part of one of the sub-stages.

Sub-stages are shown during the run, though.

As this Jira issue is still in-progress, I didn't want to open a new one. And I couldn't find any other issue reporting similar issues.
(Seeing this on 1.7.2 / Core 2.121.2)

gertvdijk+jenkins@gmail.com (JIRA)

unread,
Aug 17, 2018, 5:07:05 AM8/17/18
to jenkinsc...@googlegroups.com
Gert van Dijk edited a comment on Story JENKINS-38442
First of all, I really like nested sequential stages, because I use a build tool already running things in maximum parallel (bazel), I don't want to run things with parallel stages which will be blocking on the Bazel server anyway.

However, I noticed a very annoying visualization issue when a sub-stage has FAILED (due to a failed step): the parent stage is marked SUCCESS. I would assume the failed state would propagate up to its parent.

It not only hides the error in the graph and makes it's hard to spot where in the pipeline the error occurred, +it also hides the existence of the sub-stage+. In the screenshot below, the "Code Style" stage has multiple sub-stages, that got somehow merged with its parent in this view, but the steps shown are part of one of the sub-stages.
!jenkins-weird-masked2.png|width=254,height=249!

Sub-stages are shown _during the run_, though.


As this Jira issue is still in-progress, I didn't want to open a new one. And I couldn't find any other issue reporting similar issues.
(Seeing this on 1.7.2 / Core 2.121.2)


Update: in 1.8.2 I now see all stages, but all flattened, as if there is no nesting in stages. It has improved the situation a lot to spot the errors, though, but it's far from ideal.

dnusbaum@cloudbees.com (JIRA)

unread,
Aug 17, 2018, 3:14:10 PM8/17/18
to jenkinsc...@googlegroups.com
Devin Nusbaum closed an issue as Duplicate
 

Blue Ocean 1.8.x adds support for visualizing sequential stages, so I am closing this as a dupe of JENKINS-49050.
Change By: Devin Nusbaum
Status: In Progress Closed
Resolution: Duplicate

dnusbaum@cloudbees.com (JIRA)

unread,
Aug 17, 2018, 3:15:06 PM8/17/18
to jenkinsc...@googlegroups.com
Devin Nusbaum updated an issue
Change By: Devin Nusbaum
Released As: Blue Ocean 1.8.0

dnusbaum@cloudbees.com (JIRA)

unread,
Aug 17, 2018, 3:21:30 PM8/17/18
to jenkinsc...@googlegroups.com
Devin Nusbaum edited a comment on Story JENKINS-38442
 
Re: View sequential stages in the pipeline visualization graph
[Blue Ocean 1.8.x|https://plugins.jenkins.io/blueocean] adds support for visualizing sequential stages, so I am closing this as a dupe of JENKINS-49050 (although note that I believe that issue is specific to declarative pipeline) .

joerg.schwaerzler@infineon.com (JIRA)

unread,
Aug 18, 2018, 1:38:30 AM8/18/18
to jenkinsc...@googlegroups.com

Devin Nusbaum So for nested stages in scripted pipelines, do we need to open another feature request - or is there already something in place?

dnusbaum@cloudbees.com (JIRA)

unread,
Aug 20, 2018, 9:13:05 AM8/20/18
to jenkinsc...@googlegroups.com

Joerg Schwaerzler I don't think there are any open feature requests specific to nested stages in scripted pipelines. We could reopen this issue and modify the title to be a little more specific, or we could open a new issue (probably better to have a more focused issue, assuming some of the people here are satisfied with the nested stage support for declarative in blue ocean 1.8), but I think either would be fine.

daniel.kurzynski@sap.com (JIRA)

unread,
Aug 20, 2018, 9:21:08 AM8/20/18
to jenkinsc...@googlegroups.com

I think originally, this ticketed was also about having parallel blocks within parallel blocks. So at least to level of parallelization. 
Although the declarative syntax does not support it, you can have scripted parallel blocks within a parallel block in a declarative pipeline. The result is not visualized properly.

 

 

daniel.kurzynski@sap.com (JIRA)

unread,
Aug 20, 2018, 9:21:32 AM8/20/18
to jenkinsc...@googlegroups.com
Daniel Kurzynski edited a comment on Story JENKINS-38442
I think originally, this ticketed was also about having parallel blocks within parallel blocks. So at least to two level of parallelization. 

Although the declarative syntax does not support it, you can have scripted parallel blocks within a parallel block in a declarative pipeline. The result is not visualized properly.

dnusbaum@cloudbees.com (JIRA)

unread,
Aug 20, 2018, 9:25:05 AM8/20/18
to jenkinsc...@googlegroups.com

Daniel Kurzynski Yes, this issue has multiple feature requests in the comments, so it seems to me like it would make more sense to open individual issues so each request can be discussed separately, but we could also just reopen this issue.

joerg.schwaerzler@infineon.com (JIRA)

unread,
Aug 21, 2018, 8:29:05 AM8/21/18
to jenkinsc...@googlegroups.com

Devin Nusbaum: Hmm, looking at the examples above think this issue was originally targeted to scripted Pipeline. However as I like the idea of having smaller feature requests which are easier to implement on its own. Therefore I will create a new feature request hoping it'll not be merged with similar feature requests.

joerg.schwaerzler@infineon.com (JIRA)

unread,
Aug 21, 2018, 8:42:04 AM8/21/18
to jenkinsc...@googlegroups.com

For those interested: I raised a new fr here: JENKINS-53162

phil.segal@gmail.com (JIRA)

unread,
Oct 10, 2018, 5:36:08 AM10/10/18
to jenkinsc...@googlegroups.com

Josh McDonald is there still no plans to support nested parallels? we have built a nested parallel scripted pipeline, and the blue ocean view seems to change between various representations. More worryingly, if a task fails it shows as GREEN  . Something like pipeline_mockups.png from above would be amazing

 
This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

daniel.kurzynski@sap.com (JIRA)

unread,
Oct 11, 2018, 4:53:32 AM10/11/18
to jenkinsc...@googlegroups.com

Devin Nusbaum As suggested, I have created an issue for two level of parallelization: https://issues.jenkins-ci.org/browse/JENKINS-54010

feirenliu@gmail.com (JIRA)

unread,
Dec 17, 2018, 4:00:09 PM12/17/18
to jenkinsc...@googlegroups.com
zengqiao liu updated an issue
 
Change By: zengqiao liu
{panel}
In progress - one level of visualization below parent stage. Additional research and feedback will help us determine future visualizations.
{panel}
I've tried using nested stages in order to group each shell script alone to have a meaningful data, however this broken the UI of blueocean and it stopped it from showing showing the variant steps.

*Example 1*
{code:java}
def test = [:]

test["a"] = {
    stage ("a") {
        stage ("ab") {
            sh "echo stage abc"
        }
        stage ("xyz") {
            sh "echo stage xyz"
        }
    }
}

test["b"] = {
    stage ("b") {
        stage ("bb") {
            sh "echo stage bb"
        }
        stage ("bxz") {
            sh "echo stagebxyz"
        }
    }
}
node {
   //stage 'start'
   parallel test
   stage ('middle') {
       sh "echo middle"
   }
   
}
{code}
*Example 2*
{code:java}
node() {
  stage('Build') {
    println 'I prepare the build for the parallel steps'
  }

  stage('Test') {
   parallel (
"win7-vs2012" : { stage("checkout") { }; stage("build") { }; stage("test") { } },
"win10-vs2015" : { stage("checkout") { }; stage("build") { }; stage("test") { }},
"linux-gcc5" : { stage("checkout") { }; stage("build") { }; stage("test") { } }
)
  }
}
{code}

ahmed@sghaier.com (JIRA)

unread,
Jan 11, 2019, 8:03:06 AM1/11/19
to jenkinsc...@googlegroups.com
Reply all
Reply to author
Forward
0 new messages