[JIRA] (JENKINS-39975) Possibility to specify number of executors a node step will consume

robin.bjorklin@gmail.com (JIRA)

unread,

Nov 23, 2016, 9:50:01 AM11/23/16

to jenkinsc...@googlegroups.com

Robin Björklin created an issue

Jenkins /

JENKINS-39975

Possibility to specify number of executors a node step will consume

Issue Type:	New Feature
Assignee:	Unassigned
Components:	workflow-durable-task-step-plugin
Created:	2016/Nov/23 2:49 PM
Priority:	Major
Reporter:	Robin Björklin

Possibility to specify number of executors a node step will consume. The syntax below is probably not correct but I hope it will get the general idea across.

                                                                    Unable to find source-code formatter for language: groovy. Available languages are: actionscript, html, java, javascript, none, sql, xhtml, xml
                                                                
// List of tuples with (taskName, executorCount)
def heavyTasks = [('task1', 2), ('task2', 3), ('task3', 8)]
def tasks = [:]
for (x in heavyTasks) {
    def task = x
    tasks[task] = {
        node executors: task[1] {
            sh 'heavyThreadedTaskGoesHere'
            }
    }
}
stage("RunTasks") {
    parallel tasks
}

Add Comment

This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c)

robin.bjorklin@gmail.com (JIRA)

unread,

Nov 23, 2016, 9:51:01 AM11/23/16

to jenkinsc...@googlegroups.com

Robin Björklin updated an issue

Jenkins /

JENKINS-39975

Possibility to specify number of executors a node step will consume

Change By:	Robin Björklin

Possibility to specify number of executors a node step will consume. The syntax below is probably not correct but I hope it will get the general idea across.

{code: groovy java }

// List of tuples with (taskName, executorCount)
def heavyTasks = [('task1', 2), ('task2', 3), ('task3', 8)]
def tasks = [:]
for (x in heavyTasks) {
    def task = x
    tasks[task] = {
        node executors: task[1] {
            sh 'heavyThreadedTaskGoesHere'
            }
    }
}
stage("RunTasks") {
    parallel tasks
}

{code}

Add Comment

robin.bjorklin@gmail.com (JIRA)

unread,

Nov 24, 2016, 6:41:01 AM11/24/16

to jenkinsc...@googlegroups.com

Robin Björklin updated an issue

Jenkins /

JENKINS-39975

Possibility to specify number of executors a node step will consume

Change By:	Robin Björklin

Possibility to specify number of executors a node step will consume. The syntax below is probably not correct but I hope it will get the general idea across.

{code:java}

// List of tuples with (taskName, executorCount)
def heavyTasks = [('task1', 2), ('task2', 3), ('task3', 8)]
def tasks = [:]
for (x in heavyTasks) {
    def task = x
    tasks[task] = {
        node executors: task[1] {
            sh 'heavyThreadedTaskGoesHere'
            }
    }
}
stage("RunTasks") {
    parallel tasks
}
{code}

EDIT: There is a plugin that tries to do this but there is no pipeline support. https://wiki.jenkins-ci.org/display/JENKINS/Heavy+Job+Plugin

Add Comment

jglick@cloudbees.com (JIRA)

unread,

Dec 29, 2016, 3:02:01 PM12/29/16

to jenkinsc...@googlegroups.com

Jesse Glick updated an issue

Jenkins /

JENKINS-39975

Possibility to specify number of executors a node step will consume

 
                                                                node {
  node(NODE_NAME) {
    // …
  }
}
 
                                                            

would do the trick for n=2, though this is probably deadlock-prone—not sure how the plugin handles that.