Jenkins slowdown when there are many jobs in the queue

26 views
Skip to first unread message

snaftaly

unread,
Sep 9, 2015, 4:03:00 AM9/9/15
to Jenkins Users
Hi,

I have a jenkins build flow job, which creates ~200 downstream jobs and runs them in parallel.
The downstream jobs are all different builds of the same job, with different parameters.
I use the throttle concurrent builds option on the downstream job, to limit the number of builds that run in parallel.
The problem is that the queue in jenkins gets large, and makes jenkins very slow.

I saw there are two open bugs about this issue:
https://issues.jenkins-ci.org/browse/JENKINS-20046
https://issues.jenkins-ci.org/browse/JENKINS-27650

My temporary solution was to send the jobs from the build flow job in small, constant sized groups, using a loop in
which I run the the small group of builds in parallel.

I was wondering if there is a better solution for this problem, like plugins that control the amount of triggered
builds.

Any suggestion will be appreciated,
Thanks,
Sharon
Reply all
Reply to author
Forward
0 new messages