How many jobs can handle by Jenkins master?

[dennys]

We use 1 Jenkins and 30 Jenkins slaves.
(Jenkins master doesn't build code, only slaves build code.)
But when there are about 18 build jobs at the same time, Jenkins will hang
for a while.

Jenkins master has 16 cores and the CPU loading is about 50% when the server
is hang.
The following is the JVM parameter, is there any suggestion for it?

-Xms4096m
-Xmx4096m
-XX:MaxPermSize=800M
-XX:+UseParallelOldGC
-XX:+HeapDumpOnOutOfMemoryError
-Dorg.eclipse.jetty.server.Request.maxFormContentSize=5000000



--
View this message in context: http://jenkins-ci.361315.n4.nabble.com/How-many-jobs-can-handle-by-Jenkins-master-tp4808004.html
Sent from the Jenkins users mailing list archive at Nabble.com.

[Daniel Beck]

Would be interesting to know what's the output of /threadDump when this is going on. 18 builds is much less than Jenkins should be able to handle.

> --
> You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/1461127511665-4808004.post%40n4.nabble.com.
> For more options, visit https://groups.google.com/d/optout.
>

[Alex Domoradov]

@Dennys Hsieh
How many executors you have configured on the master node?

[dennys]

Thanks for your reply. We don't build code on master, the executor is 0.
And does thread dump show CPU data? I think it's for memory analysis (If I'm
wrong, please let me know, thanks.)



--
View this message in context: http://jenkins-ci.361315.n4.nabble.com/How-many-jobs-can-handle-by-Jenkins-master-tp4808004p4808061.html

[Daniel Beck]

> On 20.04.2016, at 10:05, dennys <dennys...@gmail.com> wrote:
>
> And does thread dump show CPU data?

No, but it shows the code Jenkins is working on at that point in time and often gives hints wrt bottlenecks.

[dennys]

I try to analyze the thread dump, fingerprint and global build status plugin
use lots of resource.
I can disable global build status, but I cannot find a solution to disable
fingerprint...



--
View this message in context: http://jenkins-ci.361315.n4.nabble.com/How-many-jobs-can-handle-by-Jenkins-master-tp4808004p4808294.html

[Daniel Beck]

> On 21.04.2016, at 11:20, dennys <dennys...@gmail.com> wrote:
>
> cannot find a solution to disable
> fingerprint

Fingerprinting is optional when archiving and in Copy Artifacts.

[Stephen Connolly]

I will theorize that you are using the evil job type.

Also you have not mentioned the Jenkins version you are running, so you may be being affected by JENKINS-34213 

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/1461230453321-4808294.post%40n4.nabble.com.

[dennys]

We use Jenkins 1.554.3, I know it's old, we'll try to upgrade it.
And most projects are Maven 2/3, I think we cannot disable fingerprint of
Maven project, is it correct?

Btw, Jenkins copies all artifacts from slaves to master after build. Will it
increase disk IO or network loading of Jenkins master?



--
View this message in context: http://jenkins-ci.361315.n4.nabble.com/How-many-jobs-can-handle-by-Jenkins-master-tp4808004p4808474.html

[Stephen Connolly]

On 22 April 2016 at 07:24, dennys <dennys...@gmail.com> wrote:

We use Jenkins 1.554.3, I know it's old, we'll try to upgrade it.
And most projects are Maven 2/3, I think we cannot disable fingerprint of
Maven project, is it correct?

It is evil in many many ways: http://javaadventure.blogspot.ie/2013/11/jenkins-maven-job-type-considered-evil.html lists just some of the ways in which it is evil.

More critically for you, the fingerprinting of artifacts causes some concurrency related locking that effectively hobbles the concurrent build rate. It may have been fixed in newer versions, but I stay away from the evil one so I cannot confirm.

 

Btw, Jenkins copies all artifacts from slaves to master after build. Will it
increase disk IO or network loading of Jenkins master?

Yes. However file copy is a more optimized path in the remoting protocol so it should not be as bad... but if you are copying very large (think .iso images) files it may be better to route around Jenkins remoting

 

--
View this message in context: http://jenkins-ci.361315.n4.nabble.com/How-many-jobs-can-handle-by-Jenkins-master-tp4808004p4808474.html

Sent from the Jenkins users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/1461306253866-4808474.post%40n4.nabble.com.