Jenkins ui not loading sometimes

487 views
Skip to first unread message

Rumesh Bandara

unread,
Jun 27, 2016, 10:19:27 AM6/27/16
to Jenkins Users
Hi All,

We have a Jenkins setup with 1 master + 4 worker nodes and more than 250 jobs, which would run up to a maximum of 10 executors at a given time.
However sometimes Jenkins ui doesn't load at all due to heavy load on master server.

Can we do any java tuneups or OS optimizations to avoid ui accessibility issues?

Thanks,
Rumesh

Daniel Beck

unread,
Jun 27, 2016, 10:26:04 AM6/27/16
to jenkins...@googlegroups.com
Do this and provide the information:
https://wiki.jenkins-ci.org/display/JENKINS/Obtaining+a+thread+dump
> --
> You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/f0972152-064f-4890-a5c2-3d08e787de2b%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

Re@lබණ්ඩා™

unread,
Jun 28, 2016, 2:16:03 AM6/28/16
to jenkins...@googlegroups.com
Hi Daniel,

I sent you the thread dump. Please have a look.

Thanks,
Rumesh

You received this message because you are subscribed to a topic in the Google Groups "Jenkins Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-users/BO9BuGVjzD0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to jenkinsci-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/28470A18-3635-42AE-9EA3-98BA0BF7B374%40beckweb.net.

For more options, visit https://groups.google.com/d/optout.



--
Re@lBanda

Baptiste Mathus

unread,
Jun 29, 2016, 3:00:00 AM6/29/16
to jenkins...@googlegroups.com

IIUC you sent the thread dump to Daniel privately. I doubt very much this is what he was meaning. More probably: generate that thread dump, paste it somewhere and post the link here.

Another thing wrt this: do diagnose it the first step is even to look at your gc behaviour. For that your generally enable gc logs and use a tool to analyse them and see what it gives. Looking for things like: how often does the gc chime in, how many full gc in proportion, max observed pause...

If you can generate a gc log, and post it too that could help(in that case give precise details as to when you see issues in the UI to correlate timestamps).

HTH
PS: gc logs should always be enabled, even in production.

Re@lබණ්ඩා™

unread,
Jun 30, 2016, 2:40:31 AM6/30/16
to jenkins...@googlegroups.com
You may find the thread dump here - http://pasted.co/b767d9d4
Password - jenk!@#

Thanks,
Rumesh


For more options, visit https://groups.google.com/d/optout.



--
Re@lBanda

Björn Pedersen

unread,
Jun 30, 2016, 3:10:18 AM6/30/16
to Jenkins Users
Hi,

I see lots of
"Handling POST /jenkins/view/Dashboard/timeline/data/ from <ip> : http-bio-8080-exec-643" Id=40861 Group=main 
BLOCKED on hudson.model.RunMap@1e73d746 owned by "Handling POST /jenkins/view/Dashboard/timeline/data/ from <ip> : http-bio-8080-exec-547" Id=40663


in the dump. That indictaes getting the timeline data is slow and stalls ui updates.

What could be done:
1) reduce the amount of stored jobs (->configure deletion of old jobs)
2) faster disks

Björn



Re@lබණ්ඩා™

unread,
Jun 30, 2016, 1:04:01 PM6/30/16
to jenkins...@googlegroups.com
Hi Björn,

Thanks for the reply. Can you describe bit about what do you mean by "timeline data and stalls ui updates"?
Does the timeline data related to a plugin?

--
You received this message because you are subscribed to a topic in the Google Groups "Jenkins Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-users/BO9BuGVjzD0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to jenkinsci-use...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--
Re@lBanda
Reply all
Reply to author
Forward
0 new messages