Loading job configuration pages is excruciatingly slow (minutes)

744 views
Skip to first unread message

bl0ck3r

unread,
Jan 28, 2014, 9:10:45 AM1/28/14
to jenkins...@googlegroups.com
Everything in Jenkins is reasonably fast, but loading job configuration pages is frustratingly slow (minutes). Using Firefox, hosted on linux. Started happening a few months ago. I don't get it since Jenkins should only be loading the config.xml for the job... what else does it do that takes so long?

bl0ck3r

unread,
Jan 28, 2014, 9:32:38 AM1/28/14
to jenkins...@googlegroups.com
I should add that the CPU is railed all the time and that I use Jenkins 1.509.2. There is nothing else on that host but Jenkins. We have about 50 jobs, and thousands of results (and hundreds/thousands of JUnit xml files per build). Have I exceeded Jenkins capacity? How do I discover what Jenkins is doing, we're only running two jobs on two slaves, the master should have nothing to do but wait.

top - 09:24:57 up 72 days, 8 min,  2 users,  load average: 1.06, 1.18, 1.14
Tasks: 104 total,   1 running, 103 sleeping,   0 stopped,   0 zombie
Cpu0  : 99.0%us,  0.7%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.3%si,  0.0%st
Mem:   4059656k total,  4022352k used,    37304k free,   268708k buffers
Swap:  2097148k total,        0k used,  2097148k free,  2728332k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 1627 jenkins-  20   0 1483m 656m 8936 S 99.9 16.6  5125456h java


Daniel Beck

unread,
Jan 28, 2014, 9:57:16 AM1/28/14
to jenkins...@googlegroups.com
You probably have a plugin whose job config parts have a really long load time for some reason.

While the job config page is loading, open http://(yourjenkins)/threadDump in another window. Search for "Handling GET /job/(jobname)/configure". This will tell you, what part of the code, and often, which plugin, it's processing. Reload a few times if necessary to get more samples.

Alternatively, while the job config page is loading, keep pressing the End key to try to determine what part of the config page is at the very end of the page (this will look really broken, because no JavaScript is running yet to hide parts of the form). If there's no change for a while, the part at the very or (or the part that will be drawn next) is the culprit. This has worked for me in the past (using Firefox).

On 28.01.2014, at 15:10, bl0ck3r <martin....@gmail.com> wrote:

> Everything in Jenkins is reasonably fast, but loading job configuration pages is frustratingly slow (minutes). Using Firefox, hosted on linux. Started happening a few months ago. I don't get it since Jenkins should only be loading the config.xml for the job... what else does it do that takes so long?
>
> --
> You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.

bl0ck3r

unread,
Jan 28, 2014, 10:30:34 AM1/28/14
to jenkins...@googlegroups.com, m...@beckweb.net
Thanks for the advice.

1) scrolling to the end while config is loading: it gets to the end (the last post-build step which is editable email notification) very quickly. so it seems it's busy doing something else

2) examining the threadDump while loading the config is hung at the bottom: nothing stands out in terms of plugin name. However, reloading the threadDump repeatedly while the other tab is slowly loading the configuration page show that there is a lot of activity going on. I have pasted the threadDump here http://pastebin.com/F2Yhkjmp (but it changes all the time)

Does anyone see anything abnormal?

George Li

unread,
Jul 17, 2014, 11:44:08 AM7/17/14
to jenkins...@googlegroups.com, m...@beckweb.net
Hi,

I am seeing similar slowness issue. I have Jenkins v1.567. The slowness is cross the board but it is especially slow when trying to open config system or config job pages. I caught some thread dump and noticed org.kohsuke.stapler.compression.CompressionFilter.doFilter shows up in all of the ones I caught. In some post from the past, I thought adding option "-Dorg.kohsuke.stapler.compression.CompressionFilter.disabled=true" in "JAVA_ARGS" in /etc/default/jenkins would disable the compression. But I am seeing the same thing after having done that. Do you guys have any idea what else I can try? I noticed that my version v.1.567 isn't the latest but it is fairly recent. I also checked the change log for all subsequent releases after v1.567 but did not see anything that may be related.

Thanks.

George.
Reply all
Reply to author
Forward
0 new messages