Too many open files

68 views
Skip to first unread message

David Aldrich

unread,
Apr 13, 2017, 3:37:42 AM4/13/17
to jenkins...@googlegroups.com

Hi

 

Since updating some plugins we are getting lots of “Too many open files” warnings. Here’s an example:

 

Apr 12, 2017 9:38:35 PM WARNING org.eclipse.jetty.util.log.JavaUtilLog warn

java.io.IOException: Too many open files

        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)

        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)

        at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:377)

        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:500)

        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

 

I know that there is a File Leak Detector plugin but such investigation seems quite involved.

 

On the master, we have:

 

$ ulimit -a

<snip>

open files                      (-n) 1024

 

Should 1024 be sufficient?  Do I need to worry about limits on the slaves? 

 

Any other suggestions please?  I don’t know why these warnings have suddenly appeared.

 

Best regards

 

David

 

Victor Martinez

unread,
Apr 13, 2017, 4:23:49 AM4/13/17
to Jenkins Users, David....@emea.nec.com
Hi there,

You could read the below blog entry:

Although it's the cloudbees support page, but it's the same core in the end.

In my case,

# ulimit -a

....

open files                      (-n) 65536
....


Cheers

Baptiste Mathus

unread,
Apr 13, 2017, 4:38:56 AM4/13/17
to jenkins...@googlegroups.com, David....@emea.nec.com
Also, this could be a bug. So, you need to clarify which "some plugins" you upgraded. Because if all was fine until now, then there may be some bug somewhere. Or maybe not if you were already close to the ulimit max without knowing it for some time. But impossible to tell from here.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/31f1b754-6366-4545-8dd3-68bf6df2c12f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

David Aldrich

unread,
Apr 13, 2017, 4:39:53 AM4/13/17
to Victor Martinez, Jenkins Users

Hi Victor

 

Thanks for your answer – I will try increasing the limits as they suggest.

 

Best regards

 

David

 


p
.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 12.0px 'Andale Mono'; color: #29f914; background-color: #000000}
span
.s1 {font-variant-ligatures: no-common-ligatures}

 

Click here to report this email as spam.

David Aldrich

unread,
Apr 13, 2017, 4:41:18 AM4/13/17
to Baptiste Mathus, jenkins...@googlegroups.com

Yes, I agree.  But I can’t practically roll back each upgraded plugin on the production server easily. I’ll try increasing the limits first.

 

From: bma...@gmail.com [mailto:bma...@gmail.com] On Behalf Of Baptiste Mathus
Sent: 13 April 2017 09:38
To: jenkins...@googlegroups.com
Cc: David Aldrich <David....@EMEA.NEC.COM>
Subject: Re: Too many open files

 

Also, this could be a bug. So, you need to clarify which "some plugins" you upgraded. Because if all was fine until now, then there may be some bug somewhere. Or maybe not if you were already close to the ulimit max without knowing it for some time. But impossible to tell from here.

 

To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.

 

 

Click here to report this email as spam.

Baptiste Mathus

unread,
Apr 13, 2017, 8:37:19 AM4/13/17
to jenkins...@googlegroups.com
If you can at least post here the list of upgraded plugins, it could serve as a reference if this issue is encountered by any other. Thanks!

To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscribe@googlegroups.com.

Click here to report this email as spam.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/e4d7af6683eb4ea98ac958641a365ce2%40EUX13SRV1.EU.NEC.COM.

David Aldrich

unread,
Apr 13, 2017, 8:44:00 AM4/13/17
to jenkins...@googlegroups.com

Ok, the plugins I upgraded were:

 

bouncycastle API 2.16.0 > 2.16.1

Git client 2.4.0 > 2.4.1

Support core 2.39 > 2.40

Token macro 2.0 > 2.1

SCM API 1.3 > 2.1.1

Subversion 2.7.1 > 2.7.2

Email Extension 2.57.1 > 2.57.2

Matrix Authorisation Strategy 1.4 > 1.5

Static Analysis Utilities 1.84 > 1.86

Warnings 4.60 > 4.62

 

I also installed Blue Ocean 1.0.0

 

Best regards

 

David

 

 

 

From: bma...@gmail.com [mailto:bma...@gmail.com] On Behalf Of Baptiste Mathus
Sent: 13 April 2017 13:37
To: jenkins...@googlegroups.com
Subject: Re: Too many open files

 

If you can at least post here the list of upgraded plugins, it could serve as a reference if this issue is encountered by any other. Thanks!

 

To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.

Click here to report this email as spam.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.


For more options, visit https://groups.google.com/d/optout.

 

--

You received this message because you are subscribed to the Google Groups "Jenkins Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/CANWgJS6PuE5Yr2jx5SqBh5n%2BNpMr9NMTQnkkTbZv-vkn%2BB17Zg%40mail.gmail.com.

Reply all
Reply to author
Forward
0 new messages