Divolte crashed: Too many open files

39 views
Skip to first unread message

Peter Ruijter

unread,
Feb 5, 2019, 5:05:53 AM2/5/19
to divolte-collector
Hi,

In our cluster, Divolte crashed with the error message "Too many open files". 

[XNIO-1 Accept] ERROR [server]: Exception accepting request, closing server channel TCP server (NIO) <6a29ab6e>
java
.io.IOException: Too many open files
 at sun
.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
 at sun
.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
 at sun
.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
 at org
.xnio.nio.QueuedNioTcpServer.handleReady(QueuedNioTcpServer.java:467)
 at org
.xnio.nio.QueuedNioTcpServerHandle.handleReady(QueuedNioTcpServerHandle.java:38)
 at org
.xnio.nio.WorkerThread.run(WorkerThread.java:561)


The user under which divolte runs has a userlimit of 1048576. 
`ulimit -Hn`
1048576

This number is equal to divolte.global.mapper.buffer_size inside the Divolte configuration. Is this value set by Divolte or is it better to modify this value in /etc/security/limits.conf? 

I'm looking forward to your reaction...

Kind regards,

Peter



Friso van Vollenhoven

unread,
Feb 5, 2019, 4:04:51 PM2/5/19
to divolte-...@googlegroups.com
Hi Peter,

The config option you mention is not related to the number of file descriptors that Divolte will use. It is a in memory buffer size for incoming events, as per the docs here. It just happens to default to 10M.

The error looks like you have too many TCPs going on. It's unfortunate that XNIO apparently kills the server instead of just dropping connections in this case. You could try to bump the ulimit for files to unlimited.


Friso



--
You received this message because you are subscribed to the Google Groups "divolte-collector" group.
To unsubscribe from this group and stop receiving emails from it, send an email to divolte-collec...@googlegroups.com.
To post to this group, send email to divolte-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/divolte-collector/f69324ac-24d8-412c-9bcc-c2917c98a9db%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Peter Ruijter

unread,
Feb 6, 2019, 4:07:15 AM2/6/19
to divolte-collector
Hi Friso,

Thanks for your quick reply. I will set the ulimit for the Divolte files to unlimited and sharpen the monitoring.

Peter

James Walton

unread,
Feb 6, 2019, 6:54:35 PM2/6/19
to divolte-...@googlegroups.com
please remove me from the group I am not supposed to be there/ 

thanks

Reply all
Reply to author
Forward
0 new messages