Nimbus crash on OOM

161 views
Skip to first unread message

vinh

unread,
Oct 11, 2013, 10:13:55 PM10/11/13
to storm...@googlegroups.com
Our Nimbus server finally crashed due to OOM errors. It's been up for about a week, although we've never encountered this issue before. Any ideas how this can happen? We currently have Nimbus and UI running on a dedicated box with no other apps running. I assume all Nimbus does is monitor supervisors.

We detected this error when the UI responded with stack traces indicating that it could not contact Nimbus.

2013-10-11 18:05:14,379 [ERROR] [TNonblockingServer.run] run() exiting due to uncaught error
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
at org.apache.thrift7.server.TNonblockingServer$FrameBuffer.read(TNonblockingServer.java:491)
at org.apache.thrift7.server.TNonblockingServer$SelectThread.handleRead(TNonblockingServer.java:359)
at org.apache.thrift7.server.TNonblockingServer$SelectThread.select(TNonblockingServer.java:304)
at org.apache.thrift7.server.TNonblockingServer$SelectThread.run(TNonblockingServer.java:243)

vinh

unread,
Oct 11, 2013, 11:55:52 PM10/11/13
to storm...@googlegroups.com
Sorry, please ignore. Turned out to be an error on our part. Accidental ssh to the Nimbus control port.
-Vinh

Jon

unread,
Oct 12, 2013, 3:09:31 PM10/12/13
to storm...@googlegroups.com
You probably want to raise these:
ui.childopts
: "-Xmx768m"
nimbus.childopts: "-Xmx1024m"
Reply all
Reply to author
Forward
0 new messages