Mancenter Heap OutOfMemoryError - How to set or increase Mancenter Heap size

[Saikat Sur]

Hi ,

Getting bellow log error in Mancenter.

Caused by: java.lang.OutOfMemoryError: Java heap space

Mancenter url giving error: 504 Gateway Time-out

Using Docker Image of Mancenter with all default values.  e.g., hazelcast.mc.cache.max.size with default value 768

----------------------------

2020-01-23 13:44:37 [qtp1453128758-72] WARN  o.e.j.server.handler.ErrorHandler - EXCEPTION

org.springframework.web.util.NestedServletException: Request processing failed; nested exception is org.thymeleaf.exceptions.TemplateProcessingException: Exception evaluating SpringEL expression: "@mvcResourceUrlProvider.getForLookupPath('/stylesheets/application.css')" (template: "head" - line 19, col 11)

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:982)

at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:687)

at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)

at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865)

at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)

at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:566)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)

at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)

at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700)

at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)

at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667)

at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)

at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:227)

at org.eclipse.jetty.server.Dispatcher.error(Dispatcher.java:86)

at org.eclipse.jetty.server.handler.ErrorHandler.doError(ErrorHandler.java:120)

at org.eclipse.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:79)

at org.eclipse.jetty.server.Response.sendError(Response.java:757)

at org.eclipse.jetty.server.handler.AbstractHandler.doError(AbstractHandler.java:100)

at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1339)

at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)

at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)

at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667)

at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)

at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)

at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)

at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)

at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)

at org.eclipse.jetty.server.Server.handle(Server.java:505)

at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:425)

at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)

at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)

at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)

at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)

at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:786)

at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:743)

at java.base/java.lang.Thread.run(Thread.java:834)

Caused by: org.thymeleaf.exceptions.TemplateProcessingException: Exception evaluating SpringEL expression: "@mvcResourceUrlProvider.getForLookupPath('/stylesheets/application.css')" (template: "head" - line 19, col 11)

at org.thymeleaf.spring4.expression.SPELVariableExpressionEvaluator.evaluate(SPELVariableExpressionEvaluator.java:290)

at org.thymeleaf.standard.expression.VariableExpression.executeVariableExpression(VariableExpression.java:165)

at org.thymeleaf.standard.expression.SimpleExpression.executeSimple(SimpleExpression.java:66)

at org.thymeleaf.standard.expression.Expression.execute(Expression.java:109)

at org.thymeleaf.standard.expression.Expression.execute(Expression.java:138)

at org.thymeleaf.standard.expression.LinkExpression.executeLinkExpression(LinkExpression.java:262)

at org.thymeleaf.standard.expression.SimpleExpression.executeSimple(SimpleExpression.java:84)

at org.thymeleaf.standard.expression.Expression.execute(Expression.java:109)

at org.thymeleaf.standard.expression.Expression.execute(Expression.java:138)

at org.thymeleaf.standard.expression.Expression.execute(Expression.java:125)

at org.thymeleaf.standard.processor.AbstractStandardExpressionAttributeTagProcessor.doProcess(AbstractStandardExpressionAttributeTagProcessor.java:82)

at org.thymeleaf.processor.element.AbstractAttributeTagProcessor.doProcess(AbstractAttributeTagProcessor.java:74)

at org.thymeleaf.processor.element.AbstractElementTagProcessor.process(AbstractElementTagProcessor.java:95)

at org.thymeleaf.util.ProcessorConfigurationUtils$ElementTagProcessorWrapper.process(ProcessorConfigurationUtils.java:633)

at org.thymeleaf.engine.ProcessorTemplateHandler.handleStandaloneElement(ProcessorTemplateHandler.java:918)

at org.thymeleaf.engine.StandaloneElementTag.beHandled(StandaloneElementTag.java:228)

at org.thymeleaf.engine.Model.process(Model.java:282)

at org.thymeleaf.engine.ProcessorTemplateHandler.handleOpenElement(ProcessorTemplateHandler.java:1587)

at org.thymeleaf.engine.OpenElementTag.beHandled(OpenElementTag.java:205)

at org.thymeleaf.engine.TemplateModel.process(TemplateModel.java:136)

at org.thymeleaf.engine.TemplateManager.parseAndProcess(TemplateManager.java:593)

at org.thymeleaf.TemplateEngine.process(TemplateEngine.java:1087)

at org.thymeleaf.TemplateEngine.process(TemplateEngine.java:1061)

at org.thymeleaf.spring4.view.ThymeleafView.renderFragment(ThymeleafView.java:335)

at org.thymeleaf.spring4.view.ThymeleafView.render(ThymeleafView.java:189)

at org.springframework.web.servlet.DispatcherServlet.render(DispatcherServlet.java:1286)

at org.springframework.web.servlet.DispatcherServlet.processDispatchResult(DispatcherServlet.java:1041)

at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:984)

at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)

... 43 common frames omitted

Caused by: org.springframework.expression.ExpressionInvocationTargetException: A problem occurred when trying to execute method 'getForLookupPath' on object of type [org.springframework.web.servlet.resource.ResourceUrlProvider]

at org.springframework.expression.spel.ast.MethodReference.throwSimpleExceptionIfPossible(MethodReference.java:237)

at org.springframework.expression.spel.ast.MethodReference.getValueInternal(MethodReference.java:138)

at org.springframework.expression.spel.ast.MethodReference.access$000(MethodReference.java:52)

at org.springframework.expression.spel.ast.MethodReference$MethodValueRef.getValue(MethodReference.java:377)

at org.springframework.expression.spel.ast.CompoundExpression.getValueInternal(CompoundExpression.java:88)

at org.springframework.expression.spel.ast.SpelNodeImpl.getValue(SpelNodeImpl.java:121)

at org.springframework.expression.spel.standard.SpelExpression.getValue(SpelExpression.java:318)

at org.thymeleaf.spring4.expression.SPELVariableExpressionEvaluator.evaluate(SPELVariableExpressionEvaluator.java:263)

... 72 common frames omitted

Caused by: java.lang.OutOfMemoryError: Java heap space

[Rafal Leszko]

Hi Saikat,

You can increase heap memory using two parameters: -XX:MaxRAMPercentage=80 (in JAVA_OPTS) and -m 512m. The first one decides how much of the container memory can be used by the JVM Heap and the second how much memory you allow the container to use.

Please try to run the following:

docker run -e JAVA_OPTS=' -XX:MaxRAMPercentage=80' -m 512m hazelcast/management-center

Cheers,

Rafał

--
You received this message because you are subscribed to the Google Groups "Hazelcast" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hazelcast+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast/d190fac2-903e-46a6-ac27-5f36b584ef3a%40googlegroups.com.

--

Rafał Leszko

Software Engineer

ra...@hazelcast.com

@RafalLeszko

This message contains confidential information and is intended only for the individuals named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required, please request a hard-copy version. Thank you, 

[Saikat Sur]

Thank you Rafal,  will try with your suggestion.  

BTW, I am using Hazelcast cluster of 3 Nodes with huge load to cache, having continuous creation and increase of IMAP (TTL set) as per our requirement.  Thinking to reduce the value of hazelcast.mc.cache.max.size too for better Heap performance.  Should it be right to make its value to 512 from default 768.

To unsubscribe from this group and stop receiving emails from it, send an email to haze...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast/d190fac2-903e-46a6-ac27-5f36b584ef3a%40googlegroups.com.

[Josef Cacek]

I think Rafal's values were used just to demonstrate how to provide them to the Docker run command. You should pick proper values depending on your environment.

Regards,

-- Josef

To unsubscribe from this group and stop receiving emails from it, send an email to hazelcast+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast/74b986f0-5c60-40d6-ab30-a48158a31497%40googlegroups.com.

[Saikat Sur]

Thanks everyone, 

I have set the values as below ..

docker run -e JAVA_OPTS=' -Dhazelcast.mc.cache.max.size=512 -Dhazelcast.mc.healthCheck.enable=true -Dhazelcast.mc.disk.usage.limit=1GB -XX:MaxRAMPercentage=80' -m 512m hazelcast/management-center:$MANAGEMENT_CENTER

Now Mancenter is stable.   

... Saikat

To view this discussion on the web visit https://groups.google.com/d/msgid/hazelcast/74b986f0-5c60-40d6-ab30-a48158a31497%40googlegroups.com.