Overlord memory consumption spiked to 100%

[Mrugesh Kadia]

Hi,

We had deployed Overlord on EC2 (r5a.large) (only overlord is running on this node), normally our memory consumption is around 60%, suddenly Memory consumption spiked to 100%,

After restarting overlord service, it reach to 60%.

jvm.config:

-server
-Xms13500m
-Xmx13500m
-XX:+ExitOnOutOfMemoryError
-XX:+UseG1GC
-Duser.timezone=UTC
-Dfile.encoding=UTF-8
-Djute.maxbuffer=10240000
-Djava.io.tmpdir=/opt/mridata/var/tmp
-Dservice=overlord
-Dderby.stream.error.file=/opt/mridata/var/sv/derby.log
-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager
-Dorg.jboss.logging.provider=slf4j
-Dnet.spy.log.LoggerImpl=net.spy.memcached.compat.log.SLF4JLogger
-Dlog4j.shutdownCallbackRegistry=org.apache.druid.common.config.Log4jShutdown
-Dlog4j.shutdownHookEnabled=true
-Xlog:gc*,safepoint:file=/logs/var/jvm/gc.log:tags,time,uptime,level:filecount=5,filesize=2M
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/opt/test/var/jvm/heapdump

we haven't found anything into logs. for what reason overlord memory can spike?

Thanks,

Mrugesh Kadia

[Mrugesh Kadia]

Our Druid Version: 25.0.0