Reg: Prometheus aborting continuously

[RAJESH DASARI]

Hi,

Recently we upgraded prometheus from 1.18.0 to 1.23.0 , after that for
every 2hrs or 4hrs we see that prometheus is aborting. Is there any
known issue for this . Please find the attached back trace of the
abort. We tried with 1.24 and 1.22 versions of Prometheus but the
the issue still exists.


Thanks,
Rajesh Dasari.

[Stuart Clark]

Are you running out of memory / hitting a memory limit?

--
Stuart Clark

[RAJESH DASARI]

Hi Stuart,

Thanks for pointing this out. We had a system wide ulimit setting and
for prometheus we had set the memory limit as 1.5G with LimitAS=1.5G
in the prometheus systemd service file. Earlier versions i.e 1.16.0
was used to consume only 1G at any given time so we had set it as 1.5G
as max limit, but now memory consumption is crossing 1.5G with the
later version (>1.16.0). Is it expected behaviour or any known issue.
Could you please provide your inputs.

Thanks,
Rajesh Dasari.