Prometheus pods are going to crashloopbackoff

[Nishant Ketu]

Hi, 

I have deployed Prometheus through the helm, I am using statefulsets for multiple pods, It starts up very well, but after a few hours, the pods are not able to restart and going to crashloopbackoff. When I checked the logs it says "err="opening storage failed: invalid block sequence: block time ranges overlap"  \.

Can someone help, what could be the issue and what is the solution?

[sayf eddine Hammemi]

Hi, Are they writing to the same volume/path ? prometheus does not support any kind of clustering

The information in this message may be proprietary and/or confidential, and protected from disclosure. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify ATMECS and delete it from your computer.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/dfb14839-68bc-4a21-aadb-61f019703d97%40googlegroups.com.

[Nishant Ketu]

yes, they are writing to the same volume/path. If this is not allowed how can we manage multiple pods through statefulset.

On Monday, April 20, 2020 at 11:24:45 AM UTC+5:30, sayf eddine Hammemi wrote:

Hi, Are they writing to the same volume/path ? prometheus does not support any kind of clustering

On Mon, Apr 20, 2020 at 7:06 AM Nishant Ketu <nisha...@atmecs.com> wrote:

Hi, 

I have deployed Prometheus through the helm, I am using statefulsets for multiple pods, It starts up very well, but after a few hours, the pods are not able to restart and going to crashloopbackoff. When I checked the logs it says "err="opening storage failed: invalid block sequence: block time ranges overlap"  \.

Can someone help, what could be the issue and what is the solution?

The information in this message may be proprietary and/or confidential, and protected from disclosure. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify ATMECS and delete it from your computer.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to promethe...@googlegroups.com.

[Brian Candler]

By giving each pod its own storage volume.  That's what "stateful" means here - "I need to maintain my own state".