Alerts history

[Mohan Nagandlla]

Hi  team

Is there any way to get the alerts history like currently I am able to see the alerts which are trigger and those are able to see in grafana dashboard by using grafana plugins and now I want to see past alerts also like 1 days before or n no of days before alerts how could it possibly.

[Joe Pauly]

  https://github.com/prometheus/alertmanager/issues/2223

Alertmanager doesnt persist state.

On Mon, Mar 15, 2021 at 1:40 PM Mohan Nagandlla <nagandl...@gmail.com> wrote:

Hi  team

Is there any way to get the alerts history like currently I am able to see the alerts which are trigger and those are able to see in grafana dashboard by using grafana plugins and now I want to see past alerts also like 1 days before or n no of days before alerts how could it possibly.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CALSpdGmxa8zkHKv_PZ%2ByBxSc3VnjXu9OHBP1jreRED1Eg8Rusg%40mail.gmail.com.

--

Joe Pauly

☎: +91-9388088774

✉: joepau...@gmail.com

[Chris Siebenmann]

Prometheus creates a time series for every alert, under the metric
name ALERTS. You can then do various reporting and visualization of
past alerts in Grafana based on this metric. This doesn't get you quite
exactly what alerts triggered in Alertmanager, because it doesn't
capture Alertmanager's delays if you've set them (or grouping).

Grafana's native panels don't make for really great visualizations
of alert timelines. Locally, we use a plugin for a third party panel
for this:

https://grafana.com/grafana/plugins/natel-discrete-panel/

Unfortunately there are limits for the information that's readily
extracted from Prometheus for this in numerical form. It's quite
difficult to report on things like a count of how many different
times a particular alert has been triggered or what the start (or
end) times of the alerts were. You can determine it from visual
inspection of when ALERTS time series were present on a graph that
visualizes them, though.

- cks