Prometheus resolve alert thrown when no metric is available

36 views
Skip to first unread message

rashmi Rashmitha

unread,
Dec 24, 2021, 8:09:29 AM12/24/21
to Prometheus Users
Hi Team,

I need to get firing alert when 99th percentile of response time is >10ms. and this I have achieved using histogram_quantile and configured this in rule expr.
Firing alert thrown as expected.
For some reason, the metric is gone and when the metric is not available, prometheus is resolving the alert.
I wanted to get resolve alert only when the metric is present and histogram_quantile for that metric is less than 10ms. please suggest.

Thanks,
Rashmitha

Stuart Clark

unread,
Dec 24, 2021, 10:10:23 AM12/24/21
to rashmi Rashmitha, Prometheus Users
Alerts resolve if the expression no longer returns any results.

So it will resolve both when the 99th percentile is below 10ms or if the
metric no longer exists.

--
Stuart Clark
Reply all
Reply to author
Forward
0 new messages