Sending resolved alerts once pod comes to running state

10 views
Skip to first unread message

Guna Kambalimath

unread,
Nov 10, 2020, 12:19:29 AM11/10/20
to Prometheus Users
HI All,

I have written an alert rule, which sends alert when kubernetes pod is not in running state (kube state metrics used here). But, I want to send an alert/notification again, once the same pod comes to running state. How is this possible?

Basically, I should be able to send that , it is running. 

Thanks,

Guna

Brian Candler

unread,
Nov 10, 2020, 2:58:32 AM11/10/20
to Prometheus Users
The best way to do that is to send a message when the original alert is "resolved" (i.e. the alert expression, which said that the pod is not in running state, no longer produces an alert).

You do this by adding "send_resolved: true" to the recipients who are interested in these resolution notifications. e.g.

receivers:
- name: someone
  email_configs:
    send_resolved: true

Reply all
Reply to author
Forward
0 new messages