Sending resolved alerts once pod comes to running state

[Guna Kambalimath]

HI All,

I have written an alert rule, which sends alert when kubernetes pod is not in running state (kube state metrics used here). But, I want to send an alert/notification again, once the same pod comes to running state. How is this possible?

Basically, I should be able to send that , it is running. 

Thanks,

Guna

[Brian Candler]

The best way to do that is to send a message when the original alert is "resolved" (i.e. the alert expression, which said that the pod is not in running state, no longer produces an alert).

You do this by adding "send_resolved: true" to the recipients who are interested in these resolution notifications. e.g.

receivers:

- name: someone

  email_configs:

  - to: som...@example.com

    send_resolved: true