Inhibit Rules

[Raslen Ben Hadj Salah]

Hi,

Using Prometheus v2.27.1 with Alertmanager v0.22.2 deployed by the kube-prometheus-stack Helm chart (adjusted by Rancher) on a K8s-cluster we want to achieve, that all alerts are automatically muted when a certain alert is firing.

In our case, all alerts should be muted when the availability check (using the up-metric) triggers an alert, so that in case of a server failure we only get an alerting that the server is down. Although this is a common concern in our eyes, unfortunately we could not find any helpful advice on how to implement it. Apparently, the usual procedure here is to put a fake-alerting along e.g. https://stackoverflow.com/questions/57305247/how-to-inhibit-alerts-outside-business-hours-with-prometheus-alertmanager

What is the basic recommended procedure here?

Regards,

Raslen