Dynamic Alertmanager repeat_interval

134 views
Skip to first unread message

Will Sewell

unread,
Sep 17, 2021, 5:55:47 AM9/17/21
to Prometheus Users
Hello,

We have a particular alert where we would like to configure a different repeat_interval? What is the best practice for doing this?

One option would be to duplicate our existing routing tree, and just change the repeat_interval. Then we could route to this based on the alert name. The downside of is the alert name needs to be kept in sync between the alert rule config and the Alertmanager config.

To overcome this problem we could be to add a label to the alert definition which specifies the repeat_interval, then we can route these to the appropriate Alertmanager routing tree.

Is it possible to dynamically set the repeat_interval dynamically in the Alertmanager config? I assume not, in which case we are still left with the problem of needing to duplicate the routing trees in Alertmanager for each repeat_interval value.

What are your thoughts on these approaches? Are there alternative solutions I might have missed?

Many thanks!
Reply all
Reply to author
Forward
0 new messages