Alert Segregation on single receiver e.g email.

[Aqib Malik]

Dear All,

I have setup Prometheus with grafana and alert manager its working fine for me and monitoring properly.  but we have different departments that only look after certain services. My task is to create alerts based on  different jobs but only send the alerts to emails . 

It would be great if some could help in this regard. 

For example that if node exporter of DevServer goes down send alert to a...@gmail.com but if node exporter of AppServer goes down send alert to x...@gmail.com.

is this possible if yes please share the guide how can I achieve this.

For everyone information i read the documentation there is a variable " routes" that is being used for segregation but it its doing this with different receivers not on single receivers with multiple recipients 

[pratiksha ratnaparkhi]

Try creating different channels for different departments and add those channels depending on your requirements from alerting tab for that panel.

[Aqib Malik]

Hi Pratnapa, 

Thanks for writing to me, Could you please be more specific what channels are you refereeing to and how can I create channels as currently i dont see anything channels option in alert tab.

[pratiksha ratnaparkhi]

Open your grafana on :3000. On left side, click on the bell icon. There are two options, click on notification channels. Now create new channel. 

Give name according to your need and add people in the addresses section(their email id). Adjust more setting if you want, it is not compulsory. Now go on your dashboard. Select the panel, where you want to add alert. E.g. CPU utilization is greater than 80%, then admin people should get notified, then choose the channel where you have added those people (scroll down in the alerting tab from that panel, you will get option to select channel and message along with that). Now if node is down, senior director should get notified, then create channel according to that from notification channel tab(same as we have done before), then select it and you are good to go.

Again, if you have already configured alertmanager, select it as channel, it should be visible in the alerting tab, iff you can visit it on localhost:9093. I always prefer Grafana notifications, as it has more options for configuration and alerts are more specific and detailed, grouped. 

Hope it helps!