Recovery notifications alertmanager don't received

56 views
Skip to first unread message

Jose Antonio Chao

unread,
Mar 20, 2020, 7:26:34 AM3/20/20
to Prometheus Users
Hi, 

I'm newer about prometheus/alermanager. 
We setup alertmanager to received alerts, this works fine, but when alerts recovery don't received a email about that alerts was recovered.  
Here my alertmanager configuration (we change emails adress and user/password) 

global: 
  smtp_from: 'AlertManager <no-reply@XXXX>'
  smtp_require_tls: true
  smtp_hello: 'alertmanager'
  smtp_auth_username: 'XXXXX'
  smtp_auth_password: 'XXXXXX'


route:
#  group_by: ['instance', 'alert']
  group_by: ['alertname', 'hostname']
  group_wait: 30s
  group_interval: 5m
  repeat_interval: 12h
  receiver: devops

receivers:
  - name: 'devops'
    email_configs:
      - to: 'us...@email.com'

Thanks for advanced.

Regards, 

José Antonio Chao. 

Brian Candler

unread,
Mar 20, 2020, 7:48:16 AM3/20/20
to Prometheus Users
On Friday, 20 March 2020 11:26:34 UTC, Jose Antonio Chao wrote:
I'm newer about prometheus/alermanager. 
We setup alertmanager to received alerts, this works fine, but when alerts recovery don't received a email about that alerts was recovered.  

You have to opt into those with "send_resolved: true" next to each recipient.
 
receivers:
  - name: 'devops'
    email_configs:
      - to: 'us...@email.com
        send_resolved: true 
    

Jose Antonio Chao

unread,
Mar 20, 2020, 8:30:27 AM3/20/20
to Prometheus Users
Hi Brian, 

we setup but don't works, we received alert about service down but when we restored service don't received email.

receivers:
  - name: 'devops'
    email_configs:
      - to: 'em...@email.com'
        send_resolved: 'true'

Some ideas where is issue? 

Regards, 

José Antonio Chao. 

Brian Candler

unread,
Mar 20, 2020, 8:53:53 AM3/20/20
to Prometheus Users
true and 'true' are not the same in YAML (the first is boolean, the second is a string).  Remove the quotes.

You need to tell alertmanager when you change its config:

killall -HUP alertmanager

It works for me.  If it still doesn't work for you: what version of alertmanager are you running?  And what log output do you get from alertmanager?

Jose Antonio Chao

unread,
Mar 20, 2020, 9:34:06 AM3/20/20
to Prometheus Users
Hi Brain, 

It works!!! problem was don't restart service alertmanager. 

Thanks a lot for you support!!

Regards, 

José Antonio Chao. 
Reply all
Reply to author
Forward
0 new messages