Problem related to Black-box exporter to monitor Service-UI in Prometheus

8 views

Skip to first unread message

Satyam Vishnoi

unread,

Jul 9, 2020, 8:11:44 AM7/9/20

to Prometheus Users

Hi Team,

I am using Black-Box exporter to monitor our Service-UI in Prometheus.

Problem-Summery: I have a service running on Two nodes as primary and secondary , Currently i gets the alert if service UI is down on primary node but it stills running on secondary node . I am using below alerting Rule. I am using file_sd-configs: to store my Service URLs.

alert: Service
  UI down
expr: probe_http_status_code
  == 0
for: 2m
labels:
  severity: critical
annotations:
  summary: Service {{ $labels.instance }} UI is down

Query: can i use IF statement here for checking if both primary and secondary UI is down then only send the alerts as critical ELSE a Warning as primary UI is down but secondary UI is still running, please start the primary UI.