URL Working, Response Code captured by Blackbox also 200, but still probe_success failing.

29 views
Skip to first unread message

Yagyansh S. Kumar

unread,
Apr 23, 2020, 4:40:27 AM4/23/20
to Prometheus Users
Hi. I have couple of Service Health Checks on my AWS Instances. (Eg. 18.220.x.x:PORT/health). I am using Blackbox to monitor all my Service Health Checks.
These AWS Instances Health Checks are being shown as DOWN by Blackbox even though they are working fine. Also, when I check response code that Blaxkbox is scraping for the Health Check it is 200. Also, the Health Check URL is reachable from my server on which Blackbox is running. I am not able to understand why is probe_success failiing.

[root@exporters ~]# curl http://18.220.x.x:PORT/health
{"health":"good"}

Can someone help?

Thanks in advance!

Julius Volz

unread,
Apr 23, 2020, 4:48:46 AM4/23/20
to Yagyansh S. Kumar, Prometheus Users
When you say that the health checks are shown as DOWN, are you talking about the Blackbox targets on the /target page showing "DOWN"? This would indicate that Prometheus cannot even reach the Blackbox Exporter itself, not that the BBE is failing to reach your service health checks. Then Prometheus should also show an error message on the /targets page why it cannot reach the BBE.

In case the BBE targets on /targets are shown as UP but only the probe_success metric is set to 0, try executing the health check manually through the Blackbox Exporter with "&debug=true" appended to the BBE's /probe URL. This will show you some logs at the top that tell you why the probe is failing. For example: http://localhost:9115/probe?module=http_2xx&target=https://nonexistentbogusdomain.io&debug=true

If that doesn't help, you'll probably need to share more information about your configuration on the Prometheus and BBE side.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/7b35c6d7-8fb5-40db-a3b2-2e9bc95d19cb%40googlegroups.com.

Yagyansh S. Kumar

unread,
Apr 23, 2020, 5:36:00 AM4/23/20
to Prometheus Users
Thanks Julius.

Got the problem and rectified it.
To unsubscribe from this group and stop receiving emails from it, send an email to promethe...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages