Trying to get metrics data on RabbitMQ-Overview dashboard

[amin testing]

Can someone please suggest a work-around approach for my case. I have a working bitnami/rabbitmq server helm chart working on my Kubernetes cluster but the graphs displayed on Grafana are not enough, I found this dashboard RabbitMQ-Overview which has sufficient details that can be very useful for my bitnami/rabbitmq server but unfortunately there is no data showing on the dashboard. The issue here is I cannot see my metrics on this dashboard. Please note I am using the kube-prometheus-stack helm chart for Prometheus+Grafana services.

Steps to solve this issue:

1. I enabled the rabbitmq_prometheus for all my Rabbitmq nodes by entering the Pods

   rabbitmq-plugins enable rabbitmq_prometheus

2. Made sure I was using the same data source for Prometheus used in my Grafana

3. I tried creating a prometheus-rabbitmq-exporter to get the metrics from Rabbitmq and send them to RabbitMQ-Overview dashboard but no data was displayed.

my dashboard no data

Please note while reading this documentation to solve my issue I already have metrics from Rabbitmq displayed on Grafana but I need the RabbitMQ-Overview that contains more details about my server.

[Michal Kuratczyk]

It sounds like you are missing a PodMonitor to tell Prometheus about this target. Check your Prometheus Targets section to see if there is anything about those RabbitMQ pods. If there is nothing, then you need something along these lines:

https://www.rabbitmq.com/kubernetes/operator/operator-monitoring.html#prom-operator

I'm not sure what you mean by "prometheus-rabbitmq-exporter" but do not use any exporters - prometheus plugin provides native Prometheus support so there is no need for an exporter (some RabbitMQ exporters exist that pre-date the prometheus plugin but they are not needed these days).

Best,

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/253fe969-7831-4ca7-8a69-f10533df8a2dn%40googlegroups.com.

--

Michał

RabbitMQ team

[amin testing]

Thank you for your reply Michal. Regarding the PodMonitor, I thought about using a ServiceMonitor as there is not much difference between them, mentioned in the documentation, because I already have a service behind my RabbitMQ Pods.

I guess I can assume that the rabbitmq-exporter method is somehow deprecated and Prometheus plugin will satisfy my needs to get the metrics from RabbitMQ. Now please bare with me to show you my results.

When I created a ServiceMonitor that takes the metrics from the rabbitmq-exporter service it is discovered in the Prometheus targets and status running, But no metrics data are shown in RabbitMQ-Overview dashboard

default/prometheus-kube-prometheus-rabbitmq-exporter/0 (1/1 up)

But, I created a ServiceMonitor to take the metrics from the RabbitMQ pods service itself and the status is down with error "server returned HTTP status 404 Not Found"

So from the results we can say that the rabbitmq management /metrics path is not available although I enabled the the necessary plugins for rabbitmq_prometheus.

Please your opinion for this matter is highly appreciated.

[Michal Kuratczyk]

You still haven't explained what you "rabbitmq-exporter" is but assuming it is a stand-alone exporter that relies on RabbitMQ management plugin to get the metrics then it's no surprise there are no metrics in the RabbitMQ Overview dashboard. A Grafana dashboard has specific queries in it and expects metrics with specific names. RabbitMQ Overview dashboard is meant to be used with metrics from rabbitmq_prometheus plugin, not something else.

Now why scraping rabbitmq_prometheus gives you a 404 I can only guess because you haven't provided any configuration or logs. However, you said " rabbitmq management /metrics path is not available" which suggests you are trying to scrape the Management UI/API URL (port 15672/15671) with a "/metrics" path which indeed won't work. You need to scrape <rabbitmq-pod>:15692/metrics (or 15691 if TLS is enabled) which is where the prometheus plugin listens for requests.

Best,

To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/8c7bccc1-54e3-4766-8a8b-b0ca361b8990n%40googlegroups.com.

--

Michał

RabbitMQ team