Kafka exporter vs JMX exporter

[ankit.r...@gmail.com]

Hi,

I am confused between kafka exporter and jmx exporter. Both export metrics related to kafka brokers in prometheus format so that prometheus can use it later for further processing.

So, do I need to run both exporters or just any exporter will work to monitor my kafka cluster?

Is there any difference between the metrics exposed by these two exporters?

Please help. Any pointers would be useful.

Thanks and regards

Ankit Rohilla

[Brian Brazil]

On 10 September 2018 at 12:21, <ankit.r...@gmail.com> wrote:

Hi,

I am confused between kafka exporter and jmx exporter. Both export metrics related to kafka brokers in prometheus format so that prometheus can use it later for further processing.

So, do I need to run both exporters or just any exporter will work to monitor my kafka cluster?

You probably want both.

 

Is there any difference between the metrics exposed by these two exporters?

The JMX exporter will give you the metrics of each individual broker, such as memory, GC and kafka external metrics. The Kafka exporter is more overall state, such as the offsets of partitions.

Brian

 

Please help. Any pointers would be useful.

Thanks and regards

Ankit Rohilla

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/c48ee010-96b0-4889-a791-778efaf5cef2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Brian Brazil

www.robustperception.io

[Ankit Rohilla]

Thanks for the reply,

So, like node_exporter I need to run jmx_exporter on each broker, while kafka_exporter can be run on any of the broker in the cluster because it will get only the general information.

Please correct me if I am wrong. Explain a bit if I got it wrong. How to configure jmx_exporter and if possible can you give example of metrics exposed by jmx_exporter specific to kafka because memory and other related things I can also get through node_exporter.

Regards

Ankit Rohilla

On Monday, 10 September 2018 16:57:41 UTC+5:30, Brian Brazil wrote:

On 10 September 2018 at 12:21, <ankit.r...@gmail.com> wrote:

Hi,

I am confused between kafka exporter and jmx exporter. Both export metrics related to kafka brokers in prometheus format so that prometheus can use it later for further processing.

So, do I need to run both exporters or just any exporter will work to monitor my kafka cluster?

You probably want both.

 

Is there any difference between the metrics exposed by these two exporters?

The JMX exporter will give you the metrics of each individual broker, such as memory, GC and kafka external metrics. The Kafka exporter is more overall state, such as the offsets of partitions.

Brian

 

Please help. Any pointers would be useful.

Thanks and regards

Ankit Rohilla

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To post to this group, send email to promethe...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/c48ee010-96b0-4889-a791-778efaf5cef2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Brian Brazil

www.robustperception.io

[kunaa...@gmail.com]

Hi Ankit,

Can you help me with,setting up monitoring for kafka.

I was using JMX exporter ,but I couldn't see proper logs in promethes.

 Can you tell me how to have downloaded kafka exporter and how you managed to run.

Thanks

Aarun

[Shah Darpan]

Hi,

How to configure Kafka exporter for kafka monitoring WITHOUT using DOCKER.

Thanks,
Darpan Shah

[Himanshu Ganatra]

You can use the binary, it's on their official github.

[Ankit Rohilla]

Hi,
I don't clearly remember how I did it back then. But I found a few links that I referred to run all these things. Here are the links:
https://alex.dzyoba.com/blog/jmx-exporter/

https://subscription.packtpub.com/book/big_data_and_business_intelligence/9781783981328/7/ch07lvl1sec51/monitoring-the-storm-cluster-using-jmx

Hope you find them useful.

Regards
Ankit Rohilla

On Wednesday, 4 March 2020 11:09:46 UTC+5:30, Shah Darpan wrote:

[Ankit Rohilla]

Please follow this thread. I've given a few links.

Regards