Cloudwatch Exporter not picking up AWS/Kafka metrics

[Jim Hamill]

I am able to get metrics using the prometheus/cloudwatch_exporter tool for other AWS resources but when attempting to use for Kafka, no metrics are being retrieved:

# HELP tagging_api_requests_total API requests made to the Resource Groups Tagging API
# TYPE tagging_api_requests_total counter
# HELP cloudwatch_exporter_scrape_duration_seconds Time this CloudWatch scrape took, in seconds.
# TYPE cloudwatch_exporter_scrape_duration_seconds gauge
cloudwatch_exporter_scrape_duration_seconds 0.0403737
# HELP cloudwatch_exporter_scrape_error Non-zero if this scrape failed.
# TYPE cloudwatch_exporter_scrape_error gauge
cloudwatch_exporter_scrape_error 0.0
# HELP cloudwatch_requests_total API requests made to CloudWatch
# TYPE cloudwatch_requests_total counter
cloudwatch_requests_total{action="listMetrics",namespace="AWS/Kafka",} 16.0

There is not any examples of using Kafka in the repository, does anyone know if it has been successfully used for Kafka before?

[eran]

I am encountering a similar problem with AWS/WAFV2. Did you resolve this issue?

[Sally Lehman]

I'm not sure why it won't work, but cloudwatch_exporter is harder to use and debug than the other more popular exporters, plus it costs money. With AWS MSK you can enable open monitoring and use the jmx and node exporter that enabling it will expose instead of cloudwatch_exporter, and get to the same data. See towards the bottom, there is a whole walk through on how to do it. https://docs.aws.amazon.com/msk/latest/developerguide/monitoring.html