Read Timeseries from Kafka topic and ingest into Prometheus

[machhindra nale]

Team,

How can I ingest the timeseries metric data from a Kafka topic to Prometheus?

Timeseries metric data uses avro encoding. I do not want to monitor Kafka, but ingest the streaming data from a kafka topic into Prometheus.

thanks,

Machhindra

[Brian Candler]

You can't.  Prometheus does not support "push" of data into the timeseries database; it can only "pull" data by scraping.

Have a look at other TSDB solutions.

[Harkishen Singh]

Was wondering why pushgateway (https://github.com/prometheus/pushgateway) will not be useful here. Pushgateway was build for these purposes.

[Brian Candler]

No, pushgateway was not built for that purpose.

Pushgateway remembers only the *last* value that was pushed to it, so that it can be scraped later.  It's for one-shot scripts which run and then terminate, but want their result to linger around to be scraped later.

[machhin...@gmail.com]

Thank you for the advise!!