Extract influxDb data and store in Prometheus

[Muthu Krishna]

Hi All,

We have been using InfluxDb to store our web app metrics for some time. Recently one of our customers requested us to export the metrics to Prometheus. 

Is it possible to read from InfluxDb directly and store in Prometheus? 

Recently i came across this blog post https://www.influxdata.com/blog/influxdb-now-supports-prometheus-remote-read-write-natively/

If possible please share any documentation on how to read natively from InfluxDb or other DB and store in Prometheus.

Thanks,

Krishna

[Ben Kochie]

What your customer is asking about is not InfluxDB directly, or about how you store them, but how you generate and expose the metrics.

* What language is the app in?

* What library do you use to generate the metrics?

* Are you generating events or metrics?

* How do these metrics get sent to InfluxDB?

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/e82c1c7e-01c1-458a-bc05-ba42d942539d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Muthu Krishna]

Hi Ben,

The application is written in python. We have a custom python script which generates and pushes the metrics to InfluxDb.

I am also looking into using the python implementation of Prometheus_client to expose the metrics to Prometheus. I thought the InfluxDb api for Prometheus would be an easier way

Thanks,

Krishna

On Tuesday, November 7, 2017 at 4:49:26 PM UTC+5:30, Ben Kochie wrote:

What your customer is asking about is not InfluxDB directly, or about how you store them, but how you generate and expose the metrics.

* What language is the app in?

* What library do you use to generate the metrics?

* Are you generating events or metrics?

* How do these metrics get sent to InfluxDB?

On Tue, Nov 7, 2017 at 12:13 PM, Muthu Krishna <cmkr...@gmail.com> wrote:

Hi All,

We have been using InfluxDb to store our web app metrics for some time. Recently one of our customers requested us to export the metrics to Prometheus. 

Is it possible to read from InfluxDb directly and store in Prometheus? 

Recently i came across this blog post https://www.influxdata.com/blog/influxdb-now-supports-prometheus-remote-read-write-natively/

If possible please share any documentation on how to read natively from InfluxDb or other DB and store in Prometheus.

Thanks,

Krishna

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To post to this group, send email to promethe...@googlegroups.com.

[Ben Kochie]

By moving to the Prometheus library, you'll be able to have both Prometheus and InfluxDB, since InfluxDB is able scrape Prometheus metrics output[0].  This is going to be more directly supported in the future I hear.

Another option is to use the influxdb_exporter.  Instead of sending metrics to influxdb, your customer can send the data to the influxdb_exporter and scrape that.  The only tricky part is that your metrics tags (labels) need to be consistent for them to be compatible.

[0]: https://docs.influxdata.com/kapacitor/v1.3/pull_metrics/scraping-and-discovery/

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscribe@googlegroups.com.
To post to this group, send email to prometheus-users@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/85086d16-11b0-48d2-a668-d01135937cf8%40googlegroups.com.

[Muthu Krishna]

Hi Ben,

Thank you very much for your comments, greatly appreciate your help.

I am now looking into using the influxdb_exporter, early results are promising, need to test further.

Thanks,

Krishna