Use remote storage adapter to write to multiple inluxdb

[abhijit...@gmail.com]

I have a node exporter installed and running. I also have a prometheus instance installed. I am scraping data from the node exporter in the prometheus instance.
Now my goal is to install two influxdb instances in two separate machines.

Then use remote storage adapter to make the installed prometheus write into both the instances of influxdb.

Are there any configurations which I have to tweak to support multiple instances of influxdb?

Please note:

I have been able to establish this entire setup with a single influxdb instance. I am also seeing node exporter data in the influx database. 

Please suggest.

[neha...@gmail.com]

HI Abhijit,

Did you have any success in implementing influxdb HA with prometheus remote write api? I am tried using influx-relay to copy data to two influx-db but it seems to be not working with Prometheus write endpoint /api/v1/prom/write.

Thanks

[addepalli...@gmail.com]

Hi,

See this page: https://github.com/prometheus/prometheus/blob/c6399296dcc059bbc496f40e31aa2c7b7a341951/documentation/internal_architecture.md#storage

It says that one can have multiple remote writes and multiple remote reads.

Prometheus writes the data to all remote storage systems and also read from multiple remote storage systems.

So, there is no need for external software such as influx-relay. You can put all influxDB instances as remote_writes and remote_reads, you should see the data in all influxDB instances.

Srini

[Murali Krishna Kanagala]

All you need is to install influxdb, create a database on it and add the below line in prometheus.yml

remote_write:
- url: "http://influxdb_host:influxdb_port/api/v1/prom/write?u=paul&p=foo&db=prometheus"

[avir...@gmail.com]

Hi,

I wanted to write my prometheus data to multiple influxDB instances. I am able to write to a single DB. Can anyone suggest how to make things work for 2 different remote_write's?

I tried below which did not work..

remote_write:
- url: "http://influxdb_host:influxdb_port/api/v1/prom/write?u=paul&p=foo&db=prometheus"

- url: "http://influxdb_host:influxdb_port/api/v1/prom/write?u=paul&p=foo&db=prometheus1"

[Callum Styan]

Can you give more info? Your logs?

You should be able to add a second URL like that.

[avir...@gmail.com]

It took time but worked.

[Maria Stroe]

How did you manage to do that?