Keeping Config Files in sync for HA Prometheus.

[yagyans...@gmail.com]

Hi. I am moving from vanilla Prometheus setup to HA Prometheus setup with 2 instances scraping the same metrics. I'll be using either Thanos or VictoriaMetrics on top of that.

I have a couple of doubts:

1. How to manage the config files and keep all the config files in sync in both the Prometheus instance? Will I have to manually update the config files in both the instances every time I change something?

1. What happens to alerting? Will both the instances have the same alerting rules and keep communicating with the Alertmanager and de-duplication of alerts will be taken care by Alertmanager itself? Or something else has to be done?

Thanks in advance. Sorry if the queries seem repeated. Didn't find the answer for these yet.

[sayf.eddi...@gmail.com]

Hello
1- you can use a CMS tool like ansible to salt to manage prometheus config and update it in //

2- alertmanager will take care of deduplicating the alert

[yagyans...@gmail.com]

Thanks.

Can you explain a little more on 1st? How will adding new targets or adding a new job completely be done via ansible? Is there any existing project on this?