Moving data across prometheus instances

1,074 views
Skip to first unread message

imra...@gmail.com

unread,
Nov 15, 2017, 9:03:25 PM11/15/17
to Prometheus Users
Hi,

I have metrics in prometheus server behind a gateway. Want to mirror this data to another prometheus server that doesn't hide behind any gateway. I cannot stop the source server (the one behind gateway) and the source is configured to retain data for 2 weeks. I tried the following approaches to pull over data

1. Set up scraping the source with a tunnel - The issue is timestamps are not retained.
2. Federation - Again wasn't able to retain timestamps.
3. Tried remote read, but no privileges to configure the source prometheus instance (v 1.8)
4. I looked at Http API, but didn't understand how I can easily push the output of the query API to the new prometheus server.

What is the best approach to retain timestamps and pull the data out to the new prometheus server?

thanks,
Imran

Brian Brazil

unread,
Nov 16, 2017, 4:06:09 AM11/16/17
to imra...@gmail.com, Prometheus Users
Setup the new Prometheus server scraping all the monitoring targets, and wait 2 weeks.

--

Imran

unread,
Nov 16, 2017, 4:05:22 PM11/16/17
to Brian Brazil, Prometheus Users
Hi Brian,

Setting up new server to scrape monitoring targets is not an option. The targets can only be scraped by a server behind the gateway.

thanks,
Imran

Brian Brazil

unread,
Nov 16, 2017, 5:41:47 PM11/16/17
to Imran, Prometheus Users
On 16 November 2017 at 21:05, Imran <imra...@gmail.com> wrote:
Hi Brian,

Setting up new server to scrape monitoring targets is not an option. The targets can only be scraped by a server behind the gateway.

This is not something that makes much sense in Prometheus terms then, you should perform the queries you need against the Prometheus doing the scraping.

Brian
 

thanks,
Imran


On Thu, Nov 16, 2017 at 1:06 AM, Brian Brazil <brian.brazil@robustperception.io> wrote:
On 16 November 2017 at 02:03, <imra...@gmail.com> wrote:
Hi,

I have metrics in prometheus server behind a gateway. Want to mirror this data to another prometheus server that doesn't hide behind any gateway. I cannot stop the source server (the one behind gateway) and the source is configured to retain data for 2 weeks. I tried the following approaches to pull over data

1. Set up scraping the source with a tunnel - The issue is timestamps are not retained.
2. Federation - Again wasn't able to retain timestamps.
3. Tried remote read, but no privileges to configure the source prometheus instance (v 1.8)
4. I looked at Http API, but didn't understand how I can easily push the output of the query API to the new prometheus server.

What is the best approach to retain timestamps and pull the data out to the new prometheus server?

Setup the new Prometheus server scraping all the monitoring targets, and wait 2 weeks.

--




--
Reply all
Reply to author
Forward
0 new messages