Merging and migrating data

[Carlos Alonso Garcia Garcia]

Hello everyone,

I am new to prometheus, and I am testing it as an alternative to graphite. I handle very large amount of metrics in the current graphite environment and every once in a while changes occur and need either to merge whisper files or migrate data to another (bigger) cluster. I did not see any documentation on "merging" or "migrating" the data stored, is there a way to do this with prometheus?

Thanks.

[Brian Brazil]

On Sun, Aug 23, 2015 at 6:16 PM, Carlos Alonso Garcia Garcia <d4rkn...@gmail.com> wrote:

Hello everyone,

I am new to prometheus, and I am testing it as an alternative to graphite. I handle very large amount of metrics in the current graphite environment and every once in a while changes occur and need either to merge whisper files or migrate data to another (bigger) cluster. I did not see any documentation on "merging" or "migrating" the data stored, is there a way to do this with prometheus?

There's no way to do this currently. We consider Prometheus storage to be transient, with the long-term plan to have something like OpenTSDB/InfluxDB take care of the long-term durable storage aspect so that we can focus on monitoring. http://www.robustperception.io/scaling-and-federating-prometheus/ should give you an idea of how Prometheus scales up, as while it allows you to scale out it doesn't do clustering per-se.

Brian

 

Thanks.

--
You received this message because you are subscribed to the Google Groups "Prometheus Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-devel...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Brian Brazil

www.robustperception.io

[Carlos Alonso Garcia Garcia]

Thanks Brian, this information has been useful.

Regards,

On Sunday, August 23, 2015 at 10:57:18 AM UTC-7, Brian Brazil wrote:

On Sun, Aug 23, 2015 at 6:16 PM, Carlos Alonso Garcia Garcia <d4rkn...@gmail.com> wrote:

Hello everyone,

I am new to prometheus, and I am testing it as an alternative to graphite. I handle very large amount of metrics in the current graphite environment and every once in a while changes occur and need either to merge whisper files or migrate data to another (bigger) cluster. I did not see any documentation on "merging" or "migrating" the data stored, is there a way to do this with prometheus?

There's no way to do this currently. We consider Prometheus storage to be transient, with the long-term plan to have something like OpenTSDB/InfluxDB take care of the long-term durable storage aspect so that we can focus on monitoring. http://www.robustperception.io/scaling-and-federating-prometheus/ should give you an idea of how Prometheus scales up, as while it allows you to scale out it doesn't do clustering per-se.

Brian

 

Thanks.

--

--

Brian Brazil

www.robustperception.io

[Julius Volz]

Just to clarify what "transient" means: Prometheus's own local storage is good for keeping data for multiple weeks, maybe months, depending on how much data you have.

--