Prometheus as long time storage

23 views
Skip to first unread message

Rodolphe Ghio

unread,
Sep 22, 2020, 8:31:56 AM9/22/20
to Prometheus Users
Hi everyone !
I'm going to use Prometheus as long time TS storage,
here's all specifications I would like to have :
- scrape : every minute
- retention : 10 years
- number of metrics : 50
- Number of point : 262 800 000 (  number of metric *  retentio(min))
I've read that Prometheus is using 1/2 bytes per sample so if we calcul the disk space I need, I'm between 262,8 mo and 525,6  mo.

So what are the problems I may face in my use case ?

Cheers,
Rodolphe G.

sayf.eddi...@gmail.com

unread,
Sep 23, 2020, 1:40:54 AM9/23/20
to Prometheus Users
The initial release of Prometheus was in 2012 so no one have tried it yet :D. I am not super expert but I think 50 metrics is manageable on such retention period (in your formula you forgot to take the labels into consideration). But keep in mind prometheus has no data protection schemes given it is a very long period I suggest using another storage system coupled with prometheus like M3db or victoria metrics

Ben Kochie

unread,
Sep 23, 2020, 3:58:16 AM9/23/20
to sayf.eddi...@gmail.com, Prometheus Users
Yes, for that small a setup, the Prometheus TSDB is more than sufficient. With the snapshot system and regular backups, there should be no problems.

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/625c1d93-2769-4890-8eba-58e1135b445en%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages