TSDB performance

[Nikita Afanasev]

Hi all,

I have a task to check TSDB performance. I'm looking if it's possible to import a data set into TSDB, like I can do it in psql. Or may be you guys have some performance sheets, does it matter what types of data, what granularity and etc TSDB stores and how it affects its performance.  

[Ben Kochie]

There are some bulk-import tools being worked on. But I'm not sure they're ready for users yet.

See: https://github.com/prometheus/prometheus/pull/5887

As for performance, it depends on what kind of scale of monitoring you're looking to do. It mostly depends on the ingestion rate and the cardinality of your your data.

Base-line, Prometheus uses about 1 CPU per 200,000 samples per second. So, granularity mostly doesn't matter in this equation.

On Fri, Feb 14, 2020 at 4:14 PM Nikita Afanasev <nikit...@gmail.com> wrote:

Hi all,

I have a task to check TSDB performance. I'm looking if it's possible to import a data set into TSDB, like I can do it in psql. Or may be you guys have some performance sheets, does it matter what types of data, what granularity and etc TSDB stores and how it affects its performance.  

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/c00749b9-dc7a-4662-92d7-6828d67d1beb%40googlegroups.com.

[Nikita Afanasev]

Ben,

Thanks for you answer. Do you also have any suggestions on how much bytes one record takes?

On Friday, February 14, 2020 at 7:08:26 PM UTC+3, Ben Kochie wrote:

There are some bulk-import tools being worked on. But I'm not sure they're ready for users yet.

See: https://github.com/prometheus/prometheus/pull/5887

As for performance, it depends on what kind of scale of monitoring you're looking to do. It mostly depends on the ingestion rate and the cardinality of your your data.

Base-line, Prometheus uses about 1 CPU per 200,000 samples per second. So, granularity mostly doesn't matter in this equation.

On Fri, Feb 14, 2020 at 4:14 PM Nikita Afanasev <nikit...@gmail.com> wrote:

Hi all,

I have a task to check TSDB performance. I'm looking if it's possible to import a data set into TSDB, like I can do it in psql. Or may be you guys have some performance sheets, does it matter what types of data, what granularity and etc TSDB stores and how it affects its performance.  

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to promethe...@googlegroups.com.

[Ben Kochie]

Typical storage is around 1.3 bytes per sample. Including indexes it tends to be 1.5-1.7 bytes per sample. 

To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/395a3c0f-505d-4fdc-b3a5-9f976cc1d33c%40googlegroups.com.

[Nikita Afanasev]

Thanks Ben!

To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/395a3c0f-505d-4fdc-b3a5-9f976cc1d33c%40googlegroups.com.