Jira (PDB-5248) Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1

[Bogdan Irimie (Jira)]

Bogdan Irimie updated an issue

PuppetDB / PDB-5248 Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1 Change By: Bogdan Irimie Summary: Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2 /n1 Add Comment

This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97)

[Bogdan Irimie (Jira)]

Bogdan Irimie updated an issue

PuppetDB / PDB-5248 Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1

Change By: Bogdan Irimie Story Points: 2

Add Comment

[Andrei Filipovici (Jira)]

Andrei Filipovici assigned an issue to Andrei Filipovici

PuppetDB / PDB-5248 Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1

Change By: Andrei Filipovici Assignee: Andrei Filipovici

Add Comment

[Andrei Filipovici (Jira)]

Andrei Filipovici commented on PDB-5248

Re: Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1 Run the check-command-perf script for 10k nodes on an empty sandbox and the time was 10 minutes. Processing-seconds: { "OneMinuteRate":169.72852061825367, "MeanRate":49.93313542292066, "FifteenMinuteRate":28.842842638909264, "Max":367.501631, "50thPercentile":31.104737999999998, "Mean":31.412819979475657, "DurationUnit":"milliseconds", "95thPercentile":40.754393, "99thPercentile":291.318769, "98thPercentile":47.273361, "Min":3.6274499999999996, "999thPercentile":335.11572, "RateUnit":"events/second", "75thPercentile":33.676918, "Count":30000, "StdDev":36.994786206098325, "FiveMinuteRate":69.5092314222519} Elapsed-seconds: 595

Add Comment

[Andrei Filipovici (Jira)]

Andrei Filipovici commented on PDB-5248

Re: Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1

Run the benchmark from PDB version 6.14.0. It finished the same task in 6 minutes, with an average of 100-110 messages/s. Also PDB finished ingestion in 33 minutes. That is one minute faster than version 6.18.0.

Add Comment

[Andrei Filipovici (Jira)]

Andrei Filipovici commented on PDB-5248

Re: Determin ingestion speed when PDB, benchmark tool and PostgreSQL are deployed on n2/n1

Also run the benchmark on n2 and PDB on n1. The benchmark finished in 12 min and PDB in 36 min. Also tried it the other way round, with the benchmark on n1 and PDB on n2. The benchmark finished in 11 min and PDB dinished in 18 min.

Add Comment