Jira (PDB-3751) PDB Sync should allow a separate setting for the maximum amount of reports to sync

[Nick Walker (JIRA)]

Nick Walker created an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync Issue Type: Improvement Assignee: Unassigned Created: 2017/11/07 8:28 AM Priority: Normal Reporter: Nick Walker The Problem By default, PDB sync will try to sync all reports in the database with the other PuppetDB. Syncing all of the reports in the database is generally not valuable and syncing a smaller portion and then growing the new sync node as new reports come in would likely work great for 90% of users. In this case, you could set the sync-report-ttl to say 1d while leaving report-ttl at 14d. When setting up a new sync node you'd only sync 1d of reports and over the next 13 days the new reports coming in would bring the sync node up to the 14d of report-ttl. This also allows for sync to go down for multiple days and then come back up relatively quickly depending on how you decide to configure these settings. Having this as a configurable setting provides a release valve when you're trying to get sync working and you don't want to wait for 14 days of reports to sync. You just want sync working now and you don't care about the reports syncing all the way back in time. Add Comment

This message was sent by Atlassian JIRA (v7.0.2#70111-sha1:88534db)

[Owen Rodabaugh (JIRA)]

Owen Rodabaugh updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Owen Rodabaugh CS Priority: Needs Priority Normal CS Impact: Customers with a large number of reports, or who store more than the default days of reports will take a long time to sync those reports if they lose connectivity between PDB nodes. This would get their sync running again much faster. This is analogous to situations where customers run out of disk space on the postgres node. They can truncate the reports table to get running again if they don't need old reports. CS Severity: 3 - Serious CS Business Value: 4 - $$$$$ CS Frequency: 2 - 5-25% of Customers

Add Comment

[Austin Blatt (JIRA)]

Austin Blatt updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Austin Blatt Team: HA

Add Comment

This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93)

[Nick Burgan (JIRA)]

Nick Burgan updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Nick Burgan Story Points: 2

Add Comment

[Nick Burgan (JIRA)]

Nick Burgan updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Nick Burgan Release Notes: Enhancement

Add Comment

[Nick Burgan (JIRA)]

Nick Burgan updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Nick Burgan Sprint: HA Team 2020-01-29

Add Comment

[Nick Burgan (JIRA)]

Nick Burgan updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Nick Burgan Sprint: HA Team 2020-01-29 , HA Team 2020-02-12

Add Comment

[Melissa Amos (JIRA)]

Melissa Amos updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Melissa Amos Labels: DOCS

Add Comment

[Nick Burgan (JIRA)]

Nick Burgan updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Nick Burgan Sprint: HA Team 2020-01-29, HA Team 2020-02-12 , HA Team 2020-02-26

Add Comment

[Austin Blatt (JIRA)]

Austin Blatt assigned an issue to Austin Blatt

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Austin Blatt Assignee: Austin Blatt

Add Comment

[Austin Blatt (Jira)]

Austin Blatt updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Austin Blatt Fix Version/s: PDB 5.2.13 Fix Version/s: PDB 6.9.0

Add Comment

This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)

[Austin Blatt (Jira)]

Austin Blatt updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Austin Blatt Fix Version/s: PDB 6.10.0 Fix Version/s: PDB 6.9.1

Add Comment

[Austin Blatt (Jira)]

Austin Blatt updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Austin Blatt Fix Version/s: PDB 6.9.0 Fix Version/s: PDB 6.10.0

Add Comment

[Austin Blatt (Jira)]

Austin Blatt updated an issue

PuppetDB / PDB-3751 PDB Sync should allow a separate setting for the maximum amount of reports to sync

Change By: Austin Blatt Release Notes: Enhancement New Feature Release Notes Summary: Adds the initial-report-threshold config option to the sync settings. On startup, PuppetDB will only sync reports newer than the threshold. Older reports will still be transferred on subsequent periodic syncs.

Add Comment