Jira (PDB-3624) Generational fact value GC

[Russell Mull (JIRA)]

Russell Mull updated an issue

PuppetDB / PDB-3624 Generational fact value GC Change By: Russell Mull Issue Type: Task New Feature Add Comment

This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe)

[Russell Mull (JIRA)]

Russell Mull created an issue

PuppetDB / PDB-3624 Generational fact value GC Issue Type: Task Assignee: Unassigned Created: 2017/07/24 3:09 PM Priority: Normal Reporter: Russell Mull Improve fact value write performance by implementing a simple generational GC. Potential approach: Add an integer 'generation' column to fact_values All facts come in at generation zero Limit pinpoint fact gc only to values in generation zero, with a partial index of fact_values where generation=0. When doing the first full GC, capture the current set of all fact values with a bloom filter At subsequent full GCs, compare the set of all fact values with the previous set. If the value was maybe present in the last generation, set it to generation 1. If it definitely wasn't in the last generation, set it to generation 0.

Add Comment

[Russell Mull (JIRA)]

Russell Mull updated an issue

PuppetDB / PDB-3624 Generational fact value GC Change By: Russell Mull Sprint: Hopper Data Platform Next Sprint

Add Comment

[Jeff Yarnell (JIRA)]

Jeff Yarnell updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Jeff Yarnell Story Points: 5

Add Comment

[Jeff Yarnell (JIRA)]

Jeff Yarnell updated an issue

PuppetDB / PDB-3624 Generational fact value GC Change By: Jeff Yarnell

Improve fact value write performance by implementing a simple generational GC.  Potential approach:

* Add an integer 'generation' column to fact_values * All facts come in at generation zero * Limit pinpoint fact gc only to values in generation zero, with a partial index of fact_values where generation=0.  * When doing the first full GC, capture the current set of all fact values with a bloom filter * At subsequent full GCs, compare the set of all fact values with the previous set. If the value was maybe present in the last generation, set it to generation 1. If it definitely wasn't in the last generation, set it to generation 0.     Assumption: - This needs to be in Hoyt release

Add Comment

[Jeff Yarnell (JIRA)]

Jeff Yarnell updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Jeff Yarnell Sprint: Bad Sprint

Add Comment

[Jeff Yarnell (JIRA)]

Jeff Yarnell updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Jeff Yarnell Sprint: Hopper

Add Comment

[Zachary Kent (Jira)]

Zachary Kent updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Zachary Kent Sprint:

Add Comment

This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)

[Zachary Kent (Jira)]

Zachary Kent updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Zachary Kent Sprint: Release Engineering Hopper

Add Comment

[Morgan Rhodes (Jira)]

Morgan Rhodes updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Morgan Rhodes Sprint: Release Engineering Hopper

Add Comment

[Claudia Petty (Jira)]

Claudia Petty updated an issue

PuppetDB / PDB-3624 Generational fact value GC

Change By: Claudia Petty Labels: new-feature

Add Comment

This message was sent by Atlassian Jira (v8.20.21#820021-sha1:38274c8)