Jira (PDB-5567) Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

[Joshua Partlow (Jira)]

Joshua Partlow created an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions Issue Type: Improvement Assignee: Unassigned Created: 2022/11/29 1:24 PM Priority: Normal Reporter: Joshua Partlow PDB-5554 intended to improve performance around partition remove by making use of `alter table detach partition concurrently`. But that can only be used with declarative partitions and our partitions are inheritance based. Migrate resource_events and reports partitioning to declarative partitions. https://www.2ndquadrant.com/en/blog/how-to-migrate-from-inheritance-based-partitioning-to-declarative-partitioning-in-postgresql/ is one example. Need to validate that this migration won't have a significant impact on larger databases with a significant number of reports and events. Add Comment

This message was sent by Atlassian Jira (v8.20.11#820011-sha1:0629dd8)

[Joshua Partlow (Jira)]

Joshua Partlow assigned an issue to Joshua Partlow

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Joshua Partlow Assignee: Joshua Partlow

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Joshua Partlow Sprint: Skeletor 12/07/2022

Add Comment

[Nirupama Mantha (Jira)]

Nirupama Mantha updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Nirupama Mantha Story Points: 1

Add Comment

[Sean McDonald (Jira)]

Sean McDonald updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Sean McDonald Sprint: Skeletor 12/07/2022 , Skeletor 12/21/2022

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow commented on PDB-5567

Re: Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions PR is up for some initial review.

Add Comment

[Cas Donoghue (Jira)]

Cas Donoghue updated an issue

PuppetDB / PDB-5567

Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Cas Donoghue Sprint: Skeletor 12/07/2022, Skeletor 12/21/2022 , Skeletor 01/18/2023

Add Comment

[Cas Donoghue (Jira)]

Cas Donoghue updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Cas Donoghue Sprint: Skeletor 12/07/2022, Skeletor 12/21/2022, Skeletor 01/18/2023 , Skeletor 02/01/2023

Add Comment

[Cas Donoghue (Jira)]

Cas Donoghue updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Cas Donoghue Sprint: Skeletor 12/07/2022, Skeletor 12/21/2022, Skeletor 01/18/2023, Skeletor 02/01/2023 , Skeletor 02/15/2023

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow commented on PDB-5567

Re: Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions Charlie Sharpsteen this is the migration ticket supporting PDB-5554 I pinged you about.

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow updated an issue

PuppetDB / PDB-5567

Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Joshua Partlow Release Notes: Enhancement Release Notes Summary: The reports and resource_events tables were migrated to use PostgreSQL declarative partitioning in support of PDB-5554. This changes requires a minimum of PostgreSQL 11.

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions Change By: Joshua Partlow

PDB-5554 intended to improve performance around partition remove by making use of `alter table detach partition concurrently`. But that can only be used with declarative partitions and our partitions are inheritance based.

Migrate resource_events and reports partitioning to [declarative partitions|https://www.postgresql.org/docs/current/ddl-partitioning.html]. [https://www.2ndquadrant.com/en/blog/how-to-migrate-from-inheritance-based-partitioning-to-declarative-partitioning-in-postgresql/] is one example.

Need to validate that this migration won't have a significant impact on larger databases with a significant number of reports and events.

NOTE: The minimum PostgreSQL version is now 11 with these migrations.

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions Change By: Joshua Partlow

PDB-5554 intended to improve performance around partition remove by making use of `alter table detach partition concurrently`. But that can only be used with declarative partitions and our partitions are inheritance based. Migrate resource_events and reports partitioning to [declarative partitions|https://www.postgresql.org/docs/current/ddl-partitioning.html]. [https://www.2ndquadrant.com/en/blog/how-to-migrate-from-inheritance-based-partitioning-to-declarative-partitioning-in-postgresql/] is one example. Need to validate that this migration won't have a significant impact on larger databases with a significant number of reports and events.

NOTE: * The minimum PostgreSQL version is now 11 with these migrations. *

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow commented on PDB-5567

Re: Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions This is in 2021.7.3-rc1-41-g502f631, and 2023.1.0-rc1-51-ga570859, both of which have gone through nightly PE integration CI. There are some 2021.7 failures that look to be scattered, unrelated abs/vmpooler allocation or connectivity type errors.

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow updated an issue

PuppetDB / PDB-5567

Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Joshua Partlow Labels: docs

Add Comment

[Joshua Partlow (Jira)]

Joshua Partlow updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Joshua Partlow Fix Version/s: PDB 7.12.2 Fix Version/s: PDB 8.0.0

Add Comment

[Jonathan Newman (Jira)]

Jonathan Newman updated an issue

PuppetDB / PDB-5567 Migrate PDB reports and resource_events inheritance based partitions to postgresql declarative partitions

Change By: Jonathan Newman Fix Version/s: PDB 7.12.2 Fix Version/s: PDB 7.13.0

Add Comment