Jira (PDB-5131) Enable drop joins by default

0 views
Skip to first unread message

Austin Blatt (Jira)

unread,
May 18, 2021, 6:42:05 PM5/18/21
to puppe...@googlegroups.com
Austin Blatt created an issue
 
PuppetDB / Improvement PDB-5131
Enable drop joins by default
Issue Type: Improvement Improvement
Assignee: Unassigned
Created: 2021/05/18 3:41 PM
Priority: Normal Normal
Reporter: Austin Blatt

Drop joins has shown that it can significantly speed up nodes queries, so we should enable it by default for that entity. We should test that drop joins can be disabled, so that users can back out of this change if they encounter errors. Initially this will target main so that 6.x will be more stable. If it proves stable, we may backport it later.

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97)
Atlassian logo

Austin Blatt (Jira)

unread,
May 19, 2021, 2:20:04 PM5/19/21
to puppe...@googlegroups.com
Austin Blatt updated an issue
Change By: Austin Blatt
Epic Link: PE-31891

Zachary Kent (Jira)

unread,
May 19, 2021, 2:27:02 PM5/19/21
to puppe...@googlegroups.com
Zachary Kent updated an issue
Change By: Zachary Kent
Story Points: 1

Zachary Kent (Jira)

unread,
May 19, 2021, 2:28:04 PM5/19/21
to puppe...@googlegroups.com
Zachary Kent commented on Improvement PDB-5131
 
Re: Enable drop joins by default

only do this in 7 to start

Zachary Kent (Jira)

unread,
May 19, 2021, 2:28:04 PM5/19/21
to puppe...@googlegroups.com
Zachary Kent updated an issue
Change By: Zachary Kent
Sprint: HAHA/Grooming HA 2021-06-02

Zachary Kent (Jira)

unread,
May 24, 2021, 10:15:01 AM5/24/21
to puppe...@googlegroups.com
Zachary Kent assigned an issue to Zachary Kent
Change By: Zachary Kent
Assignee: Zachary Kent

Eric Thompson (Jira)

unread,
Jun 2, 2021, 2:20:03 PM6/2/21
to puppe...@googlegroups.com
Eric Thompson updated an issue
Change By: Eric Thompson
Sprint: HA 2021-06-02 , HA 2021-06-16

Eric Thompson (Jira)

unread,
Jun 2, 2021, 2:23:01 PM6/2/21
to puppe...@googlegroups.com
Eric Thompson updated an issue
Change By: Eric Thompson
Sprint: HA 2021-06-02 HAHA/Grooming , HA 2021-06- 16 02

Carl Caum (Jira)

unread,
Jun 2, 2021, 2:41:02 PM6/2/21
to puppe...@googlegroups.com
Carl Caum commented on Improvement PDB-5131
 
Re: Enable drop joins by default

Aidan Nathanson FYI on this work. It will significantly increase the performance of many PuppetDB queries, but it does introduce minimal potential risk of breaking some existing queries. The rollout plan is the following:
1) Turn it on by default in open source PuppetDB 7
2) Once it's baked in 7 for a while, it will be turned on by default in open source PuppetDB 6
3) Turn it on by default for the next PE release

If customers run into issues as a result of this change, it can be turned off per customer following these instructions: https://puppet.com/docs/puppetdb/latest/api/query/v4/query.html#experimental-query-optimization

Prior to rolling it out in PE, CS will need to be made aware of this change and Support specifically will need to know how to turn it off if they receive support issues about it.

Austin Blatt (Jira)

unread,
Jun 30, 2021, 4:28:02 PM6/30/21
to puppe...@googlegroups.com
Austin Blatt updated an issue
 
Change By: Austin Blatt
Sprint: HAHA/Grooming, HA 2021-06-02 , HA 2021-07-14

Austin Blatt (Jira)

unread,
Jun 30, 2021, 4:29:02 PM6/30/21
to puppe...@googlegroups.com
Austin Blatt assigned an issue to Unassigned
Change By: Austin Blatt
Assignee: Zachary Kent

Rob Browning (Jira)

unread,
Jul 6, 2021, 11:48:02 AM7/6/21
to puppe...@googlegroups.com
Rob Browning assigned an issue to Rob Browning
Change By: Rob Browning
Assignee: Rob Browning

Eric Thompson (Jira)

unread,
Jul 7, 2021, 1:26:03 PM7/7/21
to puppe...@googlegroups.com
Eric Thompson updated an issue
Change By: Eric Thompson
Labels: 2021-o1-kr2

Carl Caum (Jira)

unread,
Jul 8, 2021, 12:48:03 PM7/8/21
to puppe...@googlegroups.com
Carl Caum commented on Improvement PDB-5131
 
Re: Enable drop joins by default

Zachary Kent Do we have any idea of what query failures from this will look like? I want to make sure we have a knowledge base article to identify issues that might arise from this and point to the docs to turn it off.

Austin Blatt (Jira)

unread,
Jul 12, 2021, 11:01:02 AM7/12/21
to puppe...@googlegroups.com
Austin Blatt updated an issue
 
Change By: Austin Blatt
Fix Version/s: PDB 7.5.0

Austin Blatt (Jira)

unread,
Jul 12, 2021, 11:05:02 AM7/12/21
to puppe...@googlegroups.com
Austin Blatt updated an issue
Change By: Austin Blatt
Release Notes: Enhancement

Rob Browning (Jira)

unread,
Jul 19, 2021, 3:57:03 PM7/19/21
to puppe...@googlegroups.com
Rob Browning updated an issue
Change By: Rob Browning
Release Notes: Enhancement
Release Notes Summary: The query optimizer https://puppet.com/docs/puppetdb/latest/api/query/v4/query.html#experimental-query-optimization that attempts to drop unneeded joins is now enabled by default, but that can be changed by setting the PDB_QUERY_OPTIMIZE_DROP_UNUSED_JOINS environment variable.
Reply all
Reply to author
Forward
0 new messages