Jira (PDB-5260) Improve PQL parse performance with high number of filter clauses

11 views
Skip to first unread message

David McTavish (Jira)

unread,
Mar 23, 2022, 12:51:01 PM3/23/22
to puppe...@googlegroups.com
David McTavish updated an issue
 
PuppetDB / Improvement PDB-5260
Improve PQL parse performance with high number of filter clauses
Change By: David McTavish
Summary: Fix Improve PQL parse performance problems with high number of filter clauses
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v8.20.2#820002-sha1:829506d)
Atlassian logo

Rob Browning (Jira)

unread,
Mar 31, 2022, 7:25:01 PM3/31/22
to puppe...@googlegroups.com

Rob Browning (Jira)

unread,
Apr 4, 2022, 2:30:02 PM4/4/22
to puppe...@googlegroups.com
Rob Browning updated an issue
Change By: Rob Browning
Fix Version/s: PDB 7.10.1
Fix Version/s: PDB 6.20.3
Release Notes: Bug Fix
Release Notes Summary: PuppetDB should require much less time and memory when parsing some PQL queries, , for example queries including many or clauses like `nodes {x or y or ...}`.  Previously 5000 clauses could not be parsed with an 8GB heap, and much smaller queries still required exorbitant amounts of memory and CPU time.

Rob Browning (Jira)

unread,
Jul 28, 2022, 1:26:01 PM7/28/22
to puppe...@googlegroups.com
Rob Browning commented on Improvement PDB-5260
 
Re: Improve PQL parse performance with high number of filter clauses

Just to record this here, another case that if relevant might nudge us toward fixing it more comprehensively is any situations where we accept user pql or user pql fragments (from some ui) that we combine into a broader query.

This message was sent by Atlassian Jira (v8.20.11#820011-sha1:0629dd8)
Atlassian logo

Rob Browning (Jira)

unread,
Jul 28, 2022, 1:27:03 PM7/28/22
to puppe...@googlegroups.com
Rob Browning commented on Improvement PDB-5260

Oh, and also we did address the earlier, immediate problem by rewriting some of the production rules – was sufficient for at least that case.

Reply all
Reply to author
Forward
0 new messages