Jira (PDB-4892) Summary query for catalog_inputs unecessarily slow

12 views
Skip to first unread message

Austin Blatt (Jira)

unread,
Sep 14, 2020, 7:35:04 PM9/14/20
to puppe...@googlegroups.com
Austin Blatt created an issue
 
PuppetDB / Improvement PDB-4892
Summary query for catalog_inputs unecessarily slow
Issue Type: Improvement Improvement
Affects Versions: PDB 6.9.1
Assignee: Unassigned
Created: 2020/09/14 4:34 PM
Priority: Normal Normal
Reporter: Austin Blatt

The summary query for catalog_inputs unecessarily queries the catalog_inputs table when all of its data is in the certnames table. This results in a summary query that is much more slow than the other groups.

2020-09-11T06:22:53.500Z INFO  [sync]   --> transferred catalogs (0) from https://uklvasapp715.gdc.standardchartered.com:8081/pdb/query/v4/catalogs in 2,960 ms
 
2020-09-11T06:23:02.803Z INFO  [sync]   --> transferred factsets (2) from https://uklvasapp715.gdc.standardchartered.com:8081/pdb/query/v4/factsets in 9,303 ms
 
2020-09-11T06:23:06.081Z INFO  [sync]   --> transferred reports (0) from https://uklvasapp715.gdc.standardchartered.com:8081/pdb/query/v4/reports in 3,277 ms
 
2020-09-11T06:24:09.596Z INFO  [sync]   --> transferred catalog-inputs (0) from https://uklvasapp715.gdc.standardchartered.com:8081/pdb/query/v4/catalog-inputs in 63,515 ms
 
2020-09-11T06:24:11.400Z INFO  [sync]   --> transferred nodes (0) from https://uklvasapp715.gdc.standardchartered.com:8081/pdb/query/v4/nodes in 1,803 ms

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)
Atlassian logo

Austin Blatt (Jira)

unread,
Sep 15, 2020, 2:25:03 PM9/15/20
to puppe...@googlegroups.com
Austin Blatt updated an issue
Change By: Austin Blatt
Epic Link: PDB-4894

Austin Blatt (Jira)

unread,
Sep 15, 2020, 2:26:04 PM9/15/20
to puppe...@googlegroups.com
Austin Blatt assigned an issue to Zachary Kent
Change By: Austin Blatt
Assignee: Zachary Kent

Austin Blatt (Jira)

unread,
Sep 15, 2020, 2:47:03 PM9/15/20
to puppe...@googlegroups.com
Austin Blatt updated an issue
Change By: Austin Blatt
Acceptance Criteria: - Summary query for catalog inputs uses drop joins to only query the {{certnames}} table

Austin Blatt (Jira)

unread,
Sep 15, 2020, 6:01:04 PM9/15/20
to puppe...@googlegroups.com
Austin Blatt updated an issue
The summary query for catalog_inputs unecessarily queries the catalog_inputs table when all of its data is in the {{certnames}} table. This results in a summary query that is much more slow than the other groups.

{code}
2020-09-11T06:22:53.500Z INFO  [sync]   --> transferred catalogs (0) from https:// uklvasapp715.gdc.standardchartered.com <certname> :8081/pdb/query/v4/catalogs in 2,960 ms
2020-09-11T06:23:02.803Z INFO  [sync]   --> transferred factsets (2) from https:// uklvasapp715.gdc.standardchartered.com <certname> :8081/pdb/query/v4/factsets in 9,303 ms
2020-09-11T06:23:06.081Z INFO  [sync]   --> transferred reports (0) from https:// uklvasapp715.gdc.standardchartered.com <certname> :8081/pdb/query/v4/reports in 3,277 ms
2020-09-11T06:24:09.596Z INFO  [sync]   --> transferred catalog-inputs (0) from https:// uklvasapp715.gdc.standardchartered.com <certname> :8081/pdb/query/v4/catalog-inputs in 63,515 ms
2020-09-11T06:24:11.400Z INFO  [sync]   --> transferred nodes (0) from https:// uklvasapp715.gdc.standardchartered.com <certname> :8081/pdb/query/v4/nodes in 1,803 ms
{code}

Zachary Kent (Jira)

unread,
Oct 29, 2020, 4:59:03 PM10/29/20
to puppe...@googlegroups.com
Zachary Kent assigned an issue to Unassigned
Change By: Zachary Kent
Assignee: Zachary Kent

Rob Browning (Jira)

unread,
Nov 16, 2020, 2:25:04 PM11/16/20
to puppe...@googlegroups.com
Rob Browning updated an issue
Change By: Rob Browning
Story Points: 2

Zachary Kent (Jira)

unread,
Nov 18, 2020, 2:33:01 PM11/18/20
to puppe...@googlegroups.com
Zachary Kent commented on Improvement PDB-4892
 
Re: Summary query for catalog_inputs unecessarily slow

Once PDB-4943 is merged and released we should double check a support script to make sure the sync summary queries have improved. 
Reply all
Reply to author
Forward
0 new messages