Jira (PDB-5592) Generating catalog data

0 views
Skip to the first unread message

Austin Blatt (Jira)

unread,
13 Feb 2023, 12:26:0113/02/2023
to puppe...@googlegroups.com
Austin Blatt created an issue
 
PuppetDB / New Feature PDB-5592
Generating catalog data
Issue Type: New Feature New Feature
Assignee: Unassigned
Created: 2023/02/13 9:25 AM
Priority: Normal Normal
Reporter: Austin Blatt
  • Number of classes (correlates to "source files" in a control-repo)
  • Number of resources
  • Number of resources
  • Size of title string (this is indexed for queries, so its size is important)
  • Total size of Catalog
  • "Depth" of ordering edge DAG
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v8.20.11#820011-sha1:0629dd8)
Atlassian logo

Joshua Partlow (Jira)

unread,
16 Feb 2023, 15:47:0316/02/2023
to puppe...@googlegroups.com
Joshua Partlow updated an issue
Change By: Joshua Partlow
- Number of classes (correlates to "source files" in a control-repo)
- Number of resources
-
Number of resources
-
Size of title string (this is indexed for queries, so its size is important)
- Total size of Catalog
- "Depth" of ordering edge DAG

Joshua Partlow (Jira)

unread,
28 Feb 2023, 12:43:0228/02/2023
to puppe...@googlegroups.com
Joshua Partlow assigned an issue to Joshua Partlow
Change By: Joshua Partlow
Assignee: Joshua Partlow

Joshua Partlow (Jira)

unread,
28 Feb 2023, 12:44:0128/02/2023
to puppe...@googlegroups.com
Joshua Partlow updated an issue
Change By: Joshua Partlow
Story Points: 1

Joshua Partlow (Jira)

unread,
28 Feb 2023, 12:45:0228/02/2023
to puppe...@googlegroups.com
Joshua Partlow updated an issue
Change By: Joshua Partlow
Sprint: Skeletor 03/01/2023

Cas Donoghue (Jira)

unread,
1 Mar 2023, 14:11:0101/03/2023
to puppe...@googlegroups.com
Cas Donoghue updated an issue
Change By: Cas Donoghue
Sprint: Skeletor 03/01/2023 , Skeletor 03/15/2023

Joshua Partlow (Jira)

unread,
3 Mar 2023, 15:54:0203/03/2023
to puppe...@googlegroups.com
Joshua Partlow commented on New Feature PDB-5592
 
Re: Generating catalog data

Austin Blatt for total catalog size, are we talking kb mb gb? Based on a really large number of resources (so instead of setting num-resources)? Based on adding something like large content blobs to File resources? Something else?

For edge depth, I figure we are talking here about the deepest nesting, as, for example, class->class->defined type->resource. Are there queries in pdb that reconstruct those relations?

Austin Blatt (Jira)

unread,
6 Mar 2023, 17:47:0106/03/2023
to puppe...@googlegroups.com
Austin Blatt commented on New Feature PDB-5592
 
Re: Generating catalog data

I think I was likely just thinking we need a way to control the output size, and for this first pass we can just focus on one. Since the PR has function args for for number of resources, and their sizes I think it's ok if total catalog size is an "output" rather than a specific configurable variable.

I had totally forgotten about the "contains" edge... that's likely to be the dominant edge size I'll spin up a PE to check. I was thinking of depth as, there might be a difference between 9 edges as "resources 2 through 10 require resource 1" vs. 9 edges as "resource 1 thru 10 all require the previous resource".

If contains is the dominant edge size, and there's no way to query for "depth", then it may only be edge number that matters and the other types are (at least for now) unnecessary.

I am not that familiar with how defined types are modeled in Puppet, but there's no version of a defined type in PuppetDB afaik, so it is likely a Class (I think...). Type and Title are likely the two most important "sizes" since they are indexed together, so yeah the length of a defined type's namespace could be important to model.

Cas Donoghue (Jira)

unread,
15 Mar 2023, 14:23:0315/03/2023
to puppe...@googlegroups.com
Cas Donoghue updated an issue
Change By: Cas Donoghue
Sprint: Skeletor 03/01/2023, Skeletor 03/15/2023 , Skeletor 03/29/2023

Cas Donoghue (Jira)

unread,
29 Mar 2023, 14:20:0129/03/2023
to puppe...@googlegroups.com
Cas Donoghue updated an issue
Change By: Cas Donoghue
Sprint: Skeletor 03/01/2023, Skeletor 03/15/2023, Skeletor 03/29/2023 , Skeletor 04/12/2023

Jason Dennis (Jira)

unread,
4 Apr 2023, 16:26:0104/04/2023
to puppe...@googlegroups.com
Jason Dennis updated an issue
Change By: Jason Dennis
Labels: 23Q2

Joshua Partlow (Jira)

unread,
12 Apr 2023, 13:10:0312/04/2023
to puppe...@googlegroups.com
Joshua Partlow updated an issue
Change By: Joshua Partlow
Fix Version/s: PDB 8.0.0

Claudia Petty (Jira)

unread,
21 Jun 2023, 10:57:0921/06/2023
to puppe...@googlegroups.com
Claudia Petty updated an issue
Change By: Claudia Petty
Labels: 23Q2 new-feature
This message was sent by Atlassian Jira (v8.20.21#820021-sha1:38274c8)
Atlassian logo
Reply all
Reply to author
Forward
0 new messages