Jira (PDB-4635) puppetdb_avg_mem larger than baseline values

0 views
Skip to first unread message

John Duarte (JIRA)

unread,
Jan 23, 2020, 4:25:04 PM1/23/20
to puppe...@googlegroups.com
John Duarte created an issue
 
PuppetDB / Bug PDB-4635
puppetdb_avg_mem larger than baseline values
Issue Type: Bug Bug
Assignee: Unassigned
Created: 2020/01/23 1:24 PM
Priority: Normal Normal
Reporter: John Duarte

Performance comparison runs of recent PE builds for 2019.1 and 2019.3 reveal that PuppetDB in these builds are using more memory than it does in the PE 2018.1.11 baseline. The current threshold for this alert is a variation greater than 10%. Although the 2019.1.4-rc0-228-g062cb5b result is only slightly higher than this threshold, 2019.3.0-rc3-4-ged33755 has reported memory usage 30% higher than the 2018.1.11 baseline.

These results may be indicative of a memory/performance issue with PuppetDB

Link to 2019.1 job

  • 2019.1.4-rc0-228-g062cb5b
    • 2018.1.11 comparison exceeds tolerances:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 695206; result: 768371; variance: 10.52%

Link to 2019.3 job

  • 2019.3.0-rc3-4-ged33755
    • 2018.1.11 comparison exceeds tolerances:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 695206; result: 905635; variance: 30.27%
Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93)
Atlassian logo

Joshua Partlow (JIRA)

unread,
Jan 23, 2020, 4:39:03 PM1/23/20
to puppe...@googlegroups.com

Nick Walker (JIRA)

unread,
Jan 23, 2020, 4:55:04 PM1/23/20
to puppe...@googlegroups.com
Nick Walker commented on Bug PDB-4635

I wouldn't expect a decrease in shared_buffers for postgresql to increase PuppetDB's use of memory.  The tuning PR reduces connections from PuppetDB to postgresql which should lower the memory use by a few megabytes.  The rest of the tuning doesn't apply to a standard install of PE.  

I would expect the difference in 2019.3 to be related to the change to java 11 and the default GC change.  

Austin Blatt (JIRA)

unread,
Feb 4, 2020, 12:03:04 PM2/4/20
to puppe...@googlegroups.com
Austin Blatt commented on Bug PDB-4635

John Duarte was the 2019.3 job using java 11 with the new garbage collector?

John Duarte (JIRA)

unread,
Feb 4, 2020, 12:13:04 PM2/4/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

Austin Blatt, the reported dev build was using Java 11 with the new GC. The variance report failed again on a newer build with the new GC turned off. I will be running this job today with latest dev build and will report back its results.

John Duarte (JIRA)

unread,
Feb 5, 2020, 1:53:06 PM2/5/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

Austin Blatt

Most recent run for 2019.3 (2020.02.04) 12

  • 2019.3.0-rc3-44-ga8baef9
    • 2018.1.12 comparison exceeds tolerances:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 713140; result: 922112; variance: 29.3%

Austin Blatt (JIRA)

unread,
Feb 5, 2020, 2:05:04 PM2/5/20
to puppe...@googlegroups.com
Austin Blatt commented on Bug PDB-4635

Thanks John Duarte I'll let people know and we'll see what we can do.

John Duarte (JIRA)

unread,
Feb 13, 2020, 7:14:04 PM2/13/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

Link to job

  • 2019.4.0-rc3-78-g8ed1026
    • 2018.1.12 comparison exceeds tolerances:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 736287; result: 885135; variance: 20.22%

John Duarte (JIRA)

unread,
Feb 21, 2020, 11:33:06 AM2/21/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-02-17, this tolerance failed when testing recent master build (2019.5.0-rc0-29-gb8100c2) to the LTS baseline (but not STS).

  • 2019.5.0-rc0-29-gb8100c2
    • 2018.1.12 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 739249; result: 913658; variance: 23.59%

John Duarte (JIRA)

unread,
Feb 26, 2020, 11:09:04 AM2/26/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-02-24, this tolerance failed when testing recent PE master build (2019.5.0-rc0-68-gf0a5db6) to the LTS baseline (but not STS).

  • 2019.5.0-rc0-68-gf0a5db6
    • 2018.1.12 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 733145; result: 894072; variance: 21.95%

John Duarte (Jira)

unread,
Mar 4, 2020, 11:52:03 AM3/4/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-03-02, this tolerance failed when testing recent PE master build (2019.5.0-rc0-399-g3d3203b) to the LTS baseline (but not STS).

  • 2019.5.0-rc0-399-g3d3203b
    • 2018.1.12 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 715959; result: 889080; variance: 24.18%
This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)
Atlassian logo

John Duarte (Jira)

unread,
Mar 13, 2020, 1:07:03 PM3/13/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-03-09, this tolerance failed when testing recent PE master build (2019.5.0-rc0-520-gab23aad) to the LTS baseline (but not STS).

  • 2019.5.0-rc0-520-gab23aad
    • 2018.1.13 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 725263; result: 870024; variance: 19.96%

John Duarte (Jira)

unread,
Mar 18, 2020, 10:28:03 AM3/18/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-03-16, this tolerance failed when testing recent PE master build (2019.5.0-rc1-16-gb20eb01) to the LTS baseline (but not STS).

  • 2019.5.0-rc1-16-gb20eb01
    • 2018.1.13 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 714239; result: 905298; variance: 26.75%

John Duarte (Jira)

unread,
Mar 24, 2020, 5:44:03 PM3/24/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-03-23, this tolerance failed when testing recent PE master build (2019.6.0-rc2-16-g099cf6a) to the LTS baseline (but not STS).

  • 2019.6.0-rc2-16-g099cf6a
    • 2018.1.13 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 719128; result: 893042; variance: 24.18%

John Duarte (Jira)

unread,
Apr 1, 2020, 6:48:03 PM4/1/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-03-30, this tolerance failed when testing recent PE master build (2019.6.0-rc2-26-g21f8c4c) to the LTS baseline (but not STS).

  • 2019.6.0-rc2-26-g21f8c4c
    • 2018.1.13 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730773; result: 900104; variance: 23.17%

John Duarte (Jira)

unread,
Apr 7, 2020, 4:57:03 PM4/7/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-04-06, this tolerance failed when testing recent PE master build (2019.7.0-rc0-11-g427cad1) to the LTS baseline (but not STS).

  • 2019.7.0-rc0-11-g427cad1
    • 2018.1.13 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730773; result: 937053; variance: 28.23%

John Duarte (Jira)

unread,
Apr 14, 2020, 1:07:03 PM4/14/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-04-013, this tolerance failed when testing recent PE master build (2019.7.0-rc0-49-g5037017) to the LTS baseline (but not STS).

  • 2019.7.0-rc0-49-g5037017
    • 2018.1.13 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730773; result: 909854; variance: 24.51%

John Duarte (Jira)

unread,
Apr 23, 2020, 10:31:03 AM4/23/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-04-20, this tolerance failed when testing recent PE master build (2019.7.0-rc0-84-gf9ac17e) to the LTS baseline (but not STS).

  • 2019.7.0-rc0-84-gf9ac17e
    • 2018.1.14 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730893; result: 898614; variance: 22.95%

John Duarte (Jira)

unread,
Apr 28, 2020, 10:29:03 AM4/28/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-04-27, this tolerance failed when testing recent PE master build (2019.7.0-rc1-15-gcd7efbb) to the LTS baseline (but not STS).

  • 2019.7.0-rc1-15-gcd7efbb
    • 2018.1.14 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730893; result: 888628; variance: 21.58%

John Duarte (Jira)

unread,
May 5, 2020, 10:15:05 AM5/5/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-05-04, this tolerance failed when testing recent PE master build (2019.8.0-rc0-7-g4277622) to the LTS baseline (but not STS).

  • 2019.8.0-rc0-7-g4277622
    • 2018.1.14 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 730893; result: 894507; variance: 22.39%

John Duarte (Jira)

unread,
May 14, 2020, 10:54:03 AM5/14/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-05-11, this tolerance failed when testing recent PE master build (2019.8.0-rc0-108-ga105716) to the LTS baseline (but not STS).

  • 2019.8.0-rc0-108-ga105716
    • 2018.1.15 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 720443; result: 917625; variance: 27.37%

John Duarte (Jira)

unread,
May 22, 2020, 1:04:03 PM5/22/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-05-18, this tolerance failed when testing recent PE master build (2019.8.0-rc1-17-gf233795) to the LTS baseline (but not STS).

  • 2019.8.0-rc1-17-gf233795
    • 2018.1.15 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 720443; result: 863682; variance: 19.88%

John Duarte (Jira)

unread,
May 26, 2020, 2:01:04 PM5/26/20
to puppe...@googlegroups.com
John Duarte commented on Bug PDB-4635

For the performance comparison run of week 2020-05-25, this tolerance failed when testing recent PE master build (2019.8.0-rc3-5-g3b0d0bc) to the LTS baseline (but not STS).

  • 2019.8.0-rc3-5-g3b0d0bc
    • 2018.1.15 comparison:
      • Result 'process_puppetdb_avg_mem' is outside tolerances: baseline: 720443; result: 889065; variance: 23.41%
Reply all
Reply to author
Forward
0 new messages