Jira (PUP-10141) Puppetserver 3-4 times more overloaded after upgrade from 5.3 to 6.7.1

1 view
Skip to first unread message

Atanas Stoyanov (JIRA)

unread,
Nov 15, 2019, 4:19:04 AM11/15/19
to puppe...@googlegroups.com
Atanas Stoyanov created an issue
 
Puppet / Bug PUP-10141
Puppetserver 3-4 times more overloaded after upgrade from 5.3 to 6.7.1
Issue Type: Bug Bug
Affects Versions: PUP 6.10.1
Assignee: Unassigned
Attachments: Screenshot 2019-11-15 at 09.32.35.png, Screenshot 2019-11-15 at 09.32.40.png, Screenshot 2019-11-15 at 09.32.49.png, Screenshot 2019-11-15 at 10.17.18.png
Components: Compiler
Created: 2019/11/15 1:18 AM
Priority: Normal Normal
Reporter: Atanas Stoyanov

Puppet Version: 6.10.1
Puppet Server Version: 6.7.1
OS Name/Version: Ubuntu Bionic

We have a puppet environment of 3 masters and ~250 clients. One of the masters is also serving CA. We have a HA setup with srv records. When we push our puppet code to our internal git, it gets pushed to the puppet masters and there we have different environments depending on the branch.

Once we upgraded from puppetserver 5.3 to 6.7.1 the servers started to eat up all the server memory and occasionally die, thus we had to add more ram and CPUs to the VMs, where they are running. The CPU usage of the 3 masters also spiked a lot (see graphs). Also on the clients we noticed a signifficant slowdown in the puppet agent -t, which we assume is caused by the slow catalog compilation on the masters. The client's CPU usage, Memory usage and other stats except for the puppet run time seem unchanged. puppetserver.log does not contain any errors. On the attached images can be clearly seen when the upgrade was performed on 12.11.2019 ~ 11:00

Desired Behavior:

Make puppetserver run smooth again

 

Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93)
Atlassian logo
Reply all
Reply to author
Forward
0 new messages