Jira (PUP-10351) Puppet Agent fails to self-restart on config change or update

1 view
Skip to first unread message

Josh Cooper (Jira)

unread,
Mar 4, 2020, 10:20:04 AM3/4/20
to puppe...@googlegroups.com
Josh Cooper moved an issue
 
Puppet / Bug PUP-10351
Puppet Agent fails to self-restart on config change or update
Change By: Josh Cooper
Key: PA PUP - 3165 10351
Affects Version/s: puppet-agent 6.13.0
Affects Version/s: puppet-agent 6.12.0
Affects Version/s: puppet-agent 6.11.0
Affects Version/s: puppet-agent 6.10.1
Project: Puppet Agent
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)
Atlassian logo

Josh Cooper (Jira)

unread,
Mar 4, 2020, 10:21:03 AM3/4/20
to puppe...@googlegroups.com
Josh Cooper updated an issue
Change By: Josh Cooper
Affects Version/s: PUP 6.13.0
Affects Version/s: PUP 6.10.1
Affects Version/s: PUP 6.11.0
Affects Version/s: PUP 6.12.0

Josh Cooper (Jira)

unread,
Mar 4, 2020, 12:55:03 PM3/4/20
to puppe...@googlegroups.com
Josh Cooper commented on Bug PUP-10351
 
Re: Puppet Agent fails to self-restart on config change or update

I cannot reproduce this using nightly puppet-agent in cases where I send it HUP, USR1 or edit puppet.conf. This may have been fixed by the state pidfile detection correctly handling LWP on Linux. See PUP-10218.

root@worse-mandate:~# puppet resource package puppet-agent
 
package { 'puppet-agent':
 
  ensure   => '6.13.0.111.g401fef03-1xenial',
 
  provider => 'apt',
 
}
 
# systemctl status puppet
 
● puppet.service - Puppet agent
 
   Loaded: loaded (/lib/systemd/system/puppet.service; enabled; vendor preset: enabled)
 
   Active: active (running) since Wed 2020-03-04 17:46:55 UTC; 4min 54s ago
 
 Main PID: 2165 (puppet)
 
   CGroup: /system.slice/puppet.service
 
           └─2165 /opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent --no-daemonize
 
 
 
Mar 04 17:49:26 worse-mandate puppet-agent[2165]: Caught HUP; storing restart
 
Mar 04 17:49:27 worse-mandate puppet-agent[2165]: Processing restart
 
Mar 04 17:49:27 worse-mandate puppet-agent[2165]: Puppet::Agent::Locker.running? is deprecated as it is inherently unsafe. The only safe way to know if the lock is locked is
 
Mar 04 17:49:27 worse-mandate puppet-agent[2165]:    (location: /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/agent/locker.rb:37:in `running?')
 
Mar 04 17:49:27 worse-mandate puppet-agent[2165]: Restarting with '/opt/puppetlabs/puppet/bin/puppet agent --no-daemonize'
 
Mar 04 17:49:28 worse-mandate puppet-agent[2165]: Starting Puppet client version 6.14.0
 
Mar 04 17:49:29 worse-mandate puppet-agent[2351]: Applied catalog in 0.02 seconds
 
Mar 04 17:49:46 worse-mandate puppet-agent[2165]: Caught USR1; storing reload
 
Mar 04 17:49:48 worse-mandate puppet-agent[2165]: Processing reload
 
Mar 04 17:49:49 worse-mandate puppet-agent[2411]: Applied catalog in 0.02 seconds

Frank Wall can you confirm with puppet-agent builds from nightly using the "puppet6-night-release-*" package?

Josh Cooper (Jira)

unread,
Mar 4, 2020, 12:55:03 PM3/4/20
to puppe...@googlegroups.com
Josh Cooper updated an issue
Change By: Josh Cooper
Epic Link: PUP-7532

Josh Cooper (Jira)

unread,
Mar 4, 2020, 12:55:04 PM3/4/20
to puppe...@googlegroups.com
Josh Cooper updated an issue
Change By: Josh Cooper
Team: Night's Watch

Mihai Buzgau (Jira)

unread,
Mar 18, 2020, 5:28:03 AM3/18/20
to puppe...@googlegroups.com
Mihai Buzgau updated an issue
Change By: Mihai Buzgau
Sprint: PR NW - Triage 2020-04-01

Mihai Buzgau (Jira)

unread,
Mar 18, 2020, 5:28:04 AM3/18/20
to puppe...@googlegroups.com
Mihai Buzgau updated an issue
Change By: Mihai Buzgau
Story Points: 2

Nick Maludy (Jira)

unread,
Mar 23, 2020, 9:41:03 AM3/23/20
to puppe...@googlegroups.com
Nick Maludy commented on Bug PUP-10351
 
Re: Puppet Agent fails to self-restart on config change or update

I'm seeing this on 6.13.0

Would love to help debug this is possible! Any steps i can do debug this?

Luchian Nemes (Jira)

unread,
Mar 30, 2020, 3:54:03 AM3/30/20
to puppe...@googlegroups.com
Luchian Nemes assigned an issue to Luchian Nemes
 
Change By: Luchian Nemes
Assignee: Luchian Nemes

Nick Maludy (Jira)

unread,
Mar 30, 2020, 12:42:04 PM3/30/20
to puppe...@googlegroups.com
Nick Maludy commented on Bug PUP-10351
 
Re: Puppet Agent fails to self-restart on config change or update

FYI  manually restarting the Puppet service seems to fix the problem.

Josh Cooper (Jira)

unread,
Mar 30, 2020, 1:02:04 PM3/30/20
to puppe...@googlegroups.com
Josh Cooper commented on Bug PUP-10351

Ah I tested using ubuntu xenial but I see the report is for CentOS 7.7.1908.  Nick Maludy are you using that centos too?

Nick Maludy (Jira)

unread,
Mar 30, 2020, 1:08:04 PM3/30/20
to puppe...@googlegroups.com
Nick Maludy commented on Bug PUP-10351

I'm using both RHEL 7.7 and CentOS 7.7, yes.

Luchian Nemes (Jira)

unread,
Mar 31, 2020, 5:28:03 AM3/31/20
to puppe...@googlegroups.com

Nick Maludy/Frank Wall, could you please provide us the exact steps you're taking to reproduce/get to this state on a clean os? (manifests are also very welcomed)

Mihai Buzgau (Jira)

unread,
Apr 1, 2020, 3:51:03 AM4/1/20
to puppe...@googlegroups.com
Mihai Buzgau updated an issue
Change By: Mihai Buzgau
Sprint: NW - 2020-04-01 , NW - 2020-04-15

Mihai Buzgau (Jira)

unread,
Apr 7, 2020, 1:59:04 AM4/7/20
to puppe...@googlegroups.com
Mihai Buzgau commented on Bug PUP-10351
 
Re: Puppet Agent fails to self-restart on config change or update

HUP is sent to the puppet agent process whenever a service reload is issued. We were able  to get a similar log to the one in this ticket by using the following manifests in an agent server environment:

 

class systemd::daemon_reload {
 
exec { '/usr/bin/systemctl reload puppet':
 
 refreshonly => true,
 
 }
 
exec { '/usr/bin/systemctl daemon-reload':
 
 refreshonly => true,
 
 }
 
} 

$str = "[main]                                                                                                                                                                                                                               server = myhost                                                                                                                                                                                                                                                                                                                                                                                       runinterval = 60                                                                                                                                                                                                                             log_level = info                                                                                                                                                                                                                             # This file can be used to override the default puppet settings.                                                                                                                                                                             # See the following links for more details on what settings are available:                                                                                                                                                                   # - https://puppet.com/docs/puppet/latest/config_important_settings.html                                                                                                                                                                     # - https://puppet.com/docs/puppet/latest/config_about_settings.html                                                                                                                                                                         # - https://puppet.com/docs/puppet/latest/config_file_main.html                                                                                                                                                                              # - https://puppet.com/docs/puppet/latest/configuration.html                                                                                                                                                                                 "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           file { '/etc/puppetlabs/puppet/puppet.conf' :                                                                                                                                                                                                  content => $str,                                                                                                                                                                                                                             notify => Class['systemd::daemon_reload'],                                                                                                                                                                                                                                                                                                                                                                                                   }                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       include ::systemd::daemon_reload

Also tried using schedule puppet resource:

schedule { 'painst':
 
  period => hourly,
 
  repeat => 20,
 
}
 
exec { '/bin/rpm -i --force /home/vagrant/pa14.rpm':
 
  schedule => 'painst',
 
  notify => Class['systemd::daemon_reload'],
 
}

 

In both cases, the Puppet Agent process was successfully started. 

We've tested this on a  RedHat 7 master with a CentOS 7.7 Agent

Nick Maludy / Frank Wall can you provide any pointers on how to reproduce this?

Tim Meusel (Jira)

unread,
Apr 20, 2020, 3:01:04 AM4/20/20
to puppe...@googlegroups.com
Tim Meusel commented on Bug PUP-10351

Hello people, I see this error on multiple nodes in my environment, at the moment all of them are running puppet 6.12.0 and 6.14.0:

Apr 09 12:03:19  puppet-agent[27550]: Starting Puppet client version 6.12.0
 
Apr 09 12:03:19  puppet-agent[27550]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Apr 09 12:03:19  systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Apr 09 12:03:19  systemd[1]: Unit puppet.service entered failed state.
 
Apr 09 12:03:19  systemd[1]: puppet.service failed.
 
Apr 09 12:03:23  puppet-agent[21586]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Apr 09 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 10 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 11 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 12 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 13 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 18:00:48  systemd[1]: Started Puppet agent.
 
Apr 14 18:00:51  puppet-agent[25047]: Starting Puppet client version 6.14.0
 
Apr 14 18:00:51  puppet-agent[25047]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Apr 14 18:00:51  systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Apr 14 18:00:51  systemd[1]: Unit puppet.service entered failed state.
 
Apr 14 18:00:51  systemd[1]: puppet.service failed.
 
Apr 14 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 14 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 15 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 16 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 17 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 18 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 09:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 11:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 13:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 15:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 17:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 19:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 21:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 19 23:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 20 01:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 20 03:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 20 05:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 20 07:59:35  puppet-agent[21586]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 20 08:53:11  puppet-agent[21586]: Caught TERM; exiting
 
Apr 20 08:54:25  systemd[1]: Started Puppet agent.
 
Apr 20 08:54:28  puppet-agent[21212]: Starting Puppet client version 6.14.0

I killed the agent twice and started it by hand in my shell. That agent run worked. I assume a change modified the puppet.conf and afterwards the agent seems to fail. I'm not really sure how I can debug this properly. Let me know if you've any suggestions.

Tim Meusel (Jira)

unread,
Apr 20, 2020, 3:50:04 AM4/20/20
to puppe...@googlegroups.com
Tim Meusel commented on Bug PUP-10351

I thought to try something new and noticed that I could just start the agent on the cmdline, if the daemon logs `Shutdown/restart in progress (:restart_requested); skipping run`. At least on this box it wasn't required to kill the agent.

Mihai Buzgau (Jira)

unread,
Apr 20, 2020, 5:04:03 AM4/20/20
to puppe...@googlegroups.com
Mihai Buzgau commented on Bug PUP-10351

Tim Meusel can you paste the log before the first lock started happening?

Can you also provide more information about your environment (eg. are you using PE)? 

Do you have an insight about what changed that triggered the puppet agent restart, did you upgrade the puppet agent version, what configuration changed?

It would be great if you could set your log_level to debug and post the full log of an affected node.

Can you provide information about your environment (Mater OS, Agent OS)

Are you using any specific module to manage the Puppet Agent configuration?

 

Tim Meusel (Jira)

unread,
Apr 20, 2020, 9:33:05 AM4/20/20
to puppe...@googlegroups.com
Tim Meusel commented on Bug PUP-10351

box one (I've multiple of those, they all have in common the log entry 'Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files'):

root ~ # puppet --version; facter -p os
 
6.13.0
 
{
 
  architecture => "x86_64",
 
  family => "Archlinux",
 
  hardware => "x86_64",
 
  name => "Archlinux",
 
  release => {
 
    full => "5.3.7.b-2-hardened",
 
    major => "5",
 
    minor => "3"
 
  },
 
  selinux => {
 
    enabled => false
 
  }
 
}
 
root ~ #

Puppet log that I could find:

Apr 09 11:30:21 puppet-agent[1851375]: Failed to apply catalog: no parameter named 'ensure'
 
Apr 09 11:30:21 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/file_system/uniquefile.rb:127: warning: $SAFE will become a normal global variable in Ruby 3.0
 
Apr 09 11:30:21 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/file_system/uniquefile.rb:127: warning: $SAFE will become a normal global variable in Ruby 3.0
 
Apr 09 11:30:21 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent.rb:98:in `exit': no implicit conversion from nil to integer (TypeError)
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent.rb:98:in `block in run_in_fork'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent.rb:94:in `fork'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent.rb:94:in `run_in_fork'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent.rb:48:in `block in run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/application.rb:179:in `controlled_run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent.rb:46:in `run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/daemon.rb:171:in `block in run_event_loop'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/scheduler/job.rb:49:in `run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/scheduler/scheduler.rb:39:in `block in run_ready'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/scheduler/scheduler.rb:34:in `each'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/scheduler/scheduler.rb:34:in `run_ready'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/scheduler/scheduler.rb:11:in `run_loop'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/daemon.rb:194:in `run_event_loop'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/daemon.rb:150:in `start'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/application/agent.rb:428:in `main'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/application/agent.rb:372:in `block in run_command'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/context.rb:62:in `override'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet.rb:274:in `override'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/application/agent.rb:368:in `run_command'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/application.rb:382:in `block in run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/util.rb:710:in `exit_on_fail'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/application.rb:382:in `run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/util/command_line.rb:143:in `run'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/lib/ruby/vendor_ruby/2.7.0/puppet/util/command_line.rb:77:in `execute'
 
Apr 09 11:30:21 puppet[1384654]:         from /usr/bin/puppet:5:in `<main>'
 
Apr 09 11:59:59 systemd[1]: Reloading Puppet agent.
 
Apr 09 12:00:00 systemd[1]: Reloaded Puppet agent.
 
Apr 09 12:00:00 puppet-agent[1384654]: Caught HUP; storing restart
 
Apr 09 12:00:03 puppet-agent[1384654]: Processing restart
 
Apr 09 12:00:03 puppet-agent[1384654]: Puppet::Agent::Locker.running? is deprecated as it is inherently unsafe. The only safe way to know if the lock is locked is to try lock and perform some action and then handle the LockError that may result.
 
Apr 09 12:00:03 puppet-agent[1384654]:    (location: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/agent/locker.rb:37:in `running?')
 
Apr 09 12:00:07 puppet-agent[1384654]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Apr 09 12:00:07 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/file_system/file_impl.rb:83: warning: Using the last argument as keyword parameters is deprecated
 
Apr 09 12:00:07 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/util.rb:316: warning: deprecated Object#=~ is called on Puppet::Transaction::Report; it always returns nil
 
Apr 09 12:00:07 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/type.rb:746: warning: Using the last argument as keyword parameters is deprecated; maybe ** should be added to the call
 
Apr 09 12:00:07 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/transaction/event.rb:25: warning: The called method `initialize' is defined here
 
Apr 09 12:00:22 puppet-agent[1384654]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Apr 09 12:00:22 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/file_system/file_impl.rb:83: warning: Using the last argument as keyword parameters is deprecated
 
Apr 09 12:00:22 puppet[1384654]: /usr/lib/ruby/vendor_ruby/2.7.0/puppet/util.rb:316: warning: deprecated Object#=~ is called on Puppet::Transaction::Report; it always returns nil
 
Apr 09 13:29:56 puppet-agent[1384654]: Shutdown/restart in progress (:restart_requested); skipping run

This agent runs with system ruby:

ruby 2.7.0p0 (2019-12-25 revision 647ee6f091) [x86_64-linux]

box two:

# facter -p os
 
{
 
  architecture => "x86_64",
 
  family => "RedHat",
 
  hardware => "x86_64",
 
  name => "CentOS",
 
  release => {
 
    full => "7.7.1908",
 
    major => "7",
 
    minor => "7"
 
  },
 
  selinux => {
 
    config_mode => "permissive",
 
    config_policy => "targeted",
 
    current_mode => "permissive",
 
    enabled => true,
 
    enforced => false,
 
    policy_version => "31"
 
  }
 
}
 
# puppet --version
 
6.14.0

agent log file

Nov 07 14:27:14 puppet-agent[22931]: Applied catalog in 29.27 seconds
 
Nov 07 14:38:56 systemd[1]: Stopping SYSV: Enables periodic system configuration checks through puppet....
 
Nov 07 14:38:56 puppet-agent[985]: Caught TERM; exiting
 
Nov 07 14:38:56 puppet[23735]: Stopping puppet agent: [  OK  ]
 
Nov 07 14:38:56 systemd[1]: Starting SYSV: Enables periodic system configuration checks through puppet....
 
Nov 07 14:38:59 puppet-agent[23767]: Reopening log files
 
Nov 07 14:38:59 puppet-agent[23767]: Starting Puppet client version 6.10.1
 
Nov 07 14:38:59 puppet[23751]: Starting puppet agent: [  OK  ]
 
Nov 07 14:38:59 systemd[1]: Started SYSV: Enables periodic system configuration checks through puppet..
 
Nov 07 14:41:44 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Nov 07 14:41:59 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Nov 07 14:50:16 puppet-agent[23767]: Caught HUP; storing restart
 
Nov 07 14:50:16 puppet[8466]: Reloading puppet agent: [  OK  ]
 
Nov 07 14:50:16 systemd[1]: Reloaded SYSV: Enables periodic system configuration checks through puppet..
 
Nov 07 14:50:17 puppet-agent[23767]: Processing restart
 
Nov 07 14:50:17 puppet-agent[23767]: Puppet::Agent::Locker.running? is deprecated as it is inherently unsafe. The only safe way to know if the lock is locked is to try lock and perform some action and then handle the LockError that may result.
 
Nov 07 14:50:17 puppet-agent[23767]:    (location: /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/agent/locker.rb:37:in `running?')
 
Nov 07 14:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Nov 07 17:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{logline repeats}
 
Jan 16 14:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 16 16:28:25 systemd[1]: Stopping SYSV: Enables periodic system configuration checks through puppet....
 
Jan 16 16:28:25 systemd[1]: puppet.service: control process exited, code=exited status=203
 
Jan 16 16:28:25 systemd[1]: Stopped SYSV: Enables periodic system configuration checks through puppet..
 
Jan 16 16:28:25 systemd[1]: Unit puppet.service entered failed state.
 
Jan 16 16:28:25 systemd[1]: puppet.service failed.
 
Jan 16 16:28:25 systemd[1]: Starting SYSV: Enables periodic system configuration checks through puppet....
 
Jan 16 16:28:25 systemd[1]: puppet.service: control process exited, code=exited status=203
 
Jan 16 16:28:25 systemd[1]: Failed to start SYSV: Enables periodic system configuration checks through puppet..
 
Jan 16 16:28:25 systemd[1]: Unit puppet.service entered failed state.
 
Jan 16 16:28:25 systemd[1]: puppet.service failed.
 
Jan 16 16:31:03 systemd[1]: Started Puppet agent.
 
Jan 16 16:31:06 puppet-agent[5918]: Starting Puppet client version 6.12.0
 
Jan 16 16:31:06 puppet-agent[5918]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Jan 16 16:31:06 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Jan 16 16:31:06 systemd[1]: Unit puppet.service entered failed state.
 
Jan 16 16:31:06 systemd[1]: puppet.service failed.
 
Jan 16 16:32:34 systemd[1]: Started Puppet agent.
 
Jan 16 16:32:37 puppet-agent[7062]: Starting Puppet client version 6.12.0
 
Jan 16 16:32:37 puppet-agent[7062]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Jan 16 16:32:37 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Jan 16 16:32:37 systemd[1]: Unit puppet.service entered failed state.
 
Jan 16 16:32:37 systemd[1]: puppet.service failed.
 
Jan 16 16:33:52 systemd[1]: Started Puppet agent.
 
Jan 16 16:33:55 puppet-agent[8094]: Starting Puppet client version 6.12.0
 
Jan 16 16:33:55 puppet-agent[8094]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Jan 16 16:33:55 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Jan 16 16:33:55 systemd[1]: Unit puppet.service entered failed state.
 
Jan 16 16:33:55 systemd[1]: puppet.service failed.
 
Jan 16 17:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{logline repeats}
 
Jan 27 05:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 27 08:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 27 09:53:30 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Jan 27 09:53:45 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Jan 27 09:53:50 systemd[1]: Started Puppet agent.
 
Jan 27 09:53:53 puppet-agent[1667]: Starting Puppet client version 6.12.0
 
Jan 27 09:53:53 puppet-agent[1667]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Jan 27 09:53:53 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Jan 27 09:53:53 systemd[1]: Unit puppet.service entered failed state.
 
Jan 27 09:53:53 systemd[1]: puppet.service failed.
 
Jan 27 10:31:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 27 12:11:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{logline repeats}
 
Jan 31 16:11:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 31 17:44:42 puppet-agent[23767]: Caught USR1; storing reload
 
Jan 31 17:44:45 puppet-agent[23767]: Processing reload
 
Jan 31 17:44:45 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 31 17:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 31 18:11:40 puppet-agent[23767]: Caught USR1; storing reload
 
Jan 31 18:11:45 puppet-agent[23767]: Processing reload
 
Jan 31 18:11:45 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Jan 31 19:02:18 puppet-agent[23767]: Caught USR1; storing reload
 
Jan 31 19:02:20 puppet-agent[23767]: Processing reload
 
Jan 31 19:02:20 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{logline repeats}
 
Feb 07 14:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Feb 07 16:31:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Feb 07 17:50:59 systemd[1]: Started Puppet agent.
 
Feb 07 17:51:02 puppet-agent[25198]: Starting Puppet client version 6.12.0
 
Feb 07 17:51:02 puppet-agent[25198]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Feb 07 17:51:02 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Feb 07 17:51:02 systemd[1]: Unit puppet.service entered failed state.
 
Feb 07 17:51:02 systemd[1]: puppet.service failed.
 
Feb 07 18:11:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Feb 07 19:51:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Feb 07 21:31:04 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{logline repeats}
 
Mar 06 07:51:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Mar 06 09:31:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Mar 06 11:11:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Mar 06 12:22:32 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Mar 06 12:22:47 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Mar 06 12:23:00 systemd[1]: Started Puppet agent.
 
Mar 06 12:23:04 puppet-agent[11900]: Starting Puppet client version 6.12.0
 
Mar 06 12:23:04 puppet-agent[11900]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Mar 06 12:23:04 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Mar 06 12:23:04 systemd[1]: Unit puppet.service entered failed state.
 
Mar 06 12:23:04 systemd[1]: puppet.service failed.
 
Mar 06 12:51:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Mar 06 14:31:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Mar 06 16:11:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{logline repeats}
 
Apr 09 09:31:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 11:11:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 12:01:30 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Apr 09 12:01:45 puppet-agent[23767]: Config file /etc/puppetlabs/puppet/puppet.conf changed; triggering re-parse of all config files.
 
Apr 09 12:02:18 systemd[1]: Started Puppet agent.
 
Apr 09 12:02:21 puppet-agent[27996]: Starting Puppet client version 6.12.0
 
Apr 09 12:02:21 puppet-agent[27996]: Could not run: Could not create PID file: /var/run/puppetlabs/agent.pid
 
Apr 09 12:02:21 systemd[1]: puppet.service: main process exited, code=exited, status=1/FAILURE
 
Apr 09 12:02:21 systemd[1]: Unit puppet.service entered failed state.
 
Apr 09 12:02:21 systemd[1]: puppet.service failed.
 
Apr 09 13:11:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 15:11:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 09 17:11:05 puppet-agent[23767]: Shutdown/restart in progress (:restart_requested); skipping run
 
{repeats until today}

On all systems the puppet agent is managed with theforeman/puppet module: https://github.com/theforeman/puppet-puppet

Tim Meusel (Jira)

unread,
Apr 20, 2020, 9:59:04 AM4/20/20
to puppe...@googlegroups.com
Tim Meusel commented on Bug PUP-10351

I've multiple centos boxes, but most of them have nothing in their journal except the restart message.

root ~ # facter -p os
 
{
 
  architecture => "x86_64",
 
  family => "RedHat",
 
  hardware => "x86_64",
 
  name => "CentOS",
 
  release => {
 
    full => "7.7.1908",
 
    major => "7",
 
    minor => "7"
 
  },
 
  selinux => {
 
    config_mode => "enforcing",
 
    config_policy => "targeted",
 
    current_mode => "enforcing",
 
    enabled => true,
 
    enforced => true,
 
    policy_version => "31"
 
  }
 
}
 
root ~ # puppet --version
 
6.14.0
 
(reverse-i-search)`': ^C
 
root ~ # journalctl --unit puppet | head
 
-- Logs begin at Mon 2020-04-06 00:57:17 UTC, end at Mon 2020-04-20 13:55:45 UTC. --
 
Apr 06 02:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 04:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 06:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 08:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 10:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 12:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 14:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 16:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
Apr 06 18:18:40 puppet-agent[16308]: Shutdown/restart in progress (:restart_requested); skipping run
 
root ~ #

Mihai Buzgau (Jira)

unread,
Apr 21, 2020, 2:25:03 AM4/21/20
to puppe...@googlegroups.com
Mihai Buzgau updated an issue
Change By: Mihai Buzgau
Sprint: NW - 2020-04-01, NW - 2020-04-15 , NW - 2020-04-29

Mihai Buzgau (Jira)

unread,
Apr 29, 2020, 4:41:04 AM4/29/20
to puppe...@googlegroups.com
Mihai Buzgau updated an issue
Change By: Mihai Buzgau
Sprint: NW - 2020-04-01, NW - 2020-04-15, NW - 2020-04-29 , NW - 2020-05-13

Josh Cooper (Jira)

unread,
May 11, 2020, 6:27:03 PM5/11/20
to puppe...@googlegroups.com

Luchian Nemes (Jira)

unread,
May 12, 2020, 2:42:04 AM5/12/20
to puppe...@googlegroups.com
Luchian Nemes updated an issue
 
Change By: Luchian Nemes
Release Notes: Bug Fix
Release Notes Summary: When two agent runs were taking place at about the same time, under certain circumstances, puppet agent could get in a repeatedly `restart_requested` state. It was fixed by cleaning up the puppet daemon code logic.

Mihai Buzgau (Jira)

unread,
May 13, 2020, 3:58:03 AM5/13/20
to puppe...@googlegroups.com
Mihai Buzgau updated an issue
Change By: Mihai Buzgau
Sprint: NW - 2020-04-01, NW - 2020-04-15, NW - 2020-04-29, NW - 2020-05-13 , NW - 2020-05-27

Josh Cooper (Jira)

unread,
May 20, 2020, 12:24:03 PM5/20/20
to puppe...@googlegroups.com
Josh Cooper updated an issue
Change By: Josh Cooper
Fix Version/s: PUP 5.5.21
Fix Version/s: PUP 6.16.0

Claire Cadman (Jira)

unread,
May 29, 2020, 4:24:04 AM5/29/20
to puppe...@googlegroups.com
Claire Cadman updated an issue
Change By: Claire Cadman
Labels: doc_reviewed

Damon Maria (Jira)

unread,
May 30, 2020, 11:09:02 AM5/30/20
to puppe...@googlegroups.com
Damon Maria commented on Bug PUP-10351
 
Re: Puppet Agent fails to self-restart on config change or update

Experiencing the same on Ubuntu 18.04. 

Josh Cooper (Jira)

unread,
Jun 1, 2020, 3:11:03 PM6/1/20
to puppe...@googlegroups.com
Josh Cooper commented on Bug PUP-10351

Damon Maria this fix should go out in the next set of releases this week.

Tim Meusel (Jira)

unread,
Aug 11, 2020, 2:40:03 AM8/11/20
to puppe...@googlegroups.com
Tim Meusel commented on Bug PUP-10351

Hi. Can someone confirm this is actually fixed in 6.16.0? I wasn't able to find an entry in the release notes and my agents still fail:

root@server01 ~ # puppet --version
 
6.16.0
 
root@server01 ~ # systemctl status puppet
 
● puppet.service - Puppet agent
 
     Loaded: loaded (/usr/lib/systemd/system/puppet.service; enabled; vendor preset: disabled)
 
     Active: active (running) (thawing) since Thu 2020-02-20 13:50:56 CET; 5 months 20 days ago
 
   Main PID: 20855 (puppet)
 
         IP: 94.9M in, 75.0M out
 
      Tasks: 5 (limit: 145001)
 
     Memory: 112.7M
 
        CPU: 4h 17min 29.438s
 
     CGroup: /system.slice/puppet.service
 
             ├─20855 /usr/bin/ruby /usr/bin/puppet agent --no-daemonize
 
             ├─21622 gpg-agent --homedir /etc/pacman.d/gnupg --use-standard-socket --daemon
 
             └─21648 scdaemon --multi-server --homedir /etc/pacman.d/gnupg
 
 
 
Aug 10 12:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 10 14:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 10 16:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 10 18:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 10 20:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 10 22:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 11 00:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 11 02:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 11 04:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
Aug 11 06:53:24 server01 puppet-agent[20855]: Shutdown/restart in progress (:restart_requested); skipping run
 
root@server01 ~ #


# facter -p os
 
{
 
  architecture => "x86_64",
 
  family => "Archlinux",
 
  hardware => "x86_64",
 
  name => "Archlinux",
 
  release => {
 
    full => "5.1.15.a-1-hardened",
 
    major => "5",
 
    minor => "1"
 
  },
 
  selinux => {
 
    enabled => false
 
  }
 
}
Reply all
Reply to author
Forward
0 new messages