clearing environment cache performance

43 views

Skip to first unread message

chris smith

unread,

Oct 9, 2018, 7:29:34 PM10/9/18

to Puppet Users

Hi all,

I'm having some issues with puppetserver (jruby) performance after doing an environment cache clear.

The server is running puppetserver-5.3.1, 12 cpus, 8gig ram with 10 jruby threads running, with puppetdb running on the same box (puppetdb-5.1.3).

After doing a service restart, there are threads free and things get processed fairly quickly.

After doing an environment cache clear, performance tanks and wait times explode.

The main environment is 'production' and I'm only clearing the environment that is being updated.

Eventually I end up restarting puppetserver to get it back running again.

Graphs of before and after attached (basically the same data as the experimental dashboard but over a longer time period). The threads screenshot is free (green) vs total (yellow).

I'm not really sure what to look at to stop this - any suggestions would be great.

Thanks,

Chris.

wait.png

threads.png

Thomas Müller

unread,

Oct 10, 2018, 7:45:17 AM10/10/18

to Puppet Users

Am Mittwoch, 10. Oktober 2018 01:29:34 UTC+2 schrieb chris smith:

Hi all,

I'm having some issues with puppetserver (jruby) performance after doing an environment cache clear.

The server is running puppetserver-5.3.1, 12 cpus, 8gig ram with 10 jruby threads running, with puppetdb running on the same box (puppetdb-5.1.3).

After doing a service restart, there are threads free and things get processed fairly quickly.

After doing an environment cache clear, performance tanks and wait times explode.

doing the same too - but without problems.

It came to my mind, that sometime ago there was a blogpost on puppet.com howto debug puppetserver. https://puppet.com/blog/puppet-server-advanced-memory-debugging . but reading it now, I don't think it will help you . :-/