Puppet Master Profiles - Crosspost from Puppet-dev

[Britt Gresham]

Hello,

We are interested in collecting puppet profile data from the puppet master in the real world. This data will be used to help us find a direction to go to increase the throughput of the puppet master master.

I've created a script that will create a yaml file that will have various system facts and profile data that you will need to generate from a master.

To generate this data follow the steps listed below.

1. Download the profiler script from https://github.com/demophoon/puppet-master-profiler
2. Run your puppet master with the `--debug`, `--profile`, and `--logdest=<path_to_a_blank_file>` flags
3. Wait for a few agents to check-in. You can tail the log file to see agents checking in to the master.
4. From the repository run `profile.rb <path_to_log_file>`. The log file will the the same path as the one specified above.
5. Answer the questions on screen and email the result file to me at br...@puppetlabs.com.

If you would like to do so send the apache log files for the time that the puppet master was running as well, it will help us see how the agent acts during the profile. We realize that some may not be comfortable doing this so it is completely optional.

If you have any questions or concerns please feel free to ask them here!

Thank you,

Britt Gresham

[Andy Parker]

On Mon, Sep 22, 2014 at 10:07 AM, Britt Gresham <br...@puppetlabs.com> wrote:

Hello,

We are interested in collecting puppet profile data from the puppet master in the real world. This data will be used to help us find a direction to go to increase the throughput of the puppet master master.

I would be incredibly grateful to anyone who could send us some information. I know that this is extra work on top of what you would normally be doing, but it would really help us to find the real hotspots in deployed puppet systems.

 

I've created a script that will create a yaml file that will have various system facts and profile data that you will need to generate from a master.

To generate this data follow the steps listed below.

1. Download the profiler script from https://github.com/demophoon/puppet-master-profiler
2. Run your puppet master with the `--debug`, `--profile`, and `--logdest=<path_to_a_blank_file>` flags
3. Wait for a few agents to check-in. You can tail the log file to see agents checking in to the master.
4. From the repository run `profile.rb <path_to_log_file>`. The log file will the the same path as the one specified above.
5. Answer the questions on screen and email the result file to me at br...@puppetlabs.com.

If you would like to do so send the apache log files for the time that the puppet master was running as well, it will help us see how the agent acts during the profile. We realize that some may not be comfortable doing this so it is completely optional.

If you aren't able to do these steps on your production systems, I can completely understand. Test or staging systems would be great sources of data as well. If you have any other tools that you might rather use to gather information, then please do so. For instance a lot of interesting information about puppet's performance can be gleaned from strace. Maybe you've instrumented your puppet with New Relic or some other performance monitoring system? Are there lessons from that that could be shared?

 

If you have any questions or concerns please feel free to ask them here!

And thank you for anything that you can send us.

 

Thank you,

Britt Gresham

--
You received this message because you are subscribed to the Google Groups "Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/4888c822-028d-4262-b80f-f6074d56c888%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Andrew Parker

an...@puppetlabs.com

Freenode: zaphod42

Twitter: @aparker42

Software Developer

Join us at PuppetConf 2014, September 20-24 in San Francisco - www.puppetconf.com