Benchmark puppetDB

105 views
Skip to first unread message

shell heriyanto

unread,
Oct 15, 2012, 4:41:24 AM10/15/12
to puppet...@googlegroups.com
Dear All,

I know puppetDB its more faster than storeconfigs, but to replace storeconfigs with puppetDB into production server
Its need more explanation than some link from puppetlabs, need prove to my bos and team.
For testing i just have 1 puppetmaster and 1 and 2 puppet agent, how i can look different performance?
Its that any idea / or complex puppet stanza to benchmark / compare this with storeconfigs?

Regards,
Thanks

Nan Liu

unread,
Oct 15, 2012, 2:12:22 PM10/15/12
to puppet...@googlegroups.com
A catalog compile should show the difference in speed (especially one
with large number of resources). This is discussed in the Puppet DB
blog post. Also Deepak has great talk at Puppet Conf discussing why
PuppetDB is async (which isn't something quite as easy to benchmark
with just 2 agents):

http://youtu.be/xw83cRofkpM

HTH,

Nan

shell heriyanto

unread,
Oct 17, 2012, 8:44:58 AM10/17/12
to puppet...@googlegroups.com
Hi Nan,

Thank for your reply, yes that what im talking about, i can't prove just with link to puppet blog,
yes you right catalog compile should give our output, do you have some example of one
with large number of resources for my testing?

Thank for your help
Regards,


--
You received this message because you are subscribed to the Google Groups "Puppet Users" group.
To post to this group, send email to puppet...@googlegroups.com.
To unsubscribe from this group, send email to puppet-users...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.


Chris Price

unread,
Oct 24, 2012, 1:38:45 PM10/24/12
to puppet...@googlegroups.com
Hello Heriyanto,

Were you able to come up with something to solve your problem?  We don't currently have any sort of sample catalog that could be used to easily benchmark the performance difference in your environment, though your e-mail has prompted some internal discussion about how we could conceivably provide something like that in the future.

I suspect that if you simply time any agent run in your environment (for an agent with a non-trivial number of resources) against legacy storedconfigs, and then time it again with PuppetDB, you should notice some difference (because legacy storeconfigs must synchronously insert all of the catalog data into the database before the run completes).  You could also run your master with the "--debug" flag, which might provide you with some timing info for the various phases of the process.

However, the biggest benefits come when you have a master that is under some load from concurrent agent requests.  That might be a bit more tricky to simulate in your own environment if the blog posts and other data we've posted isn't sufficient, but we would be happy to try to help if you have questions!

Thanks
Chris

shell heriyanto

unread,
Oct 25, 2012, 4:48:55 AM10/25/12
to puppet...@googlegroups.com
Hello Chris,

Thanks for your reply, i already solved this by use my production modules. But yes, its take some time to build half my of production enviroment. Thank for yours great work.

Regards,
Heriyanto

To view this discussion on the web visit https://groups.google.com/d/msg/puppet-users/-/vTscH5wWHWEJ.
Reply all
Reply to author
Forward
0 new messages