Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Storeconfigs connection pool problem
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  10 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Daniel Kerwin  
View profile  
 More options Feb 11 2010, 7:46 am
From: Daniel Kerwin <d.k3r...@googlemail.com>
Date: Thu, 11 Feb 2010 04:46:45 -0800 (PST)
Local: Thurs, Feb 11 2010 7:46 am
Subject: Storeconfigs connection pool problem
Hi list,

i just enabled storeconfigs and cannot use puppetrun on more than 5
hosts. When i try 6+ i get the error message:

puppetmasterd[16209]: could not obtain a database connection within 5
seconds.  The max pool size is currently 5; consider increasing it.

My Mysql setup allows a lot more connections (500). Any suggestions?

Thanks,

Daniel


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Joe McDonagh  
View profile  
 More options Feb 12 2010, 12:28 am
From: Joe McDonagh <joseph.e.mcdon...@gmail.com>
Date: Fri, 12 Feb 2010 00:28:59 -0500
Local: Fri, Feb 12 2010 12:28 am
Subject: Re: [Puppet Users] Storeconfigs connection pool problem
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Daniel Kerwin wrote:
> Hi list,

> i just enabled storeconfigs and cannot use puppetrun on more than 5
> hosts. When i try 6+ i get the error message:

> puppetmasterd[16209]: could not obtain a database connection within 5
> seconds.  The max pool size is currently 5; consider increasing it.

> My Mysql setup allows a lot more connections (500). Any suggestions?

> Thanks,

> Daniel

Do you have the proper rubygem for mysql installed? I think on
deb/ubuntu it's something like libmysql-ruby1.8.

- --
Joe McDonagh
AIM: YoosingYoonickz
IRC: joe-mac on freenode
L'ennui est contre-r volutionnaire

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAkt05xoACgkQRkBieEaRmubRKACglFzvJCGtN1rChmbuZqfJKN7/
yYUAn1/KdvVfD8DURsk+lzc+/VAxb1fG
=lPum
-----END PGP SIGNATURE-----


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Jason Koppe  
View profile  
 More options Jun 9 2010, 1:09 am
From: Jason Koppe <jason.robert.ko...@gmail.com>
Date: Wed, 9 Jun 2010 00:09:50 -0500
Local: Wed, Jun 9 2010 1:09 am
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

I'm having the same problem with the mysql gem installed and the gem appears
to be in-use

jkoppe@indadm1 in ~ at 2010-06-08 23:58:59
--> gem list mysql

*** LOCAL GEMS ***

mysql (2.8.1)

jkoppe@indadm1 in ~ at 2010-06-08 23:59:00
--> cd /var/lib/puppet/log/

jkoppe@indadm1 in /var/lib/puppet/log at 2010-06-09 00:00:20
--> sudo cat rails.log
[sudo] password for jkoppe:
# Logfile created on Tue Jun 08 09:04:41 -0500 2010 by logger.rb/1.5.2.9
jkoppe@indadm1 in /var/lib/puppet/log at 2010-06-09 00:00:25
-->
jkoppe@indadm1 in /var/lib/puppet/log at 2010-06-09 00:08:03
--> sudo lsof | grep 30870 | grep mysql
puppetmas 30870       root  mem       REG        8,3    2083728    1218568
/usr/lib/libmysqlclient.so.15.0.0
puppetmas 30870       root  mem       REG        8,3     148035    1251352
/usr/lib/ruby/gems/1.8/gems/mysql-2.8.1/lib/mysql_api.so
puppetmas 30870       root    7u     IPv4   45902539                   TCP
indadm1.indeed.net:37895->indadm1.indeed.net:mysql (ESTABLISHED)
puppetmas 30870       root    9u     IPv4   45898759                   TCP
indadm1.indeed.net:37874->indadm1.indeed.net:mysql (ESTABLISHED)
puppetmas 30870       root   11u     IPv4   45902499                   TCP
indadm1.indeed.net:37893->indadm1.indeed.net:mysql (ESTABLISHED)
puppetmas 30870       root   19u     IPv4   45902527                   TCP
indadm1.indeed.net:37894->indadm1.indeed.net:mysql (ESTABLISHED)
puppetmas 30870       root   22u     IPv4   45902542                   TCP
indadm1.indeed.net:37896->indadm1.indeed.net:mysql (ESTABLISHED)
jkoppe@indadm1 in /var/lib/puppet/log at 2010-06-09 00:08:06
-->

On Fri, Feb 12, 2010 at 12:28 AM, Joe McDonagh
<joseph.e.mcdon...@gmail.com>wrote:

--
Jason Koppe
Jason.Robert.Ko...@gmail.com
Cell (210) 445-8242

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Dan Carley  
View profile  
 More options Jun 9 2010, 4:51 am
From: Dan Carley <dan.car...@gmail.com>
Date: Wed, 9 Jun 2010 09:51:26 +0100
Local: Wed, Jun 9 2010 4:51 am
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

On 9 June 2010 06:09, Jason Koppe <jason.robert.ko...@gmail.com> wrote:

The gem version is a bit of a red herring, so long are using the gem and not
Ruby's own connector. As the warning suggests, ActiveRecord's pool option
simply needs raising if it's to be put under any strain at all. There is a
bug/feature ticket as #2568 [0] which exposes this option to Puppet's
configuration. But it's not due to be delivered until 2.6/rowlf.

I've been slipstreaming the patch into 0.25 myself because storeconfigs
grinds to a halt without it in my environment. Given the simplicity of the
diff and that it seems to be affecting a number of people I think it
probably warrants being brought forward to 0.25.

[0] http://projects.puppetlabs.com/issues/2568


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Jason Koppe  
View profile  
 More options Jun 9 2010, 4:11 pm
From: Jason Koppe <jason.robert.ko...@gmail.com>
Date: Wed, 9 Jun 2010 15:11:58 -0500
Local: Wed, Jun 9 2010 4:11 pm
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

Queuing support from ActiveMQ doesn't even make a difference for me -- I
thought the purpose of adding the queuing support was to queue the data in
puppetqd's memory and let that flush out to the database when it could.  I'm
still seeing this error from the puppetmaster (not puppetqd).

err: could not obtain a database connection within 5 seconds.  The max pool
size is currently 5; consider increasing it.

Am I misunderstanding how puppetmasterd+puppetqd is supposed to function?

--
Jason Koppe
Jason.Robert.Ko...@gmail.com
Cell (210) 445-8242

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Christopher Johnston  
View profile  
 More options Jun 10 2010, 10:32 am
From: Christopher Johnston <chjoh...@gmail.com>
Date: Thu, 10 Jun 2010 10:32:25 -0400
Local: Thurs, Jun 10 2010 10:32 am
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

I have the same issue as well, seems puppetqd uses sqlite for caching....?

On Wed, Jun 9, 2010 at 4:11 PM, Jason Koppe <jason.robert.ko...@gmail.com>wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Jason Koppe  
View profile  
 More options Jun 10 2010, 1:39 pm
From: Jason Koppe <jason.robert.ko...@gmail.com>
Date: Thu, 10 Jun 2010 12:39:11 -0500
Local: Thurs, Jun 10 2010 1:39 pm
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

I'm not sure, I can't seem to find README.queuing or much documentation
about how it's supposed to work.  I'll checkout the code this weekend if
there aren't responses here.

On Thu, Jun 10, 2010 at 9:32 AM, Christopher Johnston <chjoh...@gmail.com>wrote:

--
Jason Koppe
Jason.Robert.Ko...@gmail.com
Cell (210) 445-8242

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Christopher Johnston  
View profile  
 More options Jun 21 2010, 11:30 am
From: Christopher Johnston <chjoh...@gmail.com>
Date: Mon, 21 Jun 2010 11:30:21 -0400
Local: Mon, Jun 21 2010 11:30 am
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

Any findings?  From what I can tell it defaults to sqlite leaving me with an
issue of my hosts bombing out when more then 6 runs are happening.  I would
prefer to have it use mysql for a cache then let the queuing daemon fwd its
data to a central mysql server.

On Thu, Jun 10, 2010 at 1:39 PM, Jason Koppe
<jason.robert.ko...@gmail.com>wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Jason Koppe  
View profile  
 More options Jun 22 2010, 1:59 am
From: Jason Koppe <jason.robert.ko...@gmail.com>
Date: Tue, 22 Jun 2010 00:59:45 -0500
Local: Tues, Jun 22 2010 1:59 am
Subject: Re: [Puppet Users] Storeconfigs connection pool problem

I didn't read anything over last weekend but I'm anxious to find out how to
fix this for my environment.

What is the OS of your puppetmaster?

I've got CentOS and there's another thread about CentOS5 leaking file
descriptors.... which seems to be related.

On Mon, Jun 21, 2010 at 10:30 AM, Christopher Johnston
<chjoh...@gmail.com>wrote:

--
Jason Koppe
Jason.Robert.Ko...@gmail.com
Cell (210) 445-8242

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Thomas A. McGonagle  
View profile  
 More options Jun 26 2010, 6:08 pm
From: "Thomas A. McGonagle" <t...@dataero.com>
Date: Sat, 26 Jun 2010 18:08:46 -0400
Local: Sat, Jun 26 2010 6:08 pm
Subject: Re: [Puppet Users] Storeconfigs connection pool problem
Hey Jason,
 I ran into this problem myself. I switched to SQLite3, for my stored
configs. No problems with it, and then I run PuppetDashboard (with a
mysql backend as a secondary stored configs source just in case.
 Please let me know if you have any questions or if there is something
I can help with.
-Tom

Thomas A. McGonagle
t...@dataero.com
Google Voice: 617-229-5185

On Tue, Jun 22, 2010 at 1:59 AM, Jason Koppe


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »