I did `yum update` on my puppet server about a week ago. Up to that point I had puppet and puppetdb running on the same machine. Since the update puppetdb doesn't appear to be listening on port 8081 anymore.
When I run `puppet agent --test` on a client I get this error:
err: Could not retrieve catalog from remote server: Error 400 on SERVER: Failed to submit 'replace facts' command for plugpc-005.client to PuppetDB at puppet.server:8081: Connection refused - connect(2)
Looking at `nmap -P0 puppet.server` shows that port 8081 isn't open. Trying `telnet puppet.server 8081` confirms this.
`ps -ax` shows that the processes are running:
2040 ? Ss 4:55 /usr/sbin/openvpn --daemon --writepid /var/run/openvpn/puppet.pid --config puppet.conf --cd /etc/openvpn --script-security 2
29737 ? Sl 0:37 /usr/bin/java -XX:OnOutOfMemoryError=kill -9 %p -Xmx192m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/puppetdb/puppetdb-oom.hprof -jar /usr/share/puppetdb/puppetdb.jar services -c /etc/puppetdb/conf.d
29924 ? Sl 0:01 Passenger AppPreloader: /usr/share/puppet/rack/puppetmasterd
29963 ? Sl 0:00 Passenger RackApp: /usr/share/puppet/rack/puppetmasterd
The output of `netstat -nap | grep 8081` is empty.
Turning off iptables doesn't make any difference. (not that it would - nobody is listening at the port anyway)
NOTE: This system was working ok before the update. I could download configs to clients and query the db for the results.
So - what did I break?