Kubernetes problems

286 views

Skip to first unread message

Brad Fitzpatrick

unread,

Apr 13, 2017, 2:49:32 PM4/13/17

to golang-dev

Our Kubernetes build cluster is having problems at the moment.

(all the newosproc errors)

I've enlarged the pool as a workaround and am working with GKE people on using some alpha API hacks to add some isolation that Kubernetes doesn't yet officially support. (pid and fd limits)

In any case, known.

Brad Fitzpatrick

unread,

Apr 14, 2017, 12:38:17 AM4/14/17

to golang-dev

Turned out to be a process leak in the kubelet. The nodes had accumulated tens of thousands of defunct 'wc' processes.

It's fixed in a later version, so things are upgrading now. All old bugs fixed! No new bugs!