Re: [kubernetes/kubernetes] Scheduling fails with "Insufficient Memory" until restart of apiserver/master (#45237)

0 views
Skip to first unread message

Klaus Ma

unread,
May 9, 2017, 9:26:59 AM5/9/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

According to Spindel's test, k8s cluster will recover by restarting apiserver; so I think this may also apiserver related. Any way, I'd like build some tools or PR to see what happen in scheduler (can not reproduced in local, and scheduler's log seems no much info).

/cc @kubernetes/sig-api-machinery-bugs


You are receiving this because you are on a team that was mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

D. Spindel

unread,
May 9, 2017, 9:46:56 AM5/9/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention
I am in and willing to help out and test on this cluster.


On Tue, 9 May 2017, 15:26 Klaus Ma, <notifi...@github.com> wrote:

> According to Spindel's test, k8s cluster will recover by restarting
> apiserver; so I think this may also apiserver related. Any way, I'd like
> build some tools or PR to see what happen in scheduler (can not reproduced
> in local, and scheduler's log seems no much info).
>
> /cc @kubernetes/sig-api-machinery-bugs
> <https://github.com/orgs/kubernetes/teams/sig-api-machinery-bugs>
>
> —
> You are receiving this because you were mentioned.

> Reply to this email directly, view it on GitHub
> <https://github.com/kubernetes/kubernetes/issues/45237#issuecomment-300162756>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/ABmI5mQkR4FylUStbageX8xQh2g-EFhqks5r4GmigaJpZM4NOgvm>
> .

Klaus Ma

unread,
Jun 1, 2017, 8:14:42 PM6/1/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

/close

k8s-ci-robot

unread,
Jun 1, 2017, 8:14:45 PM6/1/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

Closed #45237.

Klaus Ma

unread,
Jun 1, 2017, 8:14:48 PM6/1/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

slack with Spindel@, it seems OK after update ETCD to 3.0.17 :).

Klaus Ma

unread,
Jun 1, 2017, 8:16:06 PM6/1/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

@Spindel , I closed this firstly as it seems OK with ETCD 3.0.17; if there is still issue, please free feel to re-open this and ping me :).

D. Spindel

unread,
Jun 2, 2017, 3:52:53 AM6/2/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention
I'll reinstate some more limits and get this tested more thoroughly. Until
then, keep it closed. Thank you for your assistance.

On Fri, 2 Jun 2017, 02:16 Klaus Ma, <notifi...@github.com> wrote:

> @Spindel <https://github.com/spindel> , I closed this firstly as it seems

> OK with ETCD 3.0.17; if there is still issue, please free feel to re-open
> this and ping me :).
>
> —
> You are receiving this because you were mentioned.

> Reply to this email directly, view it on GitHub
> <https://github.com/kubernetes/kubernetes/issues/45237#issuecomment-305654741>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/ABmI5jVPcuBe053BwflJiUkNDPB2omSeks5r_1RAgaJpZM4NOgvm>

kesten

unread,
Dec 29, 2017, 2:02:30 PM12/29/17
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

I'm facing this with gce 1.8.4-gke.1. I create a new beefy compute node and schedule a container that can only fit there. After stopping (using jupyter auto cull container), i am unable to schedule it again. My current workaround is to delete the node and add a new one. The scheduler always works the first time. It seems like the scheduler isn't tracking the release or resources properly. I wasn't able to find a scheduler pod in any namespace, maybe a gce thing.

Nova Terata

unread,
Oct 12, 2018, 2:03:28 PM10/12/18
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

I'm seeing this with AKS. I have nodes with 8G of ram and I schedule 1 pod per node with limits and requests for 6.5G memory. Sometimes it works fine. Othertimes it says "insufficient memory" when there is clearly enough.

roblappcoupa

unread,
Apr 6, 2022, 1:04:52 PM4/6/22
to kubernetes/kubernetes, k8s-mirror-api-machinery-bugs, Team mention

I am plagued by this issue on EKS (Kubernetes version 1.21)


Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are on a team that was mentioned.Message ID: <kubernetes/kubernetes/issues/45237/1090499660@github.com>

Reply all
Reply to author
Forward
0 new messages