[kubernetes/kubernetes] Volume manager should not mount the volumes for pods rejected by kubelet (#61137)

7 views
Skip to first unread message

Yu-Ju Hong

unread,
Mar 13, 2018, 6:31:01 PM3/13/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

This came up when I was checking the kubelet logs for #60763

Kubelet admits or rejects pods assigned to the node in its sync loop, and would not start syncing a pod until it's admitted. In the meantime, volume manager works independently to mount volumes for the assigned pods, as long as they are not in a terminated state. This causes issues where kubelet already rejected (or is about to reject) a pod, but their volumes are mounted. The volume manager should wait and check the results of the admission before attempting to mount.

/cc @kubernetes/sig-storage-bugs
/cc @kubernetes/sig-node-bugs


You are receiving this because you are on a team that was mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

fejta-bot

unread,
Jun 11, 2018, 6:47:40 PM6/11/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

Hemant Kumar

unread,
Jun 12, 2018, 3:06:52 PM6/12/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

/remove-lifecycle stale

Hemant Kumar

unread,
Jun 12, 2018, 3:08:29 PM6/12/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

@yujuhong volume manager uses kubelet's pod manager as source for picking pods that needs volumes. Once a pod gets rejected by kubelet, shouldn't it be removed from pod manager? and in that case - next reconcilliation loop of volume manager should remove the pod from desired state of world.

What do you suggest should be source of truth for volume manager to pick pods from?

fejta-bot

unread,
Sep 10, 2018, 3:25:24 PM9/10/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

fejta-bot

unread,
Oct 10, 2018, 3:49:31 PM10/10/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.

/lifecycle rotten

fejta-bot

unread,
Nov 9, 2018, 3:35:54 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.


Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

k8s-ci-robot

unread,
Nov 9, 2018, 3:36:00 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Closed #61137.

k8s-ci-robot

unread,
Nov 9, 2018, 3:36:07 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

@fejta-bot: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Hemant Kumar

unread,
Nov 9, 2018, 3:51:33 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

/reopen
/remove-lifecycle rotten
/lifecycle frozen

Hemant Kumar

unread,
Nov 9, 2018, 3:51:45 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

This is still a valid bug.

k8s-ci-robot

unread,
Nov 9, 2018, 3:51:55 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

@gnufied: Reopened this issue.

In response to this:

/reopen
/remove-lifecycle rotten
/lifecycle frozen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

k8s-ci-robot

unread,
Nov 9, 2018, 3:52:17 PM11/9/18
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Reopened #61137.

Matthias Bertschy

unread,
Jun 25, 2021, 4:50:47 AM6/25/21
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

This bug doesn't seem to have enough details to reproduce or further investigate. You must include your cluster version, the container runtime, kubelet logs, and any relevant Kubernetes manifests along with clear steps to reproduce so we can help with your issue.

Please re-open this bug once you have provided more information.

/triage needs-information
/close


You are receiving this because you are on a team that was mentioned.

Reply to this email directly, view it on GitHub, or unsubscribe.

Kubernetes Prow Robot

unread,
Jun 25, 2021, 4:50:53 AM6/25/21
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

Closed #61137.


You are receiving this because you are on a team that was mentioned.

Reply to this email directly, view it on GitHub, or unsubscribe.

Kubernetes Prow Robot

unread,
Jun 25, 2021, 4:50:53 AM6/25/21
to kubernetes/kubernetes, k8s-mirror-storage-bugs, Team mention

@matthyx: Closing this issue.

In response to this:

This bug doesn't seem to have enough details to reproduce or further investigate. You must include your cluster version, the container runtime, kubelet logs, and any relevant Kubernetes manifests along with clear steps to reproduce so we can help with your issue.

Please re-open this bug once you have provided more information.

/triage needs-information
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.


You are receiving this because you are on a team that was mentioned.

Reply to this email directly, view it on GitHub, or unsubscribe.

Reply all
Reply to author
Forward
0 new messages