Re: [kubernetes/kubernetes] Try to make scheduler volume binding more extendable (#56180)

2 views
Skip to first unread message

Michelle Au

unread,
Nov 21, 2017, 9:45:51 PM11/21/17
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

/assign @msau42 @bsalamat
/cc @liggitt


You are receiving this because you are on a team that was mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Michelle Au

unread,
Nov 21, 2017, 9:46:08 PM11/21/17
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Is this a BUG REPORT or FEATURE REQUEST?:
@kubernetes/sig-storage-feature-requests
@kubernetes/sig-scheduling-feature-requests

What happened:
Before volume scheduling moves to beta, see if there's a way to make the volume binding changes more pluggable to:

  • better support custom schedulers
  • make it easier for other cluster-level resources to integrate into the pod scheduling flow

Bobby (Babak) Salamat

unread,
Nov 21, 2017, 11:27:00 PM11/21/17
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

fejta-bot

unread,
Feb 20, 2018, 12:26:49 AM2/20/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

Michelle Au

unread,
Feb 20, 2018, 1:00:33 PM2/20/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

/remove-lifecycle stale

fejta-bot

unread,
May 21, 2018, 2:29:30 PM5/21/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

Michelle Au

unread,
May 21, 2018, 2:37:04 PM5/21/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

/remove-lifecycle stale

fejta-bot

unread,
Aug 19, 2018, 2:46:27 PM8/19/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

Michelle Au

unread,
Aug 20, 2018, 12:29:24 PM8/20/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

/remove-lifecycle stale

fejta-bot

unread,
Nov 18, 2018, 12:03:53 PM11/18/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

Michelle Au

unread,
Nov 19, 2018, 5:52:30 PM11/19/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

/remove-lifecycle stale
/lifecycle frozen

Michelle Au

unread,
Dec 17, 2018, 7:59:46 PM12/17/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

It looks like scheduler has started implement plugin hooks for the scheduler v2 framework. @cofyc can you look into refactoring the volume scheduling code to use the new framework?

Yecheng Fu

unread,
Dec 17, 2018, 8:30:40 PM12/17/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

sure
/assign

bsalamat

unread,
Dec 18, 2018, 2:23:41 AM12/18/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Thanks, @msau42 and @cofyc for taking initiative here. While we encourage you to take a look at the extension points and think about converting the volume scheduling code to plugins, please do not rely on the plugin interface yet. We plan to have the alpha available in 1.14, which means that the interface is currently in pre-alpha phase and will most probably change in the next couple of months.

Michelle Au

unread,
Dec 18, 2018, 5:23:19 PM12/18/18
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Thanks for the clarification Bobby! I think we can still at least prototype and help find issues since volume scheduling is one of the more complicated plugins.

Yecheng Fu

unread,
Jan 23, 2019, 9:46:41 PM1/23/19
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Design (Draft)

Filter

Implement scheduler filter plugin in which we call FindPodVolumes to find all feasible nodes and save pre-bound PVs and pre-provisioned PVCs in pod binding cache.

Reserve

Implement scheduler reserve plugin in which we call AssumePodVolumes to assume pre-bound PVs and pre-provisioned PVCs of selected node.

Pre-bind

Implement scheduler pre-bind plugin in which we call BindPodVolumes to bind pre-bound PVs and provision pre-provisioned PVCs.

If successfully, continue to bind pod.
If failed, exit scheduling cycle with non-unscheduable error.

Clean pod binding cache

When pod is removed from scheduling queue

https://github.com/kubernetes/kubernetes/blob/b9631a881f327b58ff52654cbb448927226bf05a/pkg/scheduler/factory/factory.go#L598-L60

References

Yecheng Fu

unread,
Oct 9, 2019, 4:53:02 AM10/9/19
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

depdencies:

Yecheng Fu

unread,
Oct 9, 2019, 7:56:13 AM10/9/19
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

another issue is how to pass KubeSchedulerConfiguration.BindTimeoutSeconds to volume binder plugin.

Kubernetes Prow Robot

unread,
May 14, 2020, 1:08:45 PM5/14/20
to kubernetes/kubernetes, k8s-mirror-storage-feature-requests, Team mention

Closed #56180 via #83726.


You are receiving this because you are on a team that was mentioned.

Reply to this email directly, view it on GitHub, or unsubscribe.

Reply all
Reply to author
Forward
0 new messages