This is a design to enable monitoring of upload progress for snapshots after the main part of the backup has finished.
Volume snapshotter plug-in are used by Velero to take snapshots of persistent volume contents. Depending on the underlying storage system, those snapshots may be available to use immediately,
they may be uploaded to stable storage internally by the plug-in or they may need to be uploaded after the snapshot has been taken. We would like for Velero to continue on to the next part of the backup as quickly as possible but we would also like the backup
to not be marked as complete until it is a usable backup. We'd also eventually like to bring the control of upload under the control of Velero and allow the user to make decisions about the ultimate destination of backup data independent of the storage system
they're using.
Document with visible diagrams - https://github.com/dsu-igeek/velero/blob/snapshot-upload-progress-design-12-14-2020/design/upload-progress.md
Pull Request https://github.com/vmware-tanzu/velero/pull/3416
This meeting will present the design. Community input is welcome at the design meeting and in other channels.
|
Thanks to everyone joining today.
We had some discussion on how to keep track of the uploading state, whether to add additional phases or a new field to the Backup resource to handle that.
Plug-in versioning was identified as a pre-requisite to adding new plugin APIs.
Kubernetes Conditions and Events were identified as potential ways to track upload progress and other Velero states. Will set up a meeting to discuss that.
Meeting recording is here: https://VMware.zoom.us/rec/share/BlR1fC523cdzT4aBhnC3fX7hE5xRzbtB11G1BZGMVuU6dz5iA23x0yKkLqFUoSge.MInnd9HTWq7enORN
Passcode: aBxv5q%F
From:
dsmith...@vmware.com
When: 9:00 AM - 10:00 AM February 25, 2021
Subject: Review/discussion on Upload Progress Monitoring Doc
Location: https://VMware.zoom.us/j/94331975442?pwd=V2Rmci9kMjlOMWlHQUZqSkZKQ0ttdz09&from=addon
This is a design to enable monitoring of upload progress for snapshots after the main part of the backup has finished.
Volume snapshotter plug-in are used by Velero to take snapshots of persistent volume contents. Depending on the underlying storage system, those snapshots may be available to use immediately, they may be uploaded to stable storage internally by the plug-in or they may need to be uploaded after the snapshot has been taken. We would like for Velero to continue on to the next part of the backup as quickly as possible but we would also like the backup to not be marked as complete until it is a usable backup. We'd also eventually like to bring the control of upload under the control of Velero and allow the user to make decisions about the ultimate destination of backup data independent of the storage system they're using.
Document with visible diagrams - https://github.com/dsu-igeek/velero/blob/snapshot-upload-progress-design-12-14-2020/design/upload-progress.md
Pull Request https://github.com/vmware-tanzu/velero/pull/3416
This meeting will present the design. Community input is welcome at the design meeting and in other channels.