Question about data and file deletion timing

11 views
Skip to first unread message

rabidmuta...@gmail.com

unread,
Jan 4, 2021, 10:42:54 PM1/4/21
to s3ql
I have a backup that involves mounting an s3ql file system and using  'rsync --delete ...' to do the backup.

If a large folder (or file) is moved, there is a risk that the files will be 'deleted' before they area created again, possibly resulting in remote data being deleted then recreated.

Is this concern genuine?

Would doing: 'rsync' (with no --delete) followed by 'rsync --delete ...' be the best way to alleviate the risk of wasted bandwidth (and time) here? Or should I consider a snapshot, the 'rsync --delete' then delete the snapshot?

Any advice appreciated!

Cliff Stanford

unread,
Jan 5, 2021, 3:09:25 AM1/5/21
to s3...@googlegroups.com
On 05/01/2021 05:42, rabidmuta...@gmail.com wrote:

> If a large folder (or file) is moved, there is a risk that the files
> will be 'deleted' before they area created again, possibly resulting in
> remote data being deleted then recreated.

How about using `rsync --delete-after` to ensure that all blocks remain
until the transfer is complete?

Cliff.

--
Cliff Stanford
London: +44 20 0222 1666 Swansea: +44 1792 469666
Spain: +34 603 777 666 Estonia: +372 5308 9666
UK Mobile: +44 7973 616 666

rabidmuta...@gmail.com

unread,
Jan 5, 2021, 3:50:59 AM1/5/21
to s3ql
lol...that works...didn't know it existed. Thank you!
Reply all
Reply to author
Forward
0 new messages