Long-Term incremental Backups more storage efficient?

44 views
Skip to first unread message

sim....@gmail.com

unread,
Jul 7, 2020, 4:15:48 AM7/7/20
to bareos-users
Hello,

I have written about my problem before, but I'll try it again:
I have implemented the AI-Incremental backups with virtual full jobs.

Now there is a huge disadvantage about the virtual full job, explained on one server:
If my full backup is 1TB and incrementals are about 20GB-50GB a day, I just use max ~1.5TB of storage (7 days).
Doing just one virtual full backup, I suddenly have to use 2.5TB for this server.
Doing those virtual full backups 3 months, would cost me 4.5TB for a single Server.

So is there a way to add those monthly virtual full backups to the Alway Incremental chain?
This would save like 2TB of Storage and I have to backup like 40 servers of this kind.

Should I get in Contact with the devs?
If there is no way to do this, then I must use something other than bareos.

Thanks in advance
Simon

sim....@gmail.com

unread,
Jul 7, 2020, 9:42:41 AM7/7/20
to bareos-users
In addition:
If it's not possible to set up the virtual backup, so it does incremental Backups, would it be possible to make daily always incrementals, 3 months long and delete everything I don't need?
So the full backup will be consolidated once a month.
And the incrementals in between the full backup and the one a month later, would be deleted?

Brock Palen

unread,
Jul 7, 2020, 9:03:15 PM7/7/20
to sim....@gmail.com, bareos-users
As far as I know there is no way to do what you ask. The VirtualFull is a rewrite of all data as Bareos knows how that job looks at this time.

When that happens through an Consolidate job the old Full should be pruned, but you will need a point in time when you can have 2x the size of the Full + Incrementals.

If you make sure your AI-Consolidated volumes are kept short lived (ether limited number of jobs, size or age) you should be able to prune/truncate them quickly, if you have 40 servers be sure to spread them around which should happen somewhat naturally, so a few have 2x storage used, but the old Full’s prune/recycle quickly, and are used by the next few the next day etc.

Even with a long time range for how long before you force a VirtualFull of the entire Job you will need to have storage space > sum( All Servers ).

This is why some people still love tape, the disk space starts to add up. In our case all backups are taken to disk, but we use Copy Jobs to take data out to tape ASAP, and we recycle the on disk volumes quickly. Consolidated more quickly than Incremental, but you get the idea.


Brock Palen
1 (989) 277-6075
bro...@mlds-networks.com
www.mlds-networks.com
Websites, Linux, Hosting, Joomla, Consulting
> --
> You received this message because you are subscribed to the Google Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/0a9756c3-467d-4377-93bb-8d8cdd05abcdn%40googlegroups.com.

Reply all
Reply to author
Forward
0 new messages