File permission change results in whole files being backed up again

[Bartek R]

Hi,

Some days ago i have changed permissions (acl) of files on my nas. This share is backed up by bareos-fd 18.2.5 directly. Today i have found that disk space utilization in bareos-sd data directory is surprisingly high. It looks like permission change resulted in whole files being backed up again. Is it normal behavior for Bareos or maybe i have misconfigured something? Does the Bareos store permissions separately?

FileSet {
  Name = "LinuxAll"
  Description = "Backup all regular filesystems, determined by filesystem type."
  Include {
    Options {
      sparse = yes
      aclsupport = yes
      accurate = mcspiug
      verify = pin5
      Signature = MD5 # calculate md5 checksum per file
      One FS = No     # change into other filessytems
      FS Type = btrfs
      FS Type = ext2  # filesystems of given types will be backed up
      FS Type = ext3  # others will be ignored
      FS Type = ext4
      FS Type = reiserfs
      FS Type = jfs
      FS Type = xfs
      FS Type = zfs
      FS Type = vfat
    }
    File = /
  }
  # Things that usually have to be excluded
  Exclude {
    File = /var/lib/bareos
    File = /var/lib/bareos
    File = /var/lib/pgsql
    File = /var/lib/mysql
    File = /var/lib/libvirt/images
    File = /var/lib/docker
    File = /var/opt/gitlab
    File = /var/log
    File = /var/cache
    File = /volumes
    File = /proc
    File = /tmp
    File = /var/tmp
    File = /.journal
    File = /.fsck
  }
}

Regards,

Bart

[Andreas Rogge]

Hi,
Am 18.11.19 um 16:58 schrieb Bartek R:

> Some days ago i have changed permissions (acl) of files on my nas. This
> share is backed up by bareos-fd 18.2.5 directly. Today i have found that
> disk space utilization in bareos-sd data directory is surprisingly high.
> It looks like permission change resulted in whole files being backed up
> again. Is it normal behavior for Bareos or maybe i have misconfigured
> something? Does the Bareos store permissions separately?
>
> FileSet {
>   Name = "LinuxAll"
>   Description = "Backup all regular filesystems, determined by
> filesystem type."
>   Include {
>     Options {
>       sparse = yes
>       aclsupport = yes
>       accurate = mcspiug

Did you know that "p" in your accurate configuration means "permission
bits"?
You told Bareos to backup the file when the permission bits change. :)

Best Regards,
Andreas

--
Andreas Rogge andrea...@bareos.com
Bareos GmbH & Co. KG Phone: +49 221-630693-86
http://www.bareos.com

Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
Komplementär: Bareos Verwaltungs-GmbH
Geschäftsführer: S. Dühr, M. Außendorf, J. Steffens, Philipp Storz

[Vitaly Solntsev]

Hi, Andreas

>> You told Bareos to backup the file when the permission bits change. :)  

Can bareos developers change this behavior to avoid backing up actual files content if metadata changed only (md5sum still the same)? 

I mean, not just ignore metadata changes (skipping permissions bits) but instead backing up only metadata itself without actual files (the similar way as bareos handles deleted files in Accurate mode).

Metadata (filenames, user/group id, permissions, change time etc) stored in the catalog database, files - in bareos volumes.
If some metadata changed (uid/gid/permissions) only - no needs to backup the whole files again, it would be enough to keep these metadata changes in the catalog database only.

It will drastically reduce network traffic, backup storage space/resource consumption.

It's very important for large organizations with big enterprise storages - often permissions/owner changed only on big data volumes during different types of data migrations.
In most cases, it simply would not be enough space to store the millions of files once again.

--
You received this message because you are subscribed to the Google Groups "bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/bc60f6fd-f06e-c439-036b-6eeb30f384b9%40bareos.com.