vastly differing backup speeds

[Erich Eckner]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hi,

I see vastly differing backup speeds on a single machine, single partition
- - the jobs only differ regarding FileSets (and name/description, of
course):

FileSet {
Name = "Set1"
Description = "Backup Set1"
Include {
Options {
Signature = MD5 # calculate md5 checksum per file
One FS = yes # change into other filessytems
No Atime = yes
Sparse = yes
}
File = /home/user
}
Exclude {
File = /home/user/sub/directory
}
}
FileSet {
Name = "Set2"
Description = "Backup Set2"
Include {
Options {
Signature = MD5 # calculate md5 checksum per file
One FS = yes # change into other filessytems
No Atime = yes
Sparse = yes
}
File = /home/user/sub/directory
}
}

Set1 took ~2.5 days for ~6 GB and Set2 has already backed up 60 GB within
the first few hours. Neither cpu nor io was saturated during the backup of
Set1.

I suspect Set1 to have smaller, slightly compressable files and Set2 to
have larger, uncompressable files - does this rectify this huge difference
in speed or should I look for something else?

In case it matters: This is ext4 on luks. The machine encrypts the backups
(but again: identical for both). The os is archlinux32.

regards,
Erich

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEE3p92iMrPBP64GmxZCu7JB1Xae1oFAl6AYgUACgkQCu7JB1Xa
e1qxPA/9H+X17puj4O+vPE43if7VSblyDlJZm4oeaqjwHObfCz5eArqpWGVl0Kq6
WFqLeipHBzEDVyKTmgYpFXdaYbfkvWo4c9Ns+873aat6CAiiKsB2ufgoW/JfjiCc
pkTxr0nzq2FajUkS1UEzDpGgUhqQgbeiWABKqZwVU2lofry6nBjvthVAvIUrxJCa
Gn2+MT76QXFycQgHJ93BJMVo4hh5ecgEWQv58+PuE667a0G2TJ5NkC+PXBhrIfUu
HIPPlzB2gshXzTYiR6CRQWDWCeoDpk10K0UIPMqv7gdCG4aKAQ2gfiRkGUI8Y4pB
cux1Gwebz8iBdwFTZS135fjdnsm9KuaihTe9W4Tck2YZ+lU93DfxQxI35STY6DbB
8GbjYx5bMkhy78ZaRSpzvX5NJky3ycTgLGKWBLsogfbfr9hYbDtqaZbYXlTQQTeJ
G0vrdd0CKAu/yR++xRcYOojIBkBd8o7Pj4mI3ebADwcGf7V3XcieqZ47N8bOCKuw
qDW40acD4kLqK632isz5kHJudF0EQwF+G7G7Tfe5Q1uUioH8/vE5Inz8blvIkRaD
nHflgLZMbMLb+Blmm4dRXGLOlLDPEYIzBX1slKMLDBzZD5shFmGGYlM22b9AZotY
yOPn0TVHwJMN2phF7v4M8KGeBXsW3HW06mU2TH0Yci6xX6+gtiM=
=wAE/
-----END PGP SIGNATURE-----

[Philipp Storz]

Hello Erich,

the only way that I can think of is that you are backing up your own storage which reusults in a
loop. Is this possible?

Am 29.03.20 um 10:53 schrieb Erich Eckner:

Mit freundlichen Grüßen

Philipp Storz philip...@bareos.com
Bareos GmbH & Co. KG Phone: +49 221 63 06 93-92
http://www.bareos.com Fax: +49 221 63 06 93-10

Sitz der Gesellschaft: Köln | Amtsgericht Köln: HRA 29646
Geschäftsführer: Stephan Dühr, M. Außendorf,
J. Steffens, P. Storz

[Erich Eckner]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hello Philipp,

no, this client does not also host the director or storage daemon.

Once all my backups are through, I'll check with some low-level tool, if
there is any difference in read speed between those file sets (but I don't
want to skew the results by having concurring reads
on the disk).

cheers,
Erich

> --
> You received this message because you are subscribed to the Google Groups "bareos-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to bareos-users...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/bareos-users/dc194c4e-1ff5-31d8-0e0e-cb5f4df242ff%40bareos.com.
>
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEE3p92iMrPBP64GmxZCu7JB1Xae1oFAl6Akq8ACgkQCu7JB1Xa
e1oDsQ//ZOjTsFAi3n8wyunYT3e2w7SvFfiJf/ITioJqZzq58Y+sv7bdEeg8Uy7F
ern+No3oXqUy1Ivl6dFjgEL37fhgJ1RhNTXHLl2u63uo+kvTo/mZTfGXxkcy2XNC
mpl0HIP0ijnS3JTIPZ8WLXoCCc6RtpYEvYzjkC9CcBtWvjxHp2mm8JzhkZGfkeLF
xlTZkOCQtVb8jRp2c2/0irDTDdmG1mCemdWLNYojePENi4geJobQTauBDqxmpF+m
W3Gz1wcGRLVxBCVBtXolhOIAFuUIYL9SZ99RVuxo73V+eu28n2XsUVEW6d40XTm0
p1YmcpOFa/ThJKvTJTJKLdKqBeUWUR8vX3W4MKE8PTYf3011dHv4D0ENZ4FozZ5P
056MdJlaR7v4HJz6qWPiRE/wp60M84ncWUBwSjUIL0e2nqyRW3ojecW4vxE//x5K
O62tQq4LlIPW85euUns5j2COqbP1cLzMRVLuqZWs0UqjDH+K9Cbsaxigr8X6Ep9G
PCRIlQy0Y7ugBP/vRBjpWRQ2+geQIp5KCnGdDPtLx3jouTciYr17VXpO7Fz6thqS
B6f56pugmm/gcuBigIPEv/v6v6/XoOjMgosrKecSCvuG3NBRam5fycIsUSKF7GT0
mZs2Scdk7WhGwEdQarcie6i/X4gR+e0GJYzqG4SrYScWvv1/+yI=
=98mj
-----END PGP SIGNATURE-----