rsync error: error allocating core memory buffers

Hans Kraus

unread,

Apr 9, 2015, 5:23:16 AM4/9/15

to

Hi,

I've configured 'backuppc' to transfer files via rsyncd, with enabled
checksums. Whith one of the shares I get the error (in syslog):
---------------------------------------------------------------------
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
robbe rsyncd[2183]: rsync error: error allocating core memory buffers
(code 22) at util2.c(106) [sender=3.1.2dev]
robbe rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
robbe rsyncd[9821]: rsync on . from back...@elefant.control.local
(192.168.1.200)
---------------------------------------------------------------------
I read that the memory overflow comes from bulding the checksums list.

Is there a way to find out where in the file tree that overflow occurs
for determine splitting points?

The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap.

Kind regards, Hans
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Kevin Korb

unread,

Apr 9, 2015, 12:37:18 PM4/9/15

to

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

You should not be using rsync's --checksum during routine backups. It
is only for very rare use cases not every backup run.

On 04/09/2015 04:43 AM, Hans Kraus wrote:
> Hi,
>
> I've configured 'backuppc' to transfer files via rsyncd, with
> enabled checksums. Whith one of the shares I get the error (in
> syslog):
> ---------------------------------------------------------------------
>
>
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
> robbe rsyncd[2183]: rsync error: error allocating core memory
> buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe
> rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
> robbe rsyncd[9821]: rsync on . from back...@elefant.control.local
> (192.168.1.200)
> ---------------------------------------------------------------------
>
>
I read that the memory overflow comes from bulding the checksums list.
>
> Is there a way to find out where in the file tree that overflow
> occurs for determine splitting points?
>
> The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap.
>
> Kind regards, Hans

- --
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
Kevin Korb Phone: (407) 252-6853
Systems Administrator Internet:
FutureQuest, Inc. Ke...@FutureQuest.net (work)
Orlando, Florida k...@sanitarium.net (personal)
Web page: http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iEYEARECAAYFAlUmqrAACgkQVKC1jlbQAQdYnQCfSDNBGlPPbi1T0ATUlNngj3tz
fTsAn1OwEGeDdkOKf+lCaDTZEBJoS/jg
=TJEs
-----END PGP SIGNATURE-----

dev...@web.de

unread,

Apr 9, 2015, 1:31:56 PM4/9/15

to

> You should not be using rsync's --checksum during routine backups.

you know that excel can change a file`s contents without changing a file`s timestamp - do you? ;)

> Gesendet: Donnerstag, 09. April 2015 um 18:37 Uhr
> Von: "Kevin Korb" <k...@sanitarium.net>
> An: rs...@lists.samba.org
> Betreff: Re: rsync error: error allocating core memory buffers

Fabian Cenedese

unread,

Apr 10, 2015, 2:59:26 AM4/10/15

to

At 18:37 09.04.2015, Kevin Korb wrote:
>>I read that the memory overflow comes from bulding the checksums list.
>>
>> Is there a way to find out where in the file tree that overflow
>> occurs for determine splitting points?

If you run rsync with -v(v..) or --progress don't you see
where it is when it bails out?

bye Fabi