URGENT! Very slow rsync barman backup command

[Lorenzo Trenta]

rsync of barman backup very very very slow.

processing running:

/usr/bin/rsync -e ssh 'post...@svv00484.ti.ch' '-o' 'BatchMode=yes' '-o' 'StrictHostKeyChecking=no' --include=/PG_9.5_* --exclude=/* --exclude=pgsql_tmp* --exclude=postgresql.auto.conf.tmp --exclude=postmaster.pid --exclude=postmaster.opts --exclude=recovery.conf --exclude=pg_dynshmem/* --exclude=pg_notify/* --exclude=pg_replslot/* --exclude=pg_serial/* --exclude=pg_stat_tmp/* --exclude=pg_snapshots/* --exclude=pg_subtrans/* -rLKpts --delete-excluded --inplace --itemize-changes --itemize-changes --bwlimit=4  :/var/Postgresdata/data/ts_infopolca/ /var/lib/barman/pg_prod1_data/base/20180322T155748/32844 --files-from=/tmp/barman-foIKDH/ts_infopolca_safe_7459.list

but the barman.conf has been setting:

; Barman, Backup and Recovery Manager for PostgreSQL

; http://www.pgbarman.org/ - http://www.2ndQuadrant.com/

;

; Main configuration file

 

[barman]

; System user

barman_user = barman

 

; Directory of configuration files. Place your sections in separate files with .conf extension

; For example place the 'main' server section in /etc/barman.d/main.conf

configuration_files_directory = /etc/barman.d

 

; Main directory

barman_home = /var/lib/barman

 

; Locks directory - default: %(barman_home)s

;barman_lock_directory = /var/run/barman

 

; Log location

log_file = /var/log/barman/barman.log

 

; Log level (see https://docs.python.org/3/library/logging.html#levels)

log_level = INFO

 

; Default compression level: possible values are None (default), bzip2, gzip, pigz, pygzip or pybzip2

;compression = gzip

 

; Pre/post backup hook scripts

;pre_backup_script = env | grep ^BARMAN

;pre_backup_retry_script = env | grep ^BARMAN

;post_backup_retry_script = env | grep ^BARMAN

;post_backup_script = env | grep ^BARMAN

 

; Pre/post archive hook scripts

;pre_archive_script = env | grep ^BARMAN

;pre_archive_retry_script = env | grep ^BARMAN

;post_archive_retry_script = env | grep ^BARMAN

;post_archive_script = env | grep ^BARMAN

 

; Global retention policy (REDUNDANCY or RECOVERY WINDOW) - default empty

;retention_policy =

 

; Global bandwidth limit in KBPS - default 0 (meaning no limit)

;bandwidth_limit = 4000

 

; Number of parallel jobs for backup and recovery via rsync (default 1)

;parallel_jobs = 1

 

; Immediate checkpoint for backup command - default false

[Armen Ghahramanyan]

I changed rsync to streaming replicaiton and the backup process now is faster.

On Thursday, March 22, 2018 at 7:12:38 PM UTC+4, Lorenzo Trenta wrote:

rsync of barman backup very very very slow.

processing running:

/usr/bin/rsync -e ssh 'pos...@svv00484.ti.ch' '-o' 'BatchMode=yes' '-o' 'StrictHostKeyChecking=no' --include=/PG_9.5_* --exclude=/* --exclude=pgsql_tmp* --exclude=postgresql.auto.conf.tmp --exclude=postmaster.pid --exclude=postmaster.opts --exclude=recovery.conf --exclude=pg_dynshmem/* --exclude=pg_notify/* --exclude=pg_replslot/* --exclude=pg_serial/* --exclude=pg_stat_tmp/* --exclude=pg_snapshots/* --exclude=pg_subtrans/* -rLKpts --delete-excluded --inplace --itemize-changes --itemize-changes --bwlimit=4  :/var/Postgresdata/data/ts_infopolca/ /var/lib/barman/pg_prod1_data/base/20180322T155748/32844 --files-from=/tmp/barman-foIKDH/ts_infopolca_safe_7459.list