PLEASE HELpBarman Incremental backup and full backup very slow

15 views
Skip to first unread message

savita...@gmail.com

unread,
Mar 9, 2022, 11:46:40 PM3/9/22
to Barman, Backup and Recovery Manager for PostgreSQL
I am doing Full backup and incremental backup using barman rsync method and using --jobs 4 and parallel_jobs =4  , but Both full and incremental backups are very slow and taking exactly same time. 

barman@Backup-server:~$ barman list-backup server
server 20220310T010003 - STARTED
server 20220309T030003 - Wed Mar  9 06:26:02 2022 - Size: 1.5 TiB - WAL Size: 38.6 GiB
server 20220308T220003 - Wed Mar  9 01:45:22 2022 - Size: 1.5 TiB - WAL Size: 7.1 GiB
server 20220308T010003 - Tue Mar  8 04:28:17 2022 - Size: 1.5 TiB - WAL Size: 49.0 GiB
server 20220306T220004 - Mon Mar  7 22:12:32 2022 - Size: 1.5 TiB - WAL Size: 21.4 GiB
server 20220306T030002 - Sun Mar  6 07:06:09 2022 - Size: 1.5 TiB - WAL Size: 70.4 GiB
server 20220305T220002 - Sun Mar  6 02:16:31 2022 - Size: 1.5 TiB - WAL Size: 8.7 GiB

SO if take the incremental backup id (wal size 7.1GB) The copy time is 
    Copy time            : 3 hours, 45 minutes, 10 seconds + 2 seconds startup 
barman@Backup-server:~$ barman show-backup server 20220308T220003
Backup 20220308T220003:
  Server Name            : server
  System Id              : 6595745951660340829
  Status                 : DONE
  PostgreSQL Version     : 100010
  PGDATA directory       : /mnt/data/postgresql/10/main

  Base backup information:
    Disk usage           : 1.5 TiB (1.5 TiB with WALs)
    Incremental size     : 1.0 TiB (-30.51%)
    Timeline             : 1
    Begin WAL            : 000000010001162E000000A2
    End WAL              : 000000010001163C00000073
    WAL number           : 3538
    WAL compression ratio: 58.16%
    Begin time           : 2022-03-08 22:00:03.902821+00:00
    End time             : 2022-03-09 01:45:22.923195+00:00
    Copy time            : 3 hours, 45 minutes, 10 seconds + 2 seconds startup
    Estimated throughput : 79.9 MiB/s (2 jobs)
    Begin Offset         : 164128
    End Offset           : 2208976
    Begin LSN           : 1162E/A2028120
    End LSN             : 1163C/7321B4D0

  WAL information:
    No of files          : 1229
    Disk usage           : 7.1 GiB
    WAL rate             : 565.43/hour
    Compression ratio    : 63.16%
    Last available       : 000000010001164100000040

  Catalog information:
    Retention Policy     : VALID
    Previous Backup      : 20220308T010003
    Next Backup          : 20220309T030003


ANd Full BACkup
    Copy time            : 3 hours, 28 minutes, 5 seconds + 2 seconds startup
barman@backup-server:~$ barman show-backup server 20220308T010003
Backup 20220308T010003:
  Server Name            : server
  System Id              : 6595745951660340829
  Status                 : DONE
  PostgreSQL Version     : 100010
  PGDATA directory       : /mnt/data/postgresql/10/main

  Base backup information:
    Disk usage           : 1.5 TiB (1.5 TiB with WALs)
    Incremental size     : 1.0 TiB (-30.60%)
    Timeline             : 1
    Begin WAL            : 000000010001161A00000031
    End WAL              : 000000010001161C00000058
    WAL number           : 552
    WAL compression ratio: 60.09%
    Begin time           : 2022-03-08 01:00:03.519559+00:00
    End time             : 2022-03-08 04:28:17.502676+00:00
    Copy time            : 3 hours, 28 minutes, 5 seconds + 2 seconds startup
    Estimated throughput : 86.3 MiB/s (2 jobs)
    Begin Offset         : 2223104
    End Offset           : 14919200
    Begin LSN           : 1161A/3121EC00
    End LSN             : 1161C/58E3A620

  WAL information:
    No of files          : 8219
    Disk usage           : 49.0 GiB
    WAL rate             : 354.34/hour
    Compression ratio    : 61.87%
    Last available       : 000000010001163C00000073

  Catalog information:
    Retention Policy     : VALID
    Previous Backup      : 20220306T220004

Luca Ferrari

unread,
Mar 10, 2022, 8:37:38 AM3/10/22
to Barman, Backup and Recovery Manager for PostgreSQL
On Thu, Mar 10, 2022 at 5:46 AM savita...@gmail.com
<savita...@gmail.com> wrote:
>
> I am doing Full backup and incremental backup using barman rsync method and using --jobs 4 and parallel_jobs =4 , but Both full and incremental backups are very slow and taking exactly same time.

AFAIK barman does always a full backup.

Luca
Reply all
Reply to author
Forward
0 new messages