barman-cloud-backup-show is throwing 'wal_size' exception displaying a backup replica (aws s3 compatible platform)

33 views
Skip to first unread message

SteveB

unread,
Mar 13, 2023, 11:31:45 AM3/13/23
to Barman, Backup and Recovery Manager for PostgreSQL
Hello All,

We are running Barman 3.4 installed on the same host as a Postgres 14.7 database.  The operating system is RHEL 9.1.  The Barman backup method is "postgres."  We back up to local storage and use hook scripts to replicate copies of WAL files and backups to AWS S3 buckets (we are running Cloudian).  All backups and hooks script replication run successfully as far as I can tell.

Now I am trying to show backup metadata information for a backup replica in Cloudian.  When I run the "barman-cloud-backup-show" command, the high-level information is displayed properly, but before showing the "Base backup information" output it throws this exception:

2023-03-13 15:04:53,485 [85759] ERROR: Barman cloud backup show exception: 'wal_size'

Here is the full command (with changes to the URL and bucket name for security)

$ barman-cloud-backup-show  -P cloudian  --endpoint-url https://cloudian-hostname:443 s3://my-bucketname/ TESTDB2 20230312T193001
Backup 20230312T193001:
  Server Name            : TESTDB2
  System Id              : 7206443645887565823
  Status                 : DONE
  PostgreSQL Version     : 140007
  PGDATA directory       : /data/TESTDB2

  Base backup information:
2023-03-13 15:04:53,485 [85759] ERROR: Barman cloud backup show exception: 'wal_size'


Using the AWS CLI, we can list the files for the replicated backup:

$ aws --profile=cloudian --endpoint-url=https://cloudian-hostname:443  s3 ls s3://my-bucketname/TESTDB2/base/20230312T193001/
2023-03-12 19:30:05       1001 backup.info
2023-03-12 19:30:04   28211200 data.tar


The initial backup to local storage on the database/barman host can be displayed successfully:

$ barman show-backup TESTDB2 20230312T193001
Backup 20230312T193001:
  Server Name            : TESTDB2
  System Id              : 7206443645887565823
  Status                 : DONE
  PostgreSQL Version     : 140007
  PGDATA directory       : /data/TESTDB2

  Base backup information:
    Disk usage           : 25.5 MiB (25.5 MiB with WALs)
    Incremental size     : 25.5 MiB (-0.00%)
    Timeline             : 1
    Begin WAL            : 000000010000000000000035
    End WAL              : 000000010000000000000035
    WAL number           : 1
    WAL compression ratio: 99.90%
    Begin time           : 2023-03-12 19:30:01.936507+00:00
    End time             : 2023-03-12 19:30:03.149075+00:00
    Copy time            : 1 second
    Estimated throughput : 21.2 MiB/s
    Begin Offset         : 40
    End Offset           : 0
    Begin LSN            : 0/35000028
    End LSN              : 0/36000000

  WAL information:
    No of files          : 1
    Disk usage           : 16.2 KiB
    WAL rate             : 4.00/hour
    Compression ratio    : 99.90%
    Last available       : 000000010000000000000036

  Catalog information:
    Retention Policy     : VALID
    Previous Backup      : 20230311T193001
    Next Backup          : - (this is the latest base backup)

I'm wondering if this is a bug or if I am just not doing something properly.  We are still getting up to speed learning to use Barman.

Thoughts anyone?  Is more information needed to diagnose the issue?

Best regards,
Steve

Mike Wallace

unread,
Mar 13, 2023, 12:13:18 PM3/13/23
to pgba...@googlegroups.com
Hi Steve,

I can't see anything wrong with what you are doing.

I expect the issue is related to differences between the `backup.info` files created by `barman-cloud-backup` and those made by `barman backup` (and subsequently uploaded via a hook script). `barman-cloud-backup-show` should be able to handle both cases so this looks like a bug to me - I have filed https://github.com/EnterpriseDB/barman/issues/769 for further investigation.

Best,

Mike



--
--
You received this message because you are subscribed to the "Barman for PostgreSQL" group.
To post to this group, send email to pgba...@googlegroups.com
To unsubscribe from this group, send email to
pgbarman+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/pgbarman?hl=en?hl=en-GB

---
You received this message because you are subscribed to the Google Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pgbarman+u...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/pgbarman/ec673394-e905-4af6-8467-60cb54eda6c1n%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages