barman check:'continuous archiving' failed even though I can see it is working fine: all tests are O

1,157 views
Skip to first unread message

Fabien Vernaz

unread,
Jan 10, 2019, 4:15:59 PM1/10/19
to Barman, Backup and Recovery Manager for PostgreSQL
My barman was worknig smoothly until, the barman server ran out of diskspace, the dispac eissue is now resolved but I cannot restart barman!

below the commands I ran
my barman check tells me 
ERROR: Check 'continuous archiving' failed

I tried the switch-log --force --archive without error, I cleaned the WALs at the source too just in case one of them was corrupt

but I still can figure out what is wrong, all the checks I've read about are OK, just the barman check fails and prevents me from running a backup
pg_backup works I might add!


Any idea what I might try at this point?


postgres@alpha:/home/fabien$ barman cron
2019-01-10 22:04:47,985 [3461] barman.utils WARNING: Failed opening the requested log file. Using standard error instead.
Starting WAL archiving for server pg
Starting WAL archiving for server streaming
Starting streaming archiver for server streaming

The below should indicate the the receivewal actually works fine

postgres@alpha:/home/fabien$ barman switch-xlog --force  pg
2019-01-10 22:04:52,001 [3466] barman.utils WARNING: Failed opening the requested log file. Using standard error instead.
2019-01-10 22:04:52,020 [3466] barman.server INFO: Force a CHECKPOINT before pg_switch_wal()
The WAL file 000000010000020000000031 has been closed on server 'pg'
2019-01-10 22:04:52,640 [3466] barman.server INFO: The WAL file 000000010000020000000031 has been closed on server 'pg'

barman disagrees

postgres@alpha:/home/fabien$ barman check pg
2019-01-10 22:05:01,399 [3476] barman.utils WARNING: Failed opening the requested log file. Using standard error instead.
Server pg:
        PostgreSQL: OK
        is_superuser: OK
        PostgreSQL streaming: OK
        wal_level: OK
        replication slot: OK
        directories: OK
        retention policy settings: OK
        backup maximum age: OK (no last_backup_maximum_age provided)
        compression settings: OK
        failed backups: OK (there are 0 failed backups)
2019-01-10 22:05:01,788 [3476] barman.server ERROR: Check 'minimum redundancy requirements' failed for server 'pg'
        minimum redundancy requirements: FAILED (have 0 backups, expected at least 2)
        pg_basebackup: OK
        pg_basebackup compatible: OK
        pg_basebackup supports tablespaces mapping: OK
        archive_mode: OK
        archive_command: OK
2019-01-10 22:05:01,805 [3476] barman.server ERROR: Check 'continuous archiving' failed for server 'pg'
        continuous archiving: FAILED
        pg_receivexlog: OK
        pg_receivexlog compatible: OK
        receive-wal running: OK
        archiver errors: OK

I do have WALs coming in ...

postgres@alpha:/home/fabien$ ls ../barman/pg/wals/
0000000100000200  xlog.db

postgres@alpha:/home/fabien$ cat ../barman/pg/wals/xlog.db
000000010000020000000014        16777216        1547152623.77   None
000000010000020000000015        16777216        1547152667.3    None
000000010000020000000016        16777216        1547152671.74   None
000000010000020000000017        16777216        1547152722.51   None
000000010000020000000018        16777216        1547152814.31   None
000000010000020000000019        16777216        1547152838.87   None
00000001000002000000001A        16777216        1547153054.24   None
00000001000002000000001B        16777216        1547153070.15   None
00000001000002000000001C        16777216        1547153300.2    None
00000001000002000000001D        16777216        1547153344.77   None
00000001000002000000001E        16777216        1547153533.41   None
00000001000002000000001F        16777216        1547153614.99   None
000000010000020000000020        16777216        1547153637.88   None
000000010000020000000021        16777216        1547153723.89   None
000000010000020000000022        16777216        1547153787.25   None
000000010000020000000023        16777216        1547153803.78   None
000000010000020000000024        16777216        1547153821.28   None
000000010000020000000025        16777216        1547154124.1    None
000000010000020000000026        16777216        1547154125.82   None
000000010000020000000027        16777216        1547154127.53   None
000000010000020000000028        16777216        1547154129.22   None
000000010000020000000029        16777216        1547154130.84   None
00000001000002000000002A        16777216        1547154150.76   None
00000001000002000000002B        16777216        1547154158.5    None
00000001000002000000002C        16777216        1547154204.03   None
00000001000002000000002D        16777216        1547154237.16   None
00000001000002000000002E        16777216        1547154238.69   None
00000001000002000000002F        16777216        1547154243.89   None
000000010000020000000030        16777216        1547154279.82   None


in case there is something interesting in there

postgres@alpha:/home/fabien$ barman show-server pg
2019-01-10 22:05:09,446 [3479] barman.utils WARNING: Failed opening the requested log file. Using standard error instead.
Server pg:
        active: True
        archive_command: test ! -f /var/lib/postgresql/wal_archive/%f && cp %p /var/lib/postgresql/wal_archive/%f
        archive_mode: on
        archived_count: 18941
        archiver: True
        archiver_batch_size: 0
        backup_directory: /home/barman/pg
        backup_method: postgres
        backup_options: BackupOptions(['concurrent_backup'])
        bandwidth_limit: None
        barman_home: /home/barman
        barman_lock_directory: /home/barman
        basebackup_retry_sleep: 30
        basebackup_retry_times: 0
        basebackups_directory: /home/barman/pg/base
        check_timeout: 30
        compression: None
        config_file: /etc/postgresql/10/main/postgresql.conf
        connection_error: None
        conninfo: host=gamma.kylogic.com user=postgres
        current_archived_wals_per_second: 0.0137986091909
        current_size: 186975846173
        current_xlog: 000000010000020000000033
        custom_compression_filter: None
        custom_decompression_filter: None
        data_directory: /home/postgresql/10/main
        description: “PG Backup”
        disabled: False
        errors_directory: /home/barman/pg/errors
        failed_count: 18978
        hba_file: /etc/postgresql/10/main/pg_hba.conf
        ident_file: /etc/postgresql/10/main/pg_ident.conf
        immediate_checkpoint: False
        incoming_wals_directory: /home/barman/pg/incoming
        is_archiving: False
        is_in_recovery: False
        is_superuser: True
        last_archived_time: 2019-01-08 19:00:43.652172+01:00
        last_archived_wal: 00000001000001EC000000A1
        last_backup_maximum_age: None
        last_failed_time: 2019-01-10 22:05:07.566053+01:00
        last_failed_wal: 00000001000001EC000000A2
        max_incoming_wals_queue: None
        minimum_redundancy: 2
        msg_list: []
        name: pg
        network_compression: False
        parallel_jobs: 1
        path_prefix: None
        pg_basebackup_bwlimit: True
        pg_basebackup_compatible: True
        pg_basebackup_installed: True
        pg_basebackup_path: /usr/bin/pg_basebackup
        pg_basebackup_tbls_mapping: True
        pg_basebackup_version: 10.6-0ubuntu0.18.04.1)
        pg_receivexlog_compatible: True
        pg_receivexlog_installed: True
        pg_receivexlog_path: /usr/bin/pg_receivewal
        pg_receivexlog_supports_slots: True
        pg_receivexlog_synchronous: False
        pg_receivexlog_version: 10.6-0ubuntu0.18.04.1)
        pgespresso_installed: False
        post_archive_retry_script: None
        post_archive_script: None
        post_backup_retry_script: None
        post_backup_script: None
        post_delete_retry_script: None
        post_delete_script: None
        post_recovery_retry_script: None
        post_recovery_script: None
        post_wal_delete_retry_script: None
        post_wal_delete_script: None
        pre_archive_retry_script: None
        pre_archive_script: None
        pre_backup_retry_script: None
        pre_backup_script: None
        pre_delete_retry_script: None
        pre_delete_script: None
        pre_recovery_retry_script: None
        pre_recovery_script: None
        pre_wal_delete_retry_script: None
        pre_wal_delete_script: None
        recovery_options: RecoveryOptions([])
        replication_slot: Record(slot_name='barman', active=True, restart_lsn='200/33000000')
        replication_slot_support: True
        retention_policy: REDUNDANCY 5
        retention_policy_mode: auto
        reuse_backup: None
        server_txt_version: 10.6
        slot_name: barman
        ssh_command: None
        stats_reset: 2018-12-26 00:47:14.970257+01:00
        streaming: True
        streaming_archiver: True
        streaming_archiver_batch_size: 0
        streaming_archiver_name: barman_receive_wal
        streaming_backup_name: barman_streaming_backup
        streaming_conninfo: host=gamma.kylogic.com user=postgres dbname=postgres
        streaming_supported: True
        streaming_wals_directory: /home/barman/pg/streaming
        synchronous_standby_names: ['']
        systemid: 6615270058508820573
        tablespace_bandwidth_limit: None
        timeline: 1
        wal_level: replica
        wal_retention_policy: MAIN
        wals_directory: /home/barman/pg/wals
        xlogpos: 200/335B0F18

Reply all
Reply to author
Forward
0 new messages