ERROR: Backup failed copying files

[Guillermo González Fernández]

Hello,

I am experimenting an error during backup process.

Output of logs:

# /var/log/barman/barman.log
2015-05-04 13:29:17,208 [9501] barman.backup INFO: Backup start at xlog location: 1AB/850AE900 (00000001000001AB00000085, 000AE900)
2015-05-04 13:29:17,209 [9501] barman.backup INFO: Copying files.
2015-05-04 13:29:17,210 [9501] barman.command_wrappers INFO: Smart copy: ':/var/lib/pgsql/9.3/data/' -> '/home/barman/main/base/20150504T132532/pgdata' (ref: None, safe before None)
2015-05-04 13:29:17,210 [9501] barman.command_wrappers INFO: Smart copy step 1/4: preparation
2015-05-04 13:29:18,483 [9501] barman.command_wrappers INFO: Smart copy finished: :/var/lib/pgsql/9.3/data/ -> /home/barman/main/base/20150504T132532/pgdata (safe before None)
2015-05-04 16:44:48,753 [9501] barman.backup ERROR: Backup failed copying files.
DETAILS: Cannot terminate exclusive backup. You might have to manually execute pg_stop_backup() on your Postgres server

# backup.info
backup_label=None
begin_offset=715008
begin_time=2015-05-04 13:31:48.672572+02:00
begin_wal=00000001000001AB00000085
begin_xlog=1AB/850AE900
config_file=/var/lib/pgsql/9.3/data/postgresql.conf
deduplicated_size=None
end_offset=None
end_time=None
end_wal=None
end_xlog=None
error=failure copying files (Cannot terminate exclusive backup. You might have to manually execute pg_stop_backup() on your Postgres server)
hba_file=/var/lib/pgsql/9.3/data/pg_hba.conf
ident_file=/var/lib/pgsql/9.3/data/pg_ident.conf
mode=default
pgdata=/var/lib/pgsql/9.3/data
server_name=main
size=None
status=FAILED
tablespaces=None
timeline=1
version=90305

Apparently everything is well configured. I follow the proposed standards within the guide at http://docs.pgbarman.org/ with only two exceptions, instead of postgres user I use another user which has superuser privileges and I changed the default barman_home directory.

Output of check:

$ barman check main

Server main:

       ssh: OK

       PostgreSQL: OK

       archive_mode: OK

       archive_command: OK

       directories: OK

       retention policy settings: OK

       backup maximum age: OK (no last_backup_maximum_age provided)

       compression settings: OK

       minimum redundancy requirements: OK (have 0 backups, expected at least 0)

Output of diagnose:

$ barman diagnose
{
    "global": {
        "config": {
            "barman_home": "/home/barman",
            "barman_user": "barman",
            "compression": "gzip",
            "log_file": "/var/log/barman/barman.log",
            "reuse_backup": "link"
        },
        "system_info": {
            "barman_ver": "1.4.0",
            "kernel_ver": "Linux kemsirve 3.14.32-xxxx-std-ipv6-64 #1 SMP Sat Feb 7 12:07:25 CET 2015 x86_64 x86_64 x86_64 GNU/Linux",
            "python_ver": "Python 2.7.6",
            "release": "Distributor ID:\tUbuntu\nDescription:\tUbuntu 14.04.1 LTS\nRelease:\t14.04\nCodename:\ttrusty",
            "rsync_ver": "rsync  version 3.1.0  protocol version 31",
            "ssh_ver": "OpenSSH_6.6.1p1 Ubuntu-2ubuntu2, OpenSSL 1.0.1g 7 Apr 2014"
        }
    },
    "servers": {
        "main": {
            "backups": {
                "20150504T132532": {
                    "backup_id": "20150504T132532",
                    "backup_label": "None",
                    "begin_offset": "715008",
                    "begin_time": "Mon May  4 13:31:48 2015",
                    "begin_wal": "00000001000001AB00000085",
                    "begin_xlog": "1AB/850AE900",
                    "config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
                    "deduplicated_size": null,
                    "end_offset": null,
                    "end_time": null,
                    "end_wal": null,
                    "end_xlog": null,
                    "error": "failure copying files (Cannot terminate exclusive backup. You might have to manually execute pg_stop_backup() on your Postgres server)",
                    "hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
                    "ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
                    "mode": "default",
                    "pgdata": "/var/lib/pgsql/9.3/data",
                    "server_name": "main",
                    "size": null,
                    "status": "FAILED",
                    "tablespaces": null,
                    "timeline": 1,
                    "version": 90305
                },                
                "20150505T155703": {
                    "backup_id": "20150505T155703",
                    "backup_label": "None",
                    "begin_offset": "144",
                    "begin_time": "Tue May  5 16:03:22 2015",
                    "begin_wal": "00000001000001AE00000031",
                    "begin_xlog": "1AE/31000090",
                    "config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
                    "deduplicated_size": null,
                    "end_offset": null,
                    "end_time": null,
                    "end_wal": null,
                    "end_xlog": null,
                    "error": "failure copying files (Cannot terminate exclusive backup. You might have to manually execute pg_stop_backup() on your Postgres server)",
                    "hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
                    "ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
                    "mode": "default",
                    "pgdata": "/var/lib/pgsql/9.3/data",
                    "server_name": "main",
                    "size": null,
                    "status": "FAILED",
                    "tablespaces": null,
                    "timeline": 1,
                    "version": 90305
                }
            },
            "config": {
                "active": true,
                "backup_directory": "/home/barman/main",
                "backup_options": "exclusive_backup",
                "bandwidth_limit": null,
                "barman_home": "/home/barman",
                "basebackup_retry_sleep": 30,
                "basebackup_retry_times": 0,
                "basebackups_directory": "/home/barman/main/base",
                "compression": "gzip",
                "conninfo": "host= ... user= ...",
                "custom_compression_filter": null,
                "custom_decompression_filter": null,
                "description": "PostgreSQL Database",
                "immediate_checkpoint": false,
                "incoming_wals_directory": "/home/barman/main/incoming",
                "last_backup_maximum_age": null,
                "lock_file": "/home/barman/main/main.lock",
                "minimum_redundancy": 0,
                "name": "main",
                "network_compression": false,
                "post_archive_script": null,
                "post_backup_script": null,
                "pre_archive_script": null,
                "pre_backup_script": null,
                "retention_policy": null,
                "retention_policy_mode": "auto",
                "reuse_backup": "link",
                "ssh_command": "ssh ...@...",
                "tablespace_bandwidth_limit": null,
                "wal_retention_policy": "main",
                "wals_directory": "/home/barman/main/wals"
            },
            "status": {
                "archive_command": "rsync -a %p barman@...:/home/barman/main/incoming/%f",
                "archive_mode": "on",
                "config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
                "current_xlog": "00000001000001B2000000D2",
                "data_directory": "/var/lib/pgsql/9.3/data",
                "hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
                "ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
                "pgespresso_installed": false,
                "server_txt_version": "9.3.5"
            },
            "system_info": {
                "kernel_ver": "Linux trinfudat 2.6.32-504.1.3.el6.x86_64 #1 SMP Tue Nov 11 17:57:25 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux",
                "python_ver": "Python 2.6.6",
                "release": "LSB Version:\t:base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch\nDistributor ID:\tCentOS\nDescription:\tCentOS release 6.6 (Final)\nRelease:\t6.6\nCodename:\tFinal",
                "rsync_ver": "rsync  version 3.0.6  protocol version 30",
                "ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.1e-fips 11 Feb 2013"
            }
        }
    }
}

I hope the info provided helps to find the problem of this issue. I've been doing some research and reading similar topics with no luck.

Thanks !

[Gabriele Bartolini]

Hi Guillermo,

  My apologies for taking so long to reply.

  Can you please confirm that archiving actually works? This operation currently must be manually performed by the DBA when installing Barman (the check command performs a formal check only). From what you sent, it seems like Postgres cannot send WAL files to Barman (I see no WAL file being archived yet).

  We are thinking of making this check more robust, by preventing a backup from being taken if archiving is not properly working.

  Can you also please check the PostgreSQL log?

Thanks,

Gabriele

--
 Gabriele Bartolini - 2ndQuadrant Italia - Managing Director
 PostgreSQL Training, Services and Support
 gabriele....@2ndQuadrant.it | www.2ndQuadrant.it

--
--
You received this message because you are subscribed to the "Barman for PostgreSQL" group.
To post to this group, send email to pgba...@googlegroups.com
To unsubscribe from this group, send email to
pgbarman+u...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/pgbarman?hl=en?hl=en-GB

---
You received this message because you are subscribed to the Google Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pgbarman+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.