Cannot perform backup
573 views
Skip to first unread message
minhdanh72
May 28, 2014, 6:47:00 AM5/28/14
to pgba...@googlegroups.com
Hello
I'm having a problem getting barman run correctly
at the moment i've finished all the needed steps (on barman server and postgres server. 'barman check' says everything is OK)
but as I run 'barman backup db-server', it returns a 'Copying files' message, and seems do nothing else, the message just stays there for long long time
as I look at the log file, I see some lines like these:
2014-05-28 05:37:02,232 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-28 05:37:02,238 barman.backup INFO: no file found
2014-05-28 05:38:01,502 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-28 05:38:01,508 barman.backup INFO: no file found
'barman list-backup db-server' returns:
my-db 20140528T052946 - STARTED
my-db 20140527T112156 - STARTED
my-db 20140527T111803 - FAILED
my-db 20140527T111236 - FAILED
my-db 20140527T105809 - FAILED
my-db 20140527T105733 - FAILED
my-db 20140527T100200 - STARTED
Giulio Calacoci
May 28, 2014, 7:51:31 AM5/28/14
to pgba...@googlegroups.com
Hi,
could you provide us a snippet of the logfile regarding this error?
I have some question for you,
which barman version are you using?
could you please provide us the output of:
* barman check <servername>
* barman check <servername>
* barman status <servername>
* barman diagnose (if you are using at least barman 1.3.1)
could you provide us a snippet of the logfile regarding this error?
Thank you.
Giulio
minhdanh72
May 28, 2014, 11:22:43 AM5/28/14
to pgba...@googlegroups.com
Hi,
I'm using baman 1.3.2 on a Centox 6.5 box.
Here are the output of the above commands:
bash-4.1$ barman check server-db
Server pitch6-db:
ssh: OK
PostgreSQL: OK
archive_mode: OK
archive_command: OK
directories: OK
retention policy settings: OK
compression settings: OK
minimum redundancy requirements: OK (have 0 backups, expected at least 0)
bash-4.1$ barman status server-db
Server server-db:
Description: Pitch6 PostgreSQL Database
PostgreSQL version: 9.3.4
pgespresso extension: Not available
PostgreSQL Data directory: /var/lib/pgsql/9.3/data
PostgreSQL 'archive_command' setting: rsync -a %p bar...@10.130.232.46:/var/lib/barman/server-db/incoming/%f
Archive status: last shipped WAL segment None
Current WAL segment: 000000010000000000000014
Retention policies: not enforced
No. of available backups: 0
First available backup: None
Last available backup: None
Minimum redundancy requirements: satisfied (0/0)
bash-4.1$ barman diagnose
{
"global": {
"config": {
"barman_home": "/var/lib/barman",
"barman_user": "barman",
"configuration_files_directory": "/etc/barman/conf.d",
"log_file": "/var/log/barman/barman.log"
},
"system_info": {
"kernel_ver": "Linux server-backup 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.5 (Final)",
"rsync_ver": "rsync version 3.0.6 protocol version 30",
"ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.1e-fips 11 Feb 2013"
}
},
"servers": {
"server-db": {
"backups": {
"20140527T100200": {
"backup_id": "20140527T100200",
"backup_label": "None",
"begin_offset": "40",
"begin_time": "Tue May 27 10:02:00 2014",
"begin_wal": "00000001000000000000000B",
"begin_xlog": "0/B000028",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": null,
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"mode": "default",
"pgdata": "/var/lib/pgsql/9.3/data",
"server_name": "server-db",
"size": null,
"status": "STARTED",
"tablespaces": null,
"timeline": 1,
"version": 90304
},
"20140527T105733": {
"backup_id": "20140527T105733",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T105809": {
"backup_id": "20140527T105809",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T111236": {
"backup_id": "20140527T111236",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T111803": {
"backup_id": "20140527T111803",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T112156": {
"backup_id": "20140527T112156",
"backup_label": "None",
"begin_offset": "40",
"begin_time": "Tue May 27 11:21:56 2014",
"begin_wal": "000000010000000000000010",
"begin_xlog": "0/10000028",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": null,
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"mode": "default",
"pgdata": "/var/lib/pgsql/9.3/data",
"server_name": "server-db",
"size": null,
"status": "STARTED",
"tablespaces": null,
"timeline": 1,
"version": 90304
},
"20140528T052946": {
"backup_id": "20140528T052946",
"backup_label": "None",
"begin_offset": "40",
"begin_time": "Wed May 28 05:29:46 2014",
"begin_wal": "000000010000000000000013",
"begin_xlog": "0/13000028",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": null,
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"mode": "default",
"pgdata": "/var/lib/pgsql/9.3/data",
"server_name": "server-db",
"size": null,
"status": "STARTED",
"tablespaces": null,
"timeline": 1,
"version": 90304
}
},
"config": {
"active": true,
"backup_directory": "/var/lib/barman/server-db",
"backup_options": "exclusive_backup",
"bandwidth_limit": null,
"barman_home": "/var/lib/barman",
"basebackups_directory": "/var/lib/barman/server-db/base",
"compression": null,
"conninfo": "host=10.130.232.45 user=postgres",
"custom_compression_filter": null,
"custom_decompression_filter": null,
"description": "Pitch6 PostgreSQL Database",
"immediate_checkpoint": false,
"incoming_wals_directory": "/var/lib/barman/server-db/incoming",
"lock_file": "/var/lib/barman/server-db/server-db.lock",
"minimum_redundancy": 0,
"name": "server-db",
"network_compression": false,
"post_backup_script": null,
"pre_backup_script": null,
"retention_policy": null,
"retention_policy_mode": "auto",
"ssh_command": "ssh post...@10.130.232.45",
"tablespace_bandwidth_limit": null,
"wal_retention_policy": "main",
"wals_directory": "/var/lib/barman/server-db/wals"
},
"status": {
"archive_command": "rsync -a %p bar...@10.130.232.46:/var/lib/barman/server-db/incoming/%f",
"archive_mode": "on",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"current_xlog": "000000010000000000000014",
"data_directory": "/var/lib/pgsql/9.3/data",
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"last_shipped_wal": null,
"pgespresso_installed": false,
"server_txt_version": "9.3.4"
},
"system_info": {
"kernel_ver": "Linux server-db 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.5 (Final)",
"rsync_ver": "bash: rsync: command not found",
"ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.1e-fips 11 Feb 2013"
}
}
}
}
And the log file have a lot of lines like these:
2014-05-28 11:14:02,189 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:14:02,200 barman.backup INFO: no file found
2014-05-28 11:15:01,465 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:15:01,470 barman.backup INFO: no file found
2014-05-28 11:16:01,737 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:16:01,743 barman.backup INFO: no file found
2014-05-28 11:17:01,993 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:17:01,999 barman.backup INFO: no file found
I'm using baman 1.3.2 on a Centox 6.5 box.
Here are the output of the above commands:
bash-4.1$ barman check server-db
Server pitch6-db:
ssh: OK
PostgreSQL: OK
archive_mode: OK
archive_command: OK
directories: OK
retention policy settings: OK
compression settings: OK
minimum redundancy requirements: OK (have 0 backups, expected at least 0)
bash-4.1$ barman status server-db
Server server-db:
Description: Pitch6 PostgreSQL Database
PostgreSQL version: 9.3.4
pgespresso extension: Not available
PostgreSQL Data directory: /var/lib/pgsql/9.3/data
PostgreSQL 'archive_command' setting: rsync -a %p bar...@10.130.232.46:/var/lib/barman/server-db/incoming/%f
Archive status: last shipped WAL segment None
Current WAL segment: 000000010000000000000014
Retention policies: not enforced
No. of available backups: 0
First available backup: None
Last available backup: None
Minimum redundancy requirements: satisfied (0/0)
bash-4.1$ barman diagnose
{
"global": {
"config": {
"barman_home": "/var/lib/barman",
"barman_user": "barman",
"configuration_files_directory": "/etc/barman/conf.d",
"log_file": "/var/log/barman/barman.log"
},
"system_info": {
"kernel_ver": "Linux server-backup 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.5 (Final)",
"rsync_ver": "rsync version 3.0.6 protocol version 30",
"ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.1e-fips 11 Feb 2013"
}
},
"servers": {
"server-db": {
"backups": {
"20140527T100200": {
"backup_id": "20140527T100200",
"backup_label": "None",
"begin_offset": "40",
"begin_time": "Tue May 27 10:02:00 2014",
"begin_wal": "00000001000000000000000B",
"begin_xlog": "0/B000028",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": null,
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"mode": "default",
"pgdata": "/var/lib/pgsql/9.3/data",
"server_name": "server-db",
"size": null,
"status": "STARTED",
"tablespaces": null,
"timeline": 1,
"version": 90304
},
"20140527T105733": {
"backup_id": "20140527T105733",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T105809": {
"backup_id": "20140527T105809",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T111236": {
"backup_id": "20140527T111236",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T111803": {
"backup_id": "20140527T111803",
"backup_label": "None",
"begin_offset": null,
"begin_time": null,
"begin_wal": null,
"begin_xlog": null,
"config_file": null,
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": "failure detecting data directory (FATAL: no pg_hba.conf entry for host \"10.130.232.46\", user \"postgres\", database \"postgres\", SSL off)",
"hba_file": null,
"ident_file": null,
"mode": "default",
"pgdata": null,
"server_name": "server-db",
"size": null,
"status": "FAILED",
"tablespaces": null,
"timeline": null,
"version": null
},
"20140527T112156": {
"backup_id": "20140527T112156",
"backup_label": "None",
"begin_offset": "40",
"begin_time": "Tue May 27 11:21:56 2014",
"begin_wal": "000000010000000000000010",
"begin_xlog": "0/10000028",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": null,
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"mode": "default",
"pgdata": "/var/lib/pgsql/9.3/data",
"server_name": "server-db",
"size": null,
"status": "STARTED",
"tablespaces": null,
"timeline": 1,
"version": 90304
},
"20140528T052946": {
"backup_id": "20140528T052946",
"backup_label": "None",
"begin_offset": "40",
"begin_time": "Wed May 28 05:29:46 2014",
"begin_wal": "000000010000000000000013",
"begin_xlog": "0/13000028",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"end_offset": null,
"end_time": null,
"end_wal": null,
"end_xlog": null,
"error": null,
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"mode": "default",
"pgdata": "/var/lib/pgsql/9.3/data",
"server_name": "server-db",
"size": null,
"status": "STARTED",
"tablespaces": null,
"timeline": 1,
"version": 90304
}
},
"config": {
"active": true,
"backup_directory": "/var/lib/barman/server-db",
"backup_options": "exclusive_backup",
"bandwidth_limit": null,
"barman_home": "/var/lib/barman",
"basebackups_directory": "/var/lib/barman/server-db/base",
"compression": null,
"conninfo": "host=10.130.232.45 user=postgres",
"custom_compression_filter": null,
"custom_decompression_filter": null,
"description": "Pitch6 PostgreSQL Database",
"immediate_checkpoint": false,
"incoming_wals_directory": "/var/lib/barman/server-db/incoming",
"lock_file": "/var/lib/barman/server-db/server-db.lock",
"minimum_redundancy": 0,
"name": "server-db",
"network_compression": false,
"post_backup_script": null,
"pre_backup_script": null,
"retention_policy": null,
"retention_policy_mode": "auto",
"ssh_command": "ssh post...@10.130.232.45",
"tablespace_bandwidth_limit": null,
"wal_retention_policy": "main",
"wals_directory": "/var/lib/barman/server-db/wals"
},
"status": {
"archive_command": "rsync -a %p bar...@10.130.232.46:/var/lib/barman/server-db/incoming/%f",
"archive_mode": "on",
"config_file": "/var/lib/pgsql/9.3/data/postgresql.conf",
"current_xlog": "000000010000000000000014",
"data_directory": "/var/lib/pgsql/9.3/data",
"hba_file": "/var/lib/pgsql/9.3/data/pg_hba.conf",
"ident_file": "/var/lib/pgsql/9.3/data/pg_ident.conf",
"last_shipped_wal": null,
"pgespresso_installed": false,
"server_txt_version": "9.3.4"
},
"system_info": {
"kernel_ver": "Linux server-db 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.5 (Final)",
"rsync_ver": "bash: rsync: command not found",
"ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.1e-fips 11 Feb 2013"
}
}
}
}
And the log file have a lot of lines like these:
2014-05-28 11:14:02,189 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:14:02,200 barman.backup INFO: no file found
2014-05-28 11:15:01,465 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:15:01,470 barman.backup INFO: no file found
2014-05-28 11:16:01,737 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:16:01,743 barman.backup INFO: no file found
2014-05-28 11:17:01,993 barman.backup INFO: Processing xlog segments for server-db
2014-05-28 11:17:01,999 barman.backup INFO: no file found
Giulio Calacoci
May 29, 2014, 3:48:33 AM5/29/14
to pgba...@googlegroups.com
Hi,
How big is your database?
I have to ask if you please could activate the debug mode
in the configuration file using "log_level = DEBUG", and perform a
backup.
doing so we will see in the log file additional information
regards
Giulio
Nella citazione in data mer 28 mag 2014 17:22:43 CEST, minhdanh72 ha
scritto:
> --
> --
> You received this message because you are subscribed to the "Barman
> for PostgreSQL" group.
> To post to this group, send email to pgba...@googlegroups.com
> To unsubscribe from this group, send email to
> pgbarman+u...@googlegroups.com
> For more options, visit this group at
> http://groups.google.com/group/pgbarman?hl=en?hl=en-GB
>
> ---
> You received this message because you are subscribed to the Google
> Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to pgbarman+u...@googlegroups.com
> <mailto:pgbarman+u...@googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.
--
Giulio Calacoci - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
giulio....@2ndQuadrant.it | www.2ndQuadrant.it
How big is your database?
I have to ask if you please could activate the debug mode
in the configuration file using "log_level = DEBUG", and perform a
backup.
doing so we will see in the log file additional information
regards
Giulio
Nella citazione in data mer 28 mag 2014 17:22:43 CEST, minhdanh72 ha
scritto:
> --
> You received this message because you are subscribed to the "Barman
> for PostgreSQL" group.
> To post to this group, send email to pgba...@googlegroups.com
> To unsubscribe from this group, send email to
> pgbarman+u...@googlegroups.com
> For more options, visit this group at
> http://groups.google.com/group/pgbarman?hl=en?hl=en-GB
>
> ---
> You received this message because you are subscribed to the Google
> Groups "Barman, Backup and Recovery Manager for PostgreSQL" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to pgbarman+u...@googlegroups.com
> <mailto:pgbarman+u...@googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.
--
Giulio Calacoci - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
giulio....@2ndQuadrant.it | www.2ndQuadrant.it
minhdanh72
May 29, 2014, 4:04:42 AM5/29/14
to pgba...@googlegroups.com
The database is quite small (just about 1MB). I added the line 'log_level = DEBUG' to barman's configuration file and here how the log file looks like:
2014-05-29 03:55:01,292 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 03:55:01,292 barman.cli DEBUG: Replacing output stream
2014-05-29 03:55:01,320 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 03:55:01,327 barman.backup INFO: no file found
2014-05-29 03:56:01,440 barman.cli DEBUG: Loading additional configuration files
2014-05-29 03:56:01,440 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 03:56:01,440 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 03:56:01,440 barman.cli DEBUG: Replacing output stream
2014-05-29 03:56:01,452 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 03:56:01,455 barman.backup INFO: no file found
2014-05-29 03:57:01,694 barman.cli DEBUG: Loading additional configuration files
2014-05-29 03:57:01,696 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 03:57:01,697 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 03:57:01,697 barman.cli DEBUG: Replacing output stream
2014-05-29 03:57:01,723 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 03:57:01,730 barman.backup INFO: no file found
2014-05-29 03:58:01,956 barman.cli DEBUG: Loading additional configuration files
2014-05-29 03:58:01,957 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 03:58:01,958 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 03:58:01,958 barman.cli DEBUG: Replacing output stream
2014-05-29 03:58:01,983 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 03:58:01,990 barman.backup INFO: no file found
2014-05-29 03:59:01,217 barman.cli DEBUG: Loading additional configuration files
2014-05-29 03:59:01,219 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 03:59:01,219 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 03:59:01,219 barman.cli DEBUG: Replacing output stream
2014-05-29 03:59:01,247 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 03:59:01,254 barman.backup INFO: no file found
2014-05-29 04:00:01,480 barman.cli DEBUG: Loading additional configuration files
2014-05-29 04:00:01,481 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 04:00:01,481 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 04:00:01,482 barman.cli DEBUG: Replacing output stream
2014-05-29 04:00:01,505 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 04:00:01,512 barman.backup INFO: no file found
2014-05-29 04:01:01,728 barman.cli DEBUG: Loading additional configuration files
2014-05-29 04:01:01,729 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 04:01:01,730 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 04:01:01,730 barman.cli DEBUG: Replacing output stream
2014-05-29 04:01:01,756 barman.backup INFO: Processing xlog segments for pitch6-db
2014-05-29 04:01:01,763 barman.backup INFO: no file found
2014-05-29 04:02:01,985 barman.cli DEBUG: Loading additional configuration files
2014-05-29 04:02:01,986 barman.config DEBUG: Including configuration file: pitch6-db.conf
2014-05-29 04:02:01,987 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
Tell me if there's something more need to be done. Thanks.
Gabriele Bartolini
May 29, 2014, 4:09:54 AM5/29/14
to pgba...@googlegroups.com
Hello minhdanh72,
As far as I can see, you first had Postgres connection issues -
which have been solved by changing pg_hba.conf (hence the first
FAILED backups).
However, it seems like you have issues with continuous archiving.
Have you followed the procedure as described in the Barman
documentation? In particular the section "Continuous WAL archiving".
Can you please check the Postgres log? Also, can you please enter
the PGDATA directory on the Postgres server and type:
ls pg_xlog/archive_status/*.ready | wc -l
Did you make sure that Postgres is correctly shipping WAL files to Barman?
Please keep us posted.
Thanks,
Gabriele
--
Gabriele Bartolini - 2ndQuadrant Italia
> email to pgbarman+u...@googlegroups.com.
As far as I can see, you first had Postgres connection issues -
which have been solved by changing pg_hba.conf (hence the first
FAILED backups).
However, it seems like you have issues with continuous archiving.
Have you followed the procedure as described in the Barman
documentation? In particular the section "Continuous WAL archiving".
Can you please check the Postgres log? Also, can you please enter
the PGDATA directory on the Postgres server and type:
ls pg_xlog/archive_status/*.ready | wc -l
Did you make sure that Postgres is correctly shipping WAL files to Barman?
Please keep us posted.
Thanks,
Gabriele
--
Gabriele Bartolini - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
gabriele....@2ndQuadrant.it | www.2ndQuadrant.it
minhdanh72
May 29, 2014, 4:31:01 AM5/29/14
to pgba...@googlegroups.com
Thank you, Gabriele Bartolini.
I checked the procedure again and discover that the 'archive_command' doesn't work because the ssh connection from postgres@db-server to barman@backup did not work. I fixed it, but the backup was still not successful, the log file said that 'rsync' command not found. So I installed rsync on postgres db server and everything looks Ok right now.
Thanks again.
minhdanh72
May 29, 2014, 4:34:15 AM5/29/14
to pgba...@googlegroups.com
By the way, may I ask one more question, Gabriele?
Do I have to setup a cron job for the backup process or barman will do it automatically for me?
Do I have to setup a cron job for the backup process or barman will do it automatically for me?
Gabriele Bartolini
May 29, 2014, 4:45:04 AM5/29/14
to pgba...@googlegroups.com
Hi,
you need to setup a cronjob for that.
Ciao,
you need to setup a cronjob for that.
Ciao,
Gabriele
--
Gabriele Bartolini - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
gabriele....@2ndQuadrant.it | www.2ndQuadrant.it
--
Gabriele Bartolini - 2ndQuadrant Italia
PostgreSQL Training, Services and Support
gabriele....@2ndQuadrant.it | www.2ndQuadrant.it
minhdanh72
May 29, 2014, 4:46:38 AM5/29/14
to pgba...@googlegroups.com
Ok, thank you very much.
whobbs
May 29, 2014, 10:41:28 PM5/29/14
to pgba...@googlegroups.com
I'm having the same issue with a similar environment (Centos 6.4). I am able to get base backups to run fine, however log shipping to the backup server is not functioning. Getting the same error as mindanh72. rsync installed on both ends. Not sure what's going on here and can't get any useful information from any logs. I had seen the .ready files in archive_status at one point but no longer see them probably because I did a base backup.
I'm suspecting this could be related to SELinux (which I temporarily set to permissive with echo 0 > /selinux/enforce), but I may have to disable and reboot during the maintenance window tonight. Please let me know if you have any ideas. Thanks in advance
014-05-29 19:34:01,307 barman.cli DEBUG: Loading additional configuration files
2014-05-29 19:34:01,308 barman.config DEBUG: Including configuration file: hive-prod.conf
2014-05-29 19:34:01,308 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 19:34:01,308 barman.cli DEBUG: Replacing output stream
2014-05-29 19:34:01,322 barman.backup INFO: Processing xlog segments for hive-prod
2014-05-29 19:34:01,323 barman.backup INFO: no file found
Server hive-prod:
Description: "Production Hive Database"
PostgreSQL version: 9.1.11
pgespresso extension: Not available
PostgreSQL Data directory: /mnt/sdb1/postgresql/data
PostgreSQL 'archive_command' setting: rsync -a %p bar...@10.201.1.60:/home/barman/hive-prod/incoming/%f
Archive status: last shipped WAL segment 000000010000001A000000C0
Current WAL segment: 000000010000001A000000C1
Retention policies: not enforced
No. of available backups: 1
First available backup: 20140529T191647
Last available backup: 20140529T191647
Minimum redundancy requirements: FAILED (1/2)
[root@hive ~]# barman diagnose
{
"global": {
"config": {
"barman_home": "/home/barman",
"barman_user": "barman",
"compression": "gzip",
I'm suspecting this could be related to SELinux (which I temporarily set to permissive with echo 0 > /selinux/enforce), but I may have to disable and reboot during the maintenance window tonight. Please let me know if you have any ideas. Thanks in advance
014-05-29 19:34:01,307 barman.cli DEBUG: Loading additional configuration files
2014-05-29 19:34:01,308 barman.config DEBUG: Including configuration file: hive-prod.conf
2014-05-29 19:34:01,308 barman.cli DEBUG: Initialized Barman version 1.3.2 (config: /etc/barman/barman.conf)
2014-05-29 19:34:01,308 barman.cli DEBUG: Replacing output stream
2014-05-29 19:34:01,322 barman.backup INFO: Processing xlog segments for hive-prod
2014-05-29 19:34:01,323 barman.backup INFO: no file found
Server hive-prod:
Description: "Production Hive Database"
PostgreSQL version: 9.1.11
pgespresso extension: Not available
PostgreSQL Data directory: /mnt/sdb1/postgresql/data
PostgreSQL 'archive_command' setting: rsync -a %p bar...@10.201.1.60:/home/barman/hive-prod/incoming/%f
Archive status: last shipped WAL segment 000000010000001A000000C0
Current WAL segment: 000000010000001A000000C1
Retention policies: not enforced
No. of available backups: 1
First available backup: 20140529T191647
Last available backup: 20140529T191647
Minimum redundancy requirements: FAILED (1/2)
[root@hive ~]# barman diagnose
{
"global": {
"config": {
"barman_home": "/home/barman",
"barman_user": "barman",
"compression": "gzip",
"configuration_files_directory": "/etc/barman/conf.d",
"log_file": "/var/log/barman/barman.log",
"log_file": "/var/log/barman/barman.log",
"log_level": "DEBUG",
"minimum_redundancy": "2"
},
"system_info": {
"kernel_ver": "Linux hive.standby 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.4 (Final)",
"minimum_redundancy": "2"
},
"system_info": {
"kernel_ver": "Linux hive.standby 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.4 (Final)",
"rsync_ver": "rsync version 3.0.6 protocol version 30",
"ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.0-fips 29 Mar 2010"
}
},
"servers": {
"hive-prod": {
"backups": {
"20140529T191647": {
"backup_id": "20140529T191647",
"backup_label": "None",
"begin_offset": "32",
"begin_time": "Thu May 29 19:16:47 2014",
"begin_wal": "000000010000001A000000C0",
"begin_xlog": "1A/C0000020",
"config_file": "/mnt/sdb1/postgresql/data/postgresql.conf",
"end_offset": "6820312",
"end_time": "Thu May 29 19:24:48 2014",
"end_wal": "000000010000001A000000C0",
"end_xlog": "1A/C06811D8",
"error": null,
"hba_file": "/mnt/sdb1/postgresql/data/pg_hba.conf",
"ident_file": "/mnt/sdb1/postgresql/data/pg_ident.conf",
"mode": "default",
"pgdata": "/mnt/sdb1/postgresql/data",
"server_name": "hive-prod",
"size": 21195413535,
"status": "DONE",
"tablespaces": null,
"timeline": 1,
"version": 90111
}
},
"config": {
"active": true,
"backup_directory": "/home/barman/hive-prod",
}
},
"servers": {
"hive-prod": {
"backups": {
"20140529T191647": {
"backup_id": "20140529T191647",
"backup_label": "None",
"begin_offset": "32",
"begin_time": "Thu May 29 19:16:47 2014",
"begin_wal": "000000010000001A000000C0",
"begin_xlog": "1A/C0000020",
"config_file": "/mnt/sdb1/postgresql/data/postgresql.conf",
"end_offset": "6820312",
"end_time": "Thu May 29 19:24:48 2014",
"end_wal": "000000010000001A000000C0",
"end_xlog": "1A/C06811D8",
"error": null,
"hba_file": "/mnt/sdb1/postgresql/data/pg_hba.conf",
"ident_file": "/mnt/sdb1/postgresql/data/pg_ident.conf",
"mode": "default",
"pgdata": "/mnt/sdb1/postgresql/data",
"server_name": "hive-prod",
"size": 21195413535,
"status": "DONE",
"tablespaces": null,
"timeline": 1,
"version": 90111
}
},
"config": {
"active": true,
"backup_directory": "/home/barman/hive-prod",
"backup_options": "exclusive_backup",
"bandwidth_limit": null,
"bandwidth_limit": null,
"barman_home": "/home/barman",
"basebackups_directory": "/home/barman/hive-prod/base",
"compression": "gzip",
"conninfo": "host=10.201.1.59 user=postgres",
"custom_compression_filter": null,
"custom_decompression_filter": null,
"description": "\u00a0 \"Production Hive Database\"",
"immediate_checkpoint": false,
"incoming_wals_directory": "/home/barman/hive-prod/incoming",
"lock_file": "/home/barman/hive-prod/hive-prod.lock",
"minimum_redundancy": 2,
"name": "hive-prod",
"basebackups_directory": "/home/barman/hive-prod/base",
"compression": "gzip",
"conninfo": "host=10.201.1.59 user=postgres",
"custom_compression_filter": null,
"custom_decompression_filter": null,
"description": "\u00a0 \"Production Hive Database\"",
"immediate_checkpoint": false,
"incoming_wals_directory": "/home/barman/hive-prod/incoming",
"lock_file": "/home/barman/hive-prod/hive-prod.lock",
"minimum_redundancy": 2,
"name": "hive-prod",
"network_compression": false,
"post_backup_script": null,
"pre_backup_script": null,
"retention_policy": null,
"retention_policy_mode": "auto",
"post_backup_script": null,
"pre_backup_script": null,
"retention_policy": null,
"retention_policy_mode": "auto",
"ssh_command": "ssh post...@10.201.1.59",
"tablespace_bandwidth_limit": null,
"wal_retention_policy": "main",
"wal_retention_policy": "main",
"wals_directory": "/home/barman/hive-prod/wals"
},
"status": {
"archive_command": "rsync -a %p bar...@10.201.1.60:/home/barman/hive-prod/incoming/%f",
"archive_mode": "on",
"config_file": "/mnt/sdb1/postgresql/data/postgresql.conf",
"current_xlog": "000000010000001A000000C1",
"data_directory": "/mnt/sdb1/postgresql/data",
"hba_file": "/mnt/sdb1/postgresql/data/pg_hba.conf",
"ident_file": "/mnt/sdb1/postgresql/data/pg_ident.conf",
"last_shipped_wal": "000000010000001A000000C0",
"pgespresso_installed": false,
"server_txt_version": "9.1.11"
},
"system_info": {
"kernel_ver": "Linux hive.prod.central 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.4 (Final)",
},
"status": {
"archive_command": "rsync -a %p bar...@10.201.1.60:/home/barman/hive-prod/incoming/%f",
"archive_mode": "on",
"config_file": "/mnt/sdb1/postgresql/data/postgresql.conf",
"current_xlog": "000000010000001A000000C1",
"data_directory": "/mnt/sdb1/postgresql/data",
"hba_file": "/mnt/sdb1/postgresql/data/pg_hba.conf",
"ident_file": "/mnt/sdb1/postgresql/data/pg_ident.conf",
"last_shipped_wal": "000000010000001A000000C0",
"pgespresso_installed": false,
"server_txt_version": "9.1.11"
},
"system_info": {
"kernel_ver": "Linux hive.prod.central 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux",
"python_ver": "Python 2.6.6",
"release": "RedHat Linux CentOS release 6.4 (Final)",
"rsync_ver": "rsync version 3.0.6 protocol version 30",
"ssh_ver": "OpenSSH_5.3p1, OpenSSL 1.0.0-fips 29 Mar 2010"
}
}
}
}
}
}
}
}
whobbs
May 29, 2014, 10:54:39 PM5/29/14
to pgba...@googlegroups.com
Looks like I got it working - just had to wait for the last log to ship. I thought it would have come in faster with the amount of inserts the DB has per second. Looking forward to seeing how much peace of mind I can attain with this. Thanks guys!
Reply all
Reply to author
Forward
0 new messages