innobackupex streaming not working

[Ran Margaliot]

Hello,

When i need to setup a new slave I issue the flowing script on the
master:

innobackupex --user=root --password='*****' --throttle=15 --
stream=tar /tmp/ --slave-info | sshpass -p '****' ssh root@<new slave
ip> "tar xfi - -C /var/lib/mysql"

usually this command works fine and streams the data to the new slave.

from some reason, when I issue this command now, I get the following
output:

xtrabackup: suspend-at-end is enabled.
xtrabackup: uses posix_fadvise().
xtrabackup: cd to /var/lib/mysql
xtrabackup: Target instance is assumed as followings.
xtrabackup: innodb_data_home_dir = ./
xtrabackup: innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup: innodb_log_group_home_dir = ./
xtrabackup: innodb_log_files_in_group = 2
xtrabackup: innodb_log_file_size = 1310720000
xtrabackup: use O_DIRECT
xtrabackup: Stream mode.

and thats it, normally it would display: "log scanned up to
(... ...........)" every couple of seconds.

looking at the size of the mysql dir on the slave also suggest that no
data is coming in.

any ideas why?

[David Juntgen]

Hi - If you remove the pipe "|" into sshpass and dump to a file does it work?

Thanks,

--Dave

> --
> You received this message because you are subscribed to the Google Groups "Percona Discussion" group.
> To post to this group, send email to percona-d...@googlegroups.com.
> To unsubscribe from this group, send email to percona-discuss...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/percona-discussion?hl=en.
>

--
David W. Juntgen

[Jo Valerio]

Can you have a look at the value of your innodb_log_file_size in
Slave? Is it match with the current value in master?

[Jonathan T. Valerio]

Can you have a look at the value of your innodb_log_file_size in Slave? Is it match with the current value in master?

--
You received this message because you are subscribed to the Google Groups "Percona Discussion" group.
To post to this group, send email to percona-d...@googlegroups.com.
To unsubscribe from this group, send email to percona-discuss...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/percona-discussion?hl=en.

--
Jonathan T. Valerio
MYSQL Database Administrator

[Ran Margaliot]

yes, same values

> <http://www.golivemobile.com>

[Ran Margaliot]

from some reason if i stop/start the process a few times it start to
work, but since i need to do this process often and i need to find out
whats not working there

> > For more options, visit this group athttp://groups.google.com/group/percona-discussion?hl=en.
>
> --
> David W. Juntgen

[David Juntgen]

> from some reason if i stop/start the process a few times it start to
> work, but since i need to do this process often and i need to find out
> whats not working there

Hi - You'll need to provide some info. What version of MySQL and
which version of xtrabackup are you using? Can you run without the
pipe from the cli and provide its output?

--Dave

> For more options, visit this group at http://groups.google.com/group/percona-discussion?hl=en.
>

--
David W. Juntgen

[Ran Margaliot]

v1.5.1-xtrabackup

5.1 - Mysql

>> > To post to this group, send email to percona-discussion@googlegroups.com.
>> > To unsubscribe from this group, send email to percona-discussion+unsub...@googlegroups.com.

>> > For more options, visit this group athttp://groups.google.com/group/percona-discussion?hl=en.
>>
>> --
>> David W. Juntgen
>
> --
> You received this message because you are subscribed to the Google Groups "Percona Discussion" group.

> To post to this group, send email to percona-discussion@googlegroups.com.
> To unsubscribe from this group, send email to percona-discussion+unsub...@googlegroups.com.

> For more options, visit this group at http://groups.google.com/group/percona-discussion?hl=en.
>

--
David W. Juntgen

[Ran Margaliot]

when running the following command:

innobackupex --user=root --password='*****' --throttle=10 --stream=tar --slave-info /tmp/db_backup/

i get the following output:

InnoDB Backup Utility v1.5.1-xtrabackup; Copyright 2003, 2009 Innobase Oy

and Percona Inc 2009-2011.  All Rights Reserved.

This software is published under

the GNU GENERAL PUBLIC LICENSE Version 2, June 1991.

120417 08:29:13  innobackupex: Starting mysql with options:  --password='********' --user='root' --unbuffered --

120417 08:29:13  innobackupex: Connected to database with mysql child process (pid=26862)

120417 08:29:19  innobackupex: Connection to database server closed

IMPORTANT: Please check that the backup run completes successfully.

           At the end of a successful backup run innobackupex

           prints "completed OK!".

innobackupex: Using mysql  Ver 14.14 Distrib 5.1.61, for debian-linux-gnu (x86_64) using readline 6.2

innobackupex: Using mysql server version Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved.

innobackupex: Created backup directory /tmp/db_backup

backup-my.cnf0000644000000000000000000000044311743224737012147 0ustar  rootroot# This MySQL options file was generated by innobackupex.

# The MySQL server

[mysqld]

datadir=/tmp/db_backup

innodb_data_home_dir=/tmp/db_backup

innodb_data_file_path=ibdata1:10M:autoextend

innodb_log_group_home_dir=/tmp/db_backup

innodb_log_files_in_group=2

innodb_log_file_size=1310720000

120417 08:29:19  innobackupex: Starting mysql with options:  --password='******' --user='root' --unbuffered --

120417 08:29:19  innobackupex: Connected to database with mysql child process (pid=26892)

120417 08:29:23  innobackupex: Connection to database server closed

120417 08:29:23  innobackupex: Starting ibbackup with command: xtrabackup_51 --backup --suspend-at-end --log-stream --target-dir=./ --throttle=10

innobackupex: Waiting for ibbackup (pid=26902) to suspend

innobackupex: Suspend file '/var/lib/mysql/xtrabackup_suspended'

xtrabackup: suspend-at-end is enabled.

xtrabackup: uses posix_fadvise().

xtrabackup: cd to /var/lib/mysql

xtrabackup: Target instance is assumed as followings.

xtrabackup:   innodb_data_home_dir = ./

xtrabackup:   innodb_data_file_path = ibdata1:10M:autoextend

xtrabackup:   innodb_log_group_home_dir = ./

xtrabackup:   innodb_log_files_in_group = 2

xtrabackup:   innodb_log_file_size = 1310720000

xtrabackup: use O_DIRECT

xtrabackup: Stream mode.

any ideas?

[Alexey Kopytov]

Ran,

On 17.04.12 12:32, Ran Margaliot wrote:
> *when running the following command:*

>
> innobackupex --user=root --password='*****' --throttle=10 --stream=tar
> --slave-info /tmp/db_backup/
>

> *i get the following output:*
>
[skipped]

> xtrabackup: suspend-at-end is enabled.
> xtrabackup: uses posix_fadvise().
> xtrabackup: cd to /var/lib/mysql
> xtrabackup: Target instance is assumed as followings.
> xtrabackup: innodb_data_home_dir = ./
> xtrabackup: innodb_data_file_path = ibdata1:10M:autoextend
> xtrabackup: innodb_log_group_home_dir = ./
> xtrabackup: innodb_log_files_in_group = 2
> xtrabackup: innodb_log_file_size = 1310720000
> xtrabackup: use O_DIRECT
> xtrabackup: Stream mode.
>
> any ideas?
>

Can you strace the xtrabackup process when it hangs up again?

Best regards,
Alexey.

[Ran Margaliot]

how can i trace it?

[Alexey Kopytov]

On 17.04.12 15:23, Ran Margaliot wrote:
> how can i trace it?
>

strace -p `pidof xtrabackup_51`

Having a gdb backtrace might also be useful. You can get it with the
following command:

gdb -ex "set pagination 0" -ex "thread apply all bt" \
--batch -p `pidof xtrabackup_51`