> The .ibd file that keeps growing is results.ibd, it's a 26GB file. it
> gets to 4GB until I stop (cause I don't want the long locking to
> continue...)

> I just tried with the -v on the tar on the remote side, and it seems
> like when innobackupex hits results.ibd (after 30 seconds of running,
> copying some smaller .ibd files and backup-my.cnf first), it is stuck
> on it until it ends (it does copy the file, cause I see it growing on
> the remote end, and the network throughput is 10MBps...), so probably
> the .frm and other files are "queued" behind that huge file.

> Can that be ? Is that the design of xtrabackup & innobackupex?
> I think a better way might be waiting until all the .ibd files are
> copied, or just do the locking before the .ibd files are copied...

> Thanks!
> Bar.

> On Jul 21, 7:23 am, Jervin R <jervin.r...@percona.com> wrote:

> > Hello Bar,

> > I simply wanted to eliminate the transfer method as the source of the
> > problem.

> > Try using the v option on tar on the remote end to see if nothing is
> > really being transferred.

> > Which *.ibd file kept growing during the backup? Does this tablespace
> > consistenly growing on every attempt?

> > On Jul 21, 11:19 am, Bar Ziony <bar...@gmail.com> wrote:

> > > Hi Jervin.
> > > The main tablespace is 137MB (ibdata1), I don't know what's in it.

> > > Why using SSH over netcat would help?

> > > Thanks,
> > > Bar.

> > > On Jul 21, 5:11 am, Jervin R <jervin.r...@percona.com> wrote:

> > > > Bar,

> > > > How big is the main tablespace? (ibdata*) Is the destination server
> > > > not getting filled during the backup?

> > > > How about using SSH instead of netcat i.e.

> > > > innobackupex --slave-info --stream=tar ./ | ssh user@backuphost -e
> > > > "(cd /var/backups/mysql && tar xivf -)"

> > > > On Jul 21, 4:04 am, Bar Ziony <bar...@gmail.com> wrote:

> > > > > Hi,

> > > > > I'm using MySQL server 5.1 with the newest xtrabackup debian package
> > > > > from Percona's repo.

> > > > > I'm trying to backup to a remote server by using this command:
> > > > > innobackupex-1.5.1 --password=mypass --stream=tar /tmp/mysql_backup/ --
> > > > > slave-info | nc mysql-02 9999

> > > > > And on the remote destination:
> > > > > nc -l -p 9999 | tar xfi - -C /var/backups/mysql

> > > > > I have a InnoDB big db (40GB), and a 200MB MyISAM db.

> > > > > At the first couple of minutes I get a lot of ">> log scanned up to
> > > > > (86835313840)" lines, and I can see the .ibd files created and getting
> > > > > larger on the destination. about 10MBps...
> > > > > After a couple of minutes, innobackupex locks all the tables and tries
> > > > > to copy FRM, MYD, MID files:

> > > > > 110720 19:48:47  innobackupex-1.5.1: Starting mysql with options:  --
> > > > > password='mypass' --unbuffered --
> > > > > 110720 19:48:47  innobackupex-1.5.1: Connected to database with mysql
> > > > > child process (pid=6165)>> log scanned up to (86835996968)

> > > > > 110720 19:48:51  innobackupex-1.5.1: Starting to lock all tables...>> log scanned up to (86836058050)
> > > > > >> log scanned up to (86836099692)
> > > > > >> log scanned up to (86836199676)

> > > > > 110720 19:49:04  innobackupex-1.5.1: All tables locked and flushed to
> > > > > disk
> > > > > 110720 19:49:04  innobackupex-1.5.1: Starting to
> > > > > backup .frm, .MRG, .MYD, .MYI,
> > > > > innobackupex-1.5.1: .TRG, .TRN, .ARM, .ARZ, .CSM, .CSV and .opt files
> > > > > in
> > > > > innobackupex-1.5.1: subdirectories of '/var/lib/mysql'
> > > > > innobackupex-1.5.1: Backing up files '/var/lib/mysql/openx/*.
> > > > > {frm,MYD,MYI,MRG,TRG,TRN,ARM,ARZ,CSM,CSV,opt,par}' (172 files)

> > > > > but nothing happens! no FRM file is being copied, it's like it's
> > > > > stuck... but the .ibd files keep growing (a big one, 26GB is getting
> > > > > filled), and more and more "log scanned up to..." lines are shown.
> > > > > In all that time, the entire server is with a read lock, and my app is
> > > > > completely down with this long read lock.

> > > > > I can't backup to a local location because I don't have enough space
> > > > > on the local host.

> > > > > Appreciate the help,
> > > > > Thanks,
> > > > > Bar.