joining node fails after succesfull xtrabackup SST

[Erik]

Hi all,

I installed succesfully two Galera nodes (Percona Cluster).

When starting second node, it fails with this error:

[Warning] WSREP: Gap in state sequence. Need state
transfer.
120423 17:57:03 [Note] WSREP: Running: 'wsrep_sst_xtrabackup 'joiner'
'server2' '' '/var/lib/mysql/' '/root/.my.cnf' '23119' 2>sst.err'
120423 17:57:03 [Note] WSREP: Prepared SST request: xtrabackup|
server2:4444/xtrabackup_sst
120423 17:57:03 [Note] WSREP: wsrep_notify_cmd is not defined,
skipping notification.
120423 17:57:03 [Note] WSREP: Assign initial position for
certification: 0, protocol version: 2
120423 17:57:03 [Warning] WSREP: Failed to prepare for incremental
state transfer: Local state UUID
(00000000-0000-0000-0000-000000000000) does not match group state UUID
(9ba720b3-8d53-11e1-0800-52407463bac7): 1 (Operation not permitted)
at galera/src/replicator_str.cpp:prepare_for_IST():429. IST
will be unavailable.
120423 17:57:03 [Note] WSREP: Node 1 (server2) requested state
transfer from '*any*'. Selected 0 (server1)(SYNCED) as donor.
120423 17:57:03 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 0)
120423 17:57:03 [Note] WSREP: Requesting state transfer: success,
donor: 0
120423 17:57:35 [Note] WSREP: 0 (server1): State transfer to 1
(server2) complete.
120423 17:57:35 [Note] WSREP: Member 0 (server1) synced with group.
120423 17:57:35 [ERROR] WSREP: Process completed with error:
wsrep_sst_xtrabackup 'joiner' 'server2' '' '/var/lib/mysql/' '/
root/.my.cnf' '23119' 2>sst.err: 1 (Operation not permitted)
120423 17:57:35 [ERROR] WSREP: Failed to read uuid:seqno from joiner
script.
120423 17:57:35 [ERROR] WSREP: SST failed: 1 (Operation not permitted)
120423 17:57:35 [ERROR] Aborting

Actually the SST succeeded 17:57.35 (duration 30 sec), which is
confirmed in log on server1.
So something locally fails ? How can I find more logging/debugging
information (here, I see only the message "Operation not permitted").

Thx ahead for any info ! regards, E

[Vadim Tkachenko]

Erik,

Please note

120423 17:57:35 [ERROR] WSREP: Process completed with error:
wsrep_sst_xtrabackup 'joiner' 'server2' '' '/var/lib/mysql/' '/
root/.my.cnf' '23119' 2>sst.err: 1 (Operation not permitted)

There was a problem with xtrabackup.

I would need to see all innobackup.*.log files on both DONOR and JOINER
and sst.err files.

Thanks,
Vadim

> --
> You received this message because you are subscribed to the Google Groups "codership" group.
> To post to this group, send email to codersh...@googlegroups.com.
> To unsubscribe from this group, send email to codership-tea...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/codership-team?hl=en.
>

--
Vadim Tkachenko, CTO, Percona Inc.
Phone +1-925-400-7377,  Skype: vadimtk153
Schedule meeting: http://tungle.me/VadimTkachenko

Looking for Replication with Data Consistency?
Try Percona XtraDB Cluster!

[Mihai]

I was having the same problem so I looked at logs on the node that
was receiving the state transfer
and it turns out that innobackupex ignores the --ibbackup=xtrabackup
option for apply-log

I'm using percona-xtrabackup trunk ( because it can work with files
that are bigger then 8G ) but the innobackupex
that comes with this version seems to be the same as the one from the
percona-xtrabackup experimental repository 5.5.23

Here is a patch to fix this: http://pastebin.com/BmjJZ3sE

On Apr 23, 7:58 pm, Vadim Tkachenko <va...@percona.com> wrote:
> Erik,
>
> Please note
> 120423 17:57:35 [ERROR] WSREP: Process completed with error:
> wsrep_sst_xtrabackup 'joiner' 'server2' '' '/var/lib/mysql/' '/
> root/.my.cnf' '23119' 2>sst.err: 1 (Operation not permitted)
>
> There was a problem with xtrabackup.
>
> I would need to see all innobackup.*.log files on both DONOR and JOINER
> and sst.err files.
>
> Thanks,
> Vadim
>

> > For more options, visit this group athttp://groups.google.com/group/codership-team?hl=en.