Hi Gurus
Seems that i have problems with xtrabackup IST and SST again on a new cluster.
I try to start up a cluster nod that i know need a IST. I have edit the grastat file so it should start at the right position. Xtrabackup installed and works if i give the PATH to the xtrabackup and server bins.
The ip of the node that fails: 172.27.8.196.
The paths in the error log below seems to be right.
This is part of the log on the node that fails to start:
130415 16:38:00 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 12561c74-a5da-11e2-0800-6b593b877a38
130415 16:38:00 [Note] WSREP: STATE EXCHANGE: sent state msg: 12561c74-a5da-11e2-0800-6b593b877a38
130415 16:38:00 [Note] WSREP: STATE EXCHANGE: got state msg: 12561c74-a5da-11e2-0800-6b593b877a38 from 0 (aclutst3)
130415 16:38:00 [Note] WSREP: STATE EXCHANGE: got state msg: 12561c74-a5da-11e2-0800-6b593b877a38 from 1 (aclutst2)
130415 16:38:00 [Note] WSREP: STATE EXCHANGE: got state msg: 12561c74-a5da-11e2-0800-6b593b877a38 from 2 (garb)
130415 16:38:00 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 26,
members = 2/3 (joined/total),
act_id = 4,
last_appl. = -1,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = 3f9e193a-a36f-11e2-0800-3a801146ac11
130415 16:38:00 [Note] WSREP: Flow-control interval: [28, 28]
130415 16:38:00 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 4)
130415 16:38:00 [Note] WSREP: State transfer required:
Group state: 3f9e193a-a36f-11e2-0800-3a801146ac11:4
Local state: 3f9e193a-a36f-11e2-0800-3a801146ac11:0
130415 16:38:00 [Note] WSREP: New cluster view: global state: 3f9e193a-a36f-11e2-0800-3a801146ac11:4, view# 27: Primary, number of nodes: 3, my index: 0, protocol version 2
130415 16:38:00 [Warning] WSREP: Gap in state sequence. Need state transfer.
130415 16:38:02 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '172.27.8.196' --auth 'root:' --datadir '/db/aclutst3/data/' --defaults-file '/db/aclutst3/data/my.cnf' --parent '22569''
130415 16:38:02 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_xtrabackup --role 'joiner' --address '172.27.8.196' --auth 'root:' --datadir '/db/aclutst3/data/' --defaults-file '/db/aclutst3/data/my.cnf' --parent '22569'
Read: 'Can't find nc in the path'
130415 16:38:02 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'joiner' --address '172.27.8.196' --auth 'root:' --datadir '/db/aclutst3/data/' --defaults-file '/db/aclutst3/data/my.cnf' --parent '22569': 22 (Invalid argument)
130415 16:38:02 [ERROR] WSREP: Failed to prepare for 'xtrabackup' SST. Unrecoverable.
130415 16:38:02 [ERROR] Aborting
No log on the other node (theres 2 and the other i a garbd).
I have inserted this into the wsrep_sst_xtrabackup file on both nodes so it can find the xtrabackup bins:
PATH=$PATH:/db/tools/xtrabackup/bin
Here is the wsrep variables in the failing nodes my.cnf:
wsrep_sst_method = xtrabackup
wsrep_cluster_name = aclutst_cluster
innodb_locks_unsafe_for_binlog = 1
wsrep_node_name = aclutst3
wsrep_cluster_address = gcomm://
172.27.8.170,172.27.8.171
wsrep_provider_options = 'ist.recv_addr=172.27.8.196;gcache.size=100M;'
wsrep_sst_auth = root:
wsrep_sst_donor = aclutst2
I appreciate and look forward to some help as im stuck
Patrik