rsync failed "Unknown module 'rsync_sst-log_dir'"
445 views
Skip to first unread message
Olivier NORTURE
Jan 27, 2014, 5:12:20 AM1/27/14
to codersh...@googlegroups.com
Hi,
I have a problem with galera cluster on mariadb.
On all node there is the same rsync version (3.0.9 protocol version 30).
But when node try to join my cluster i have an error :
@ERROR: Unknown module 'rsync_sst-log_dir'
rsync error: error starting client-server protocol (code 5) at main.c(1534) [sender=3.0.9]
WSREP_SST: [ERROR] rsync innodb_log_group_home_dir returned code 5: (20140127 10:57:22.417)
I don't launch the cluster since 6 month, and i use a new machine to start the cluster.
MariaDB are not the same version on all node, but i think there is no incidence wright ?
But i don't know about the version of galera cluster ? There is a retro-compatibility ? How can i know the version ?
There is the fuul log:
Donor :
140127 10:57:00 [Note] WSREP: declaring 5d78304c-8739-11e3-9f41-4fa751c70cd0 stable
140127 10:57:00 [Note] WSREP: Node c239a7f8-8737-11e3-9947-dbdf1ae8144f state prim
140127 10:57:00 [Note] WSREP: view(view_id(PRIM,5d78304c-8739-11e3-9f41-4fa751c70cd0,4) memb {
5d78304c-8739-11e3-9f41-4fa751c70cd0,
c239a7f8-8737-11e3-9947-dbdf1ae8144f,
} joined {
} left {
} partitioned {
})
140127 10:57:00 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
140127 10:57:00 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
140127 10:57:00 [Note] WSREP: STATE EXCHANGE: sent state msg: 5dcc617c-8739-11e3-b264-ff69396d3457
140127 10:57:00 [Note] WSREP: STATE EXCHANGE: got state msg: 5dcc617c-8739-11e3-b264-ff69396d3457 from 0 (raspberrypi)
140127 10:57:00 [Note] WSREP: STATE EXCHANGE: got state msg: 5dcc617c-8739-11e3-b264-ff69396d3457 from 1 (node_central)
140127 10:57:00 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 3,
members = 1/2 (joined/total),
act_id = 0,
last_appl. = 0,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = c23ae427-8737-11e3-828b-565c1d85ed48
140127 10:57:00 [Note] WSREP: Flow-control interval: [23, 23]
140127 10:57:00 [Note] WSREP: New cluster view: global state: c23ae427-8737-11e3-828b-565c1d85ed48:0, view# 4: Primary, number of nodes: 2, my index: 1, protocol version 2
140127 10:57:00 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140127 10:57:00 [Note] WSREP: Assign initial position for certification: 0, protocol version: 2
140127 10:57:03 [Note] WSREP: Node 0 (raspberrypi) requested state transfer from 'node_central'. Selected 1 (node_central)(SYNCED) as donor.
140127 10:57:03 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 0)
140127 10:57:03 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140127 10:57:03 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '192.168.0.99:4444/rsync_sst' --auth 'root:0livier' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --gtid 'c23ae427-8737-11e3-828b-565c1d85ed48:0''
140127 10:57:03 [Note] WSREP: sst_donor_thread signaled with 0
140127 10:57:03 [Note] WSREP: Flushing tables for SST...
140127 10:57:03 [Note] WSREP: Provider paused at c23ae427-8737-11e3-828b-565c1d85ed48:0
140127 10:57:03 [Note] WSREP: Tables flushed.
140127 10:57:20 [Note] WSREP: (c239a7f8-8737-11e3-9947-dbdf1ae8144f, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://192.168.0.99:4567
140127 10:57:21 [Note] WSREP: (c239a7f8-8737-11e3-9947-dbdf1ae8144f, 'tcp://0.0.0.0:4567') reconnecting to 5d78304c-8739-11e3-9f41-4fa751c70cd0 (tcp://192.168.0.99:4567), attempt 0
140127 10:57:22 [Note] WSREP: (c239a7f8-8737-11e3-9947-dbdf1ae8144f, 'tcp://0.0.0.0:4567') turning message relay requesting off
140127 10:57:22 [Note] WSREP: (c239a7f8-8737-11e3-9947-dbdf1ae8144f, 'tcp://0.0.0.0:4567') cleaning up established 0xb5cdc9c0 which is duplicate of 0x7e35f180
@ERROR: Unknown module 'rsync_sst-log_dir'
rsync error: error starting client-server protocol (code 5) at main.c(1534) [sender=3.0.9]
WSREP_SST: [ERROR] rsync innodb_log_group_home_dir returned code 5: (20140127 10:57:22.417)
140127 10:57:22 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '192.168.0.99:4444/rsync_sst' --auth 'root:0livier' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --gtid 'c23ae427-8737-11e3-828b-565c1d85ed48:0'
140127 10:57:22 [Note] WSREP: Provider resumed.
140127 10:57:22 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '192.168.0.99:4444/rsync_sst' --auth 'root:0livier' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --gtid 'c23ae427-8737-11e3-828b-565c1d85ed48:0': 255 (Unknown error 255)
140127 10:57:22 [Warning] WSREP: 1 (node_central): State transfer to 0 (raspberrypi) failed: -1 (Operation not permitted)
140127 10:57:22 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 0)
140127 10:57:22 [Note] WSREP: Member 1 (node_central) synced with group.
140127 10:57:22 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0)
140127 10:57:22 [Note] WSREP: Synchronized with group, ready for connections
140127 10:57:22 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140127 10:57:22 [Note] WSREP: Node c239a7f8-8737-11e3-9947-dbdf1ae8144f state prim
140127 10:57:22 [Note] WSREP: view(view_id(PRIM,c239a7f8-8737-11e3-9947-dbdf1ae8144f,5) memb {
c239a7f8-8737-11e3-9947-dbdf1ae8144f,
} joined {
} left {
} partitioned {
5d78304c-8739-11e3-9f41-4fa751c70cd0,
})
140127 10:57:22 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
140127 10:57:22 [Note] WSREP: forgetting 5d78304c-8739-11e3-9f41-4fa751c70cd0 (tcp://192.168.0.99:4567)
140127 10:57:22 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 6ac1f7a6-8739-11e3-a109-ab81bc5b91bb
140127 10:57:22 [Note] WSREP: STATE EXCHANGE: sent state msg: 6ac1f7a6-8739-11e3-a109-ab81bc5b91bb
140127 10:57:22 [Note] WSREP: STATE EXCHANGE: got state msg: 6ac1f7a6-8739-11e3-a109-ab81bc5b91bb from 0 (node_central)
140127 10:57:22 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 4,
members = 1/1 (joined/total),
act_id = 0,
last_appl. = 0,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = c23ae427-8737-11e3-828b-565c1d85ed48
140127 10:57:22 [Note] WSREP: Flow-control interval: [16, 16]
140127 10:57:22 [Note] WSREP: New cluster view: global state: c23ae427-8737-11e3-828b-565c1d85ed48:0, view# 5: Primary, number of nodes: 1, my index: 0, protocol version 2
140127 10:57:22 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140127 10:57:22 [Note] WSREP: Assign initial position for certification: 0, protocol version: 2
140127 10:57:27 [Note] WSREP: cleaning up 5d78304c-8739-11e3-9f41-4fa751c70cd0 (tcp://192.168.0.99:4567)
Joiner :
140127 9:56:59 [Note] WSREP: Read nil XID from storage engines, skipping position init
140127 9:56:59 [Note] WSREP: wsrep_load(): loading provider library '/usr/local/mysql/lib/plugin/libgalera_smm.so'
140127 9:57:00 [Note] WSREP: wsrep_load(): Galera 2.6(rXXXX) by Codership Oy <in...@codership.com> loaded succesfully.
140127 9:57:00 [Warning] WSREP: Could not open saved state file for reading: /home/mysql//grastate.dat
140127 9:57:00 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
140127 9:57:00 [Note] WSREP: Preallocating 134219040/134219040 bytes in '/home/mysql//galera.cache'...
140127 9:57:00 [Note] WSREP: Passing config to GCS: base_host = 192.168.0.99; base_port = 4567; cert.log_conflicts = no; gcache.dir = /home/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /home/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 2147483647; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3
140127 9:57:00 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
140127 9:57:00 [Note] WSREP: wsrep_sst_grab()
140127 9:57:00 [Note] WSREP: Start replication
140127 9:57:00 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
140127 9:57:00 [Note] WSREP: protonet asio version 0
140127 9:57:00 [Note] WSREP: backend: asio
140127 9:57:00 [Note] WSREP: GMCast version 0
140127 9:57:00 [Note] WSREP: (5d78304c-8739-11e3-9f41-4fa751c70cd0, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
140127 9:57:00 [Note] WSREP: (5d78304c-8739-11e3-9f41-4fa751c70cd0, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
140127 9:57:00 [Note] WSREP: EVS version 0
140127 9:57:00 [Note] WSREP: PC version 0
140127 9:57:00 [Note] WSREP: gcomm: connecting to group 'scansec_cluster', peer '192.168.0.82:'
140127 9:57:00 [Note] WSREP: declaring c239a7f8-8737-11e3-9947-dbdf1ae8144f stable
140127 9:57:00 [Note] WSREP: Node c239a7f8-8737-11e3-9947-dbdf1ae8144f state prim
140127 9:57:00 [Note] WSREP: view(view_id(PRIM,5d78304c-8739-11e3-9f41-4fa751c70cd0,4) memb {
5d78304c-8739-11e3-9f41-4fa751c70cd0,
c239a7f8-8737-11e3-9947-dbdf1ae8144f,
} joined {
} left {
} partitioned {
})
140127 9:57:00 [Note] WSREP: gcomm: connected
140127 9:57:00 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
140127 9:57:00 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
140127 9:57:00 [Note] WSREP: Opened channel 'scansec_cluster'
140127 9:57:00 [Note] WSREP: Waiting for SST to complete.
140127 9:57:00 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
140127 9:57:00 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 5dcc617c-8739-11e3-b264-ff69396d3457
140127 9:57:00 [Note] WSREP: STATE EXCHANGE: sent state msg: 5dcc617c-8739-11e3-b264-ff69396d3457
140127 9:57:00 [Note] WSREP: STATE EXCHANGE: got state msg: 5dcc617c-8739-11e3-b264-ff69396d3457 from 0 (raspberrypi)
140127 9:57:00 [Note] WSREP: STATE EXCHANGE: got state msg: 5dcc617c-8739-11e3-b264-ff69396d3457 from 1 (node_central)
140127 9:57:00 [Note] WSREP: Quorum results:
version = 2,
component = PRIMARY,
conf_id = 3,
members = 1/2 (joined/total),
act_id = 0,
last_appl. = -1,
protocols = 0/4/2 (gcs/repl/appl),
group UUID = c23ae427-8737-11e3-828b-565c1d85ed48
140127 9:57:00 [Note] WSREP: Flow-control interval: [23, 23]
140127 9:57:00 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 0)
140127 9:57:00 [Note] WSREP: State transfer required:
Group state: c23ae427-8737-11e3-828b-565c1d85ed48:0
Local state: 00000000-0000-0000-0000-000000000000:-1
140127 9:57:00 [Note] WSREP: New cluster view: global state: c23ae427-8737-11e3-828b-565c1d85ed48:0, view# 4: Primary, number of nodes: 2, my index: 0, protocol version 2
140127 9:57:00 [Warning] WSREP: Gap in state sequence. Need state transfer.
140127 9:57:02 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '192.168.0.99' --auth 'root:0livier' --datadir '/home/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '4689''
cat: /home/mysql//rsync_sst.pid: No such file or directory
140127 9:57:03 [Note] WSREP: Prepared SST request: rsync|192.168.0.99:4444/rsync_sst
140127 9:57:03 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140127 9:57:03 [Note] WSREP: Assign initial position for certification: 0, protocol version: 2
140127 9:57:03 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (c23ae427-8737-11e3-828b-565c1d85ed48): 1 (Operation not permitted)
at galera/src/replicator_str.cpp:prepare_for_IST():436. IST will be unavailable.
140127 9:57:03 [Note] WSREP: Node 0 (raspberrypi) requested state transfer from 'node_central'. Selected 1 (node_central)(SYNCED) as donor.
140127 9:57:03 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 0)
140127 9:57:03 [Note] WSREP: Requesting state transfer: success, donor: 1
140127 9:57:21 [Note] WSREP: (5d78304c-8739-11e3-9f41-4fa751c70cd0, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://192.168.0.82:4567
140127 9:57:22 [Note] WSREP: (5d78304c-8739-11e3-9f41-4fa751c70cd0, 'tcp://0.0.0.0:4567') reconnecting to c239a7f8-8737-11e3-9947-dbdf1ae8144f (tcp://192.168.0.82:4567), attempt 0
140127 9:57:22 [Note] WSREP: (5d78304c-8739-11e3-9f41-4fa751c70cd0, 'tcp://0.0.0.0:4567') turning message relay requesting off
140127 9:57:22 [Note] WSREP: (5d78304c-8739-11e3-9f41-4fa751c70cd0, 'tcp://0.0.0.0:4567') cleaning up established 0x3135660 which is duplicate of 0x312d1f8
140127 9:57:22 [Warning] WSREP: 1 (node_central): State transfer to 0 (raspberrypi) failed: -1 (Operation not permitted)
140127 9:57:22 [ERROR] WSREP: gcs/src/gcs_group.c:gcs_group_handle_join_msg():719: Will never receive state. Need to abort.
140127 9:57:22 [Note] WSREP: gcomm: terminating thread
140127 9:57:22 [Note] WSREP: gcomm: joining thread
140127 9:57:22 [Note] WSREP: gcomm: closing backend
140127 9:57:22 [Note] WSREP: view(view_id(NON_PRIM,5d78304c-8739-11e3-9f41-4fa751c70cd0,4) memb {
5d78304c-8739-11e3-9f41-4fa751c70cd0,
} joined {
} left {
} partitioned {
c239a7f8-8737-11e3-9947-dbdf1ae8144f,
})
140127 9:57:22 [Note] WSREP: view((empty))
140127 9:57:22 [Note] WSREP: gcomm: closed
140127 9:57:22 [Note] WSREP: /usr/local/mysql/bin/mysqld: Terminated.
Best Regards
Reply all
Reply to author
Forward
0 new messages