Galera Initialize 3rd node failing rsync - writefd_unbuffered failed

[craz...@gmail.com]

Hello,

I started setting up a 3 node cluster a week ago. The 2 nodes are up and synced and receiving and sync'ing data properly.  When I tried to add the 3rd node tonight, it fails with rsync error.

The new node has no database files or anything and the database is 50GB in size roughly. I'm running Maria DB 10.1 Galera on Centos 7. 

Any idea whats going on here?

2018-02-21 21:55:40 140248830961408 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 3439834)

2018-02-21 21:55:40 140249140374272 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

2018-02-21 21:55:40 140238890465024 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.1.1.28:4444/rsync_sst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mariadb/data/'     '' --gtid '9b8bd1a1-0c28-11e8-8770-7f653ec9a1ff:3439834' --gtid-domain-id '0''

2018-02-21 21:55:40 140249140374272 [Note] WSREP: sst_donor_thread signaled with 0

2018-02-21 21:55:40 140238890465024 [Note] WSREP: Flushing tables for SST...

2018-02-21 21:55:41 140238890465024 [Note] WSREP: Provider paused at 9b8bd1a1-0c28-11e8-8770-7f653ec9a1ff:3439834 (3514246)

2018-02-21 21:55:41 140238890465024 [Note] WSREP: Tables flushed.

rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Connection reset by peer (104)

rsync: connection unexpectedly closed (43 bytes received so far) [sender]

rsync error: error in rsync protocol data stream (code 12) at io.c(605) [sender=3.0.9]

WSREP_SST: [ERROR] find/rsync returned code 123: (20180221 21:56:15.787)

2018-02-21 21:56:15 140238890465024 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'donor' --address '10.1.1.28:4444/rsync_sst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mariadb/data/'     '' --gtid '9b8bd1a1-0c28-11e8-8770-7f653ec9a1ff:3439834' --gtid-domain-id '0'

2018-02-21 21:56:15 140238890465024 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'donor' --address '10.1.1.28:4444/rsync_sst' --socket '/var/lib/mysql/mysql.sock' --datadir '/mariadb/data/'     '' --gtid '9b8bd1a1-0c28-11e8-8770-7f653ec9a1ff:3439834' --gtid-domain-id '0': 255 (Unknown error 255)

2018-02-21 21:56:15 140238890465024 [Note] WSREP: resuming provider at 3514246

2018-02-21 21:56:15 140238890465024 [Note] WSREP: Provider resumed.

[Anand S]

Hi,

check if rsync package is installed in the server.

thanks

--
You received this message because you are subscribed to the Google Groups "codership" group.
To unsubscribe from this group and stop receiving emails from it, send an email to codership-team+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Brian P]

Thanks for the reply. All 3 servers have rsync-3.0.9-18.el7.x86_64 and are on the same subnet with no local firewall. 

Brian