IPv6-only Galera cluster

[Jonathan Leroy - Inikup]

Hi,

I'm tying to setup an IPv6-only Galera cluster.

The cluster contain two servers who communicate using a private
IPv6-only network:
- fd41:9eff:c33::3306:3
- fd41:9eff:c33::3306:4

Both server uses Debian 8 with MariaDB 10.1.22 and Galera 25.3.19(r3667).


Here's the first server (fd41:9eff:c33::3306:3) configuration:

[mysqld]
binlog_format=ROW
innodb_autoinc_lock_mode=2
innodb_flush_log_at_trx_commit=0
wsrep_on=ON
wsrep_provider=/usr/lib/libgalera_smm.so
wsrep_provider_options="gcache.size=300M; gcache.page_size=300M"
wsrep_cluster_name="xxx_production"
wsrep_cluster_address="gcomm://[fd41:9eff:c33::3306:3]:4567,[fd41:9eff:c33::3306:4]:4567"
wsrep_provider_options="gmcast.listen_addr=tcp://[fd41:9eff:c33::3306:3]:4567"
wsrep_node_address="[fd41:9eff:c33::3306:3]:4567"
wsrep_sst_method=rsync


Here's the second server configuration:

[mysqld]
binlog_format=ROW
innodb_autoinc_lock_mode=2
innodb_flush_log_at_trx_commit=0
wsrep_on=ON
wsrep_provider=/usr/lib/libgalera_smm.so
wsrep_provider_options="gcache.size=300M; gcache.page_size=300M"
wsrep_cluster_name="xxx_production"
wsrep_cluster_address="gcomm://[fd41:9eff:c33::3306:3]:4567,[fd41:9eff:c33::3306:4]:4567"
wsrep_provider_options="gmcast.listen_addr=tcp://[fd41:9eff:c33::3306:4]:4567"
wsrep_node_address="[fd41:9eff:c33::3306:4]:4567"
wsrep_sst_method=rsync


I can start the first server successfully using the
"galera_new_cluster" command.

However, the second server startup fails with the following error:
failed to open gcomm backend connection: 110: failed to reach primary
view: 110 (Connection timed out)
Full log : https://gist.githubusercontent.com/jleroy/9f65374ab7a7fa2794bf53d2a41e4d77/raw/76a6bbee9409ec9af6d8ab4b24706b29daa05764/galera_startup.log

I don't understand this "Connection timed out" error as I can contact
the first server using telnet command from the second server:

# telnet fd41:9eff:c33::3306:3 4567
Trying fd41:9eff:c33::3306:3...
Connected to fd41:9eff:c33::3306:3.
Escape character is '^]'.
$????[?4?&e?<??}t3B6?&h??#??x[^C

Connection closed by foreign host.

Also, there is no firewall configured on the two servers.

Any idea ?

Thanks,

--
Jonathan Leroy
http://www.inikup.com/
Tel: +33 (0)9 74 77 41 72

[alexey.y...@galeracluster.com]

Hi,

Support for IPv6 addresses notation will be in the next Galera release.
Meanwhile you'll have to resort to using hostnames. (just set them up in
/etc/hosts)

[Jonathan Leroy - Inikup]

2017-04-21 12:37 GMT+02:00 <alexey.y...@galeracluster.com>:
> Hi,

Hi Alexey,

Thank you for your answer.

> Support for IPv6 addresses notation will be in the next Galera release.
> Meanwhile you'll have to resort to using hostnames. (just set them up in
> /etc/hosts)

I've managed to get the cluster working without hard-coding names in
/etc/hosts. Here's how:
- In the "wsrep_provider_options" setting, I've replaced
"gmcast.listen_addr=tcp://[fd41:9eff:c33::3306:3]:4567;" by
"gmcast.listen_addr=tcp://[::]:4567;",
- I've added the "wsrep_sst_receive_address" setting.
- Copied the /usr/bin/wsrep_sst_xtrabackup-v2 file to
/usr/bin/wsrep_sst_xtrabackup-v2_ipv6 and patched it in order to
support IPv6.


Here's the final configuration file:

[mysqld]
binlog_format=ROW
innodb_autoinc_lock_mode=2
innodb_flush_log_at_trx_commit=0
wsrep_on=ON
wsrep_provider=/usr/lib/libgalera_smm.so

wsrep_provider_options="gmcast.listen_addr=tcp://[::]:4567;
gcache.size=300M; gcache.page_size=300M"
wsrep_cluster_name="XXX_production"

wsrep_cluster_address="gcomm://[fd41:9eff:c33::3306:3]:4567,[fd41:9eff:c33::3306:4]:4567"

wsrep_node_address="[fd41:9eff:c33::3306:3]:4567"

wsrep_sst_method=xtrabackup-v2_ipv6
# Needed for IPv6 support in xtrabackup-v2.
wsrep_sst_receive_address = "[fd41:9eff:c33::3306:3]:4444"
wsrep_sst_auth = USER:PASSWORD

[sst]
# IPv6 support for SST.
# See: https://bugs.launchpad.net/ubuntu/+source/percona-xtradb-cluster-5.5/+bug/1380747/comments/5
sockopt=,pf=ip6

Regards,