Unable to start Galera replication

2,022 views
Skip to first unread message

Aravind D

unread,
Feb 9, 2017, 2:46:52 PM2/9/17
to codership

I am trying to setup Galera 10.1.19 replication with 2 nodes on a Enterprise Linux6 and did the software installs using YUM.

Output of my.cnf files are as below,

node 1-
# cat /etc/my.cnf
[mysqld]
symbolic-links=0
query_cache_size=0
binlog_format=ROW
default-storage-engine=innodb
innodb_autoinc_lock_mode=2
query_cache_type=0
bind-address=0.0.0.0
datadir=/var/opt/rh/rh-mariadb101/lib/mysql
socket=/var/lib/mysql/mysql.sock
log_bin=/var/opt/rh/rh-mariadb101/lib/mysql

# Galera Provider Configuration
wsrep_provider=/opt/rh/rh-mariadb101/root/usr/lib64/galera/libgalera_smm.so
wsrep_provider_options="gcache.size=32G"

# Galera Cluster Configuration
wsrep_cluster_name='first_cluster'
wsrep_cluster_address="gcomm://168.72.200.29,168.72.200.30"
wsrep_on=ON

# Galera Synchronization Congifuration
wsrep_sst_method=rsync
wsrep_sst_auth=cluster_user:Hodaz17

# Galera Node Configuration
wsrep_node_address='168.72.200.29'
wsrep_node_name='sd-cada-5219

Node2 -

[Dev root @ sd-a017-af9c ~]
# cat /etc/my.cnf
[mysqld]
query_cache_size=0
binlog_format=ROW
default-storage-engine=innodb
innodb_autoinc_lock_mode=2
query_cache_type=0
bind-address=0.0.0.0
datadir=/var/opt/rh/rh-mariadb101/lib/mysql
socket=/var/lib/mysql/mysql.sock
log_bin=/var/opt/rh/rh-mariadb101/lib/mysql

# Galera Provider Configuration
wsrep_provider=/opt/rh/rh-mariadb101/root/usr/lib64/galera/libgalera_smm.so
wsrep_provider_options="gcache.size=32G"

# Galera Cluster Configuration
wsrep_cluster_name='first_cluster'
wsrep_cluster_address="gcomm://168.72.200.29,168.72.200.30"
wsrep_on=ON

# Galera Synchronization Congifuration
wsrep_sst_method=rsync
wsrep_sst_auth=cluster_user:Hodaz17

# Galera Node Configuration
wsrep_node_address='168.72.200.30'
wsrep_node_name='sd-a017-af9c'


And am trying to start the primary node as below,

service mysql start --wsrep-new-cluster and gets OK message, but the wsrep status shows as below,

MariaDB [(none)]> show status like '%wsrep%';
+--------------------------+----------------------+
| Variable_name            | Value                |
+--------------------------+----------------------+
| wsrep_cluster_conf_id    | 18446744073709551615 |
| wsrep_cluster_size       | 0                    |
| wsrep_cluster_state_uuid |                      |
| wsrep_cluster_status     | Disconnected         |
| wsrep_connected          | OFF                  |
| wsrep_local_bf_aborts    | 0                    |
| wsrep_local_index        | 18446744073709551615 |
| wsrep_provider_name      |                      |
| wsrep_provider_vendor    |                      |
| wsrep_provider_version   |                      |
| wsrep_ready              | OFF                  |
| wsrep_thread_count       | 0                    |
+--------------------------+----------------------+
12 rows in set (0.00 sec)


Please advise on this.

Rgds,
Aravind

Philip Stoev

unread,
Feb 10, 2017, 2:49:13 AM2/10/17
to Aravind D, codership
Hello,

Please check the mysql error log for more information as to why the Galera
library did not load. One possibility is that the file
/opt/rh/rh-mariadb101/root/usr/lib64/galera/libgalera_smm.so you have
specified in my.cnf is not found or otherwise not usable.

Philip Stoev
--
You received this message because you are subscribed to the Google Groups
"codership" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to codership-tea...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Aravind D

unread,
Feb 10, 2017, 10:00:30 AM2/10/17
to codership, aravin...@gmail.com
Hello Philip,

Thanks for the feedback.

Here is the file permission of the galera lib,

# ls -ltr /opt/rh/rh-mariadb101/root/usr/lib64/galera/libgalera_smm.so
-rwxr-xr-x 1 root root 2371960 Apr 21  2016 /opt/rh/rh-mariadb101/root/usr/lib64/galera/libgalera_smm.so
[Dev root @ sd-cada-5219 ~]
#


Also here is a snippet from the error log,

2017-02-09 17:10:25 139803265849312 [Note] /opt/rh/rh-mariadb101/root/usr/libexec/mysqld (mysqld 10.1.19-MariaDB) starting as process 6830 ...
2017-02-09 17:10:51 139803265849312 [ERROR] WSREP: rsync SST method requires wsrep_cluster_address to be configured on startup.
170209 17:10:54 mysqld_safe WSREP: Position recovery skipped
2017-02-09 17:10:54 139902460835808 [Note] /opt/rh/rh-mariadb101/root/usr/libexec/mysqld (mysqld 10.1.19-MariaDB) starting as process 7089 ...
2017-02-09 17:10:55 139902460835808 [ERROR] WSREP: rsync SST method requires wsrep_cluster_address to be configured on startup.
2017-02-09 17:10:55 139902460835808 [Warning] You need to use --log-bin to make --binlog-format work.
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Using mutexes to ref count buffer pool pages
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: The InnoDB memory heap is disabled
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: GCC builtin __sync_synchronize() is used for memory barrier
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Compressed tables use zlib 1.2.3
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Using Linux native AIO
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Using SSE crc32 instructions
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Initializing buffer pool, size = 128.0M
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Completed initialization of buffer pool
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Highest supported file format is Barracuda.
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: 128 rollback segment(s) are active.
2017-02-09 17:10:55 139902460835808 [Note] InnoDB: Waiting for purge to start
2017-02-09 17:10:55 139902460835808 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.32-79.0 started; log sequence number 1627826
2017-02-09 17:10:55 139901548873472 [Note] InnoDB: Dumping buffer pool(s) not yet started
2017-02-09 17:10:55 139902460835808 [Note] Plugin 'FEEDBACK' is disabled.
2017-02-09 17:10:55 139902460835808 [Warning] GSSAPI plugin : default principal 'mariadb/sd-cada-5219....@NAMUXDEV.DYN.NSROOT.NET' not found in keytab
2017-02-09 17:10:55 139902460835808 [Note] Server socket created on IP: '0.0.0.0'.
2017-02-09 17:10:55 139902460835808 [Note] /opt/rh/rh-mariadb101/root/usr/libexec/mysqld: ready for connections.
Version: '10.1.19-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server


Please feedback if you think that I can tweak something to make this setup work.

Rgds,
Aravind

Philip Stoev

unread,
Feb 10, 2017, 10:03:07 AM2/10/17
to Aravind D, codership, aravin...@gmail.com
There is an error message in the log:

2017-02-09 17:10:51 139803265849312 [ERROR] WSREP: rsync SST method requires
wsrep_cluster_address to be configured on startup.

Aravind D

unread,
Feb 10, 2017, 10:42:45 AM2/10/17
to codership, aravin...@gmail.com
Philip,

Whats the fix/solution.

I have my wsrep_cluster_address configured correctly.

wsrep_cluster_address="gcomm://168.72.200.29,168.72.200.30"

Rgds,
Aravind

Sébastien Simonek

unread,
Feb 28, 2017, 3:02:49 PM2/28/17
to codership, aravin...@gmail.com
Hi

Could you try to insert a blank in the gcomm address ?

=> wsrep_cluster_address="gcomm://168.72.200.29, 168.72.200.30"

Do you start in bootstrap mode on 168.72.200.29 ? (rhel command=> $ galera_new_cluster )
Reply all
Reply to author
Forward
0 new messages