Galera-4 on Google Cloud VM

[Norbert Nordstern]

Hi guys I need some help:

I have 3 VM's setup identically with Debian 10 Mysql-8.0.32 and Galera 4

I start the donor node and I see ClusterSize 1 Then I start the first other node with

service mysql start

Looking at the donor node mysql console I see cluster size 2 for some seconds and the falling back to 1

I already deinstalled apparmor and selinux on all machines and rebooted them.

On donor mode mysql error log shows repeated:
2023-04-23T19:17:21.376372Z 1 [Warning] [MY-000000] [WSREP] P: Joiner didn't provide IST connection info - cert. index preload impossible, bailing out.
2023-04-23T19:17:21.608717Z 0 [Warning] [MY-000000] [WSREP] P: 1.0 (euro): State transfer to 0.0 (HongKong) failed: -42 (No message of desired type)

On 2nd node I get this log:
2023-04-24T09:08:55.255242Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
2023-04-24T09:08:55.255253Z 0 [System] [MY-013169] [Server] /usr/sbin/mysqld (mysqld 8.0.32-26.13) initializing of server in progress as process 938
2023-04-24T09:08:55.256412Z 0 [ERROR] [MY-010457] [Server] --initialize specified but the data directory has files in it. Aborting.
2023-04-24T09:08:55.256438Z 0 [ERROR] [MY-013236] [Server] The designated data directory /var/lib/mysql/ is unusable. You can remove all files that the server added to it.
2023-04-24T09:08:55.256484Z 0 [ERROR] [MY-010119] [Server] Aborting
2023-04-24T09:08:55.256571Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.32-26.13)  Galera Cluster for MySQL.
2023-04-24T09:08:55.486486Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
2023-04-24T09:08:55.486515Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.32-26.13) starting as process 944
2023-04-24T09:08:57.887305Z 0 [Warning] [MY-000000] [WSREP] P: last inactive check more than PT1.5S ago (PT2.19097S), skipping check
2023-04-24T09:08:58.802365Z 1 [Warning] [MY-000000] [WSREP] P: Failed to prepare for incremental state transfer: Failed to open IST listener at tcp://34.92.184.113:4568', asio error 'Failed to listen: bind: Cannot assign requested address: 99 (Cannot assign requested address)
         at /tmp/workspace/aws-galera-4-deb-packages/label/build-debian-10-amd64/deb-build-galera/galerautils/src/gu_asio_stream_react.cpp:listen():788': 99 (Cannot assign requested address)
         at /tmp/workspace/aws-galera-4-deb-packages/label/build-debian-10-amd64/deb-build-galera/galera/src/ist.cpp:prepare():319. IST will be unavailable.
2023-04-24T09:08:59.493022Z 0 [Warning] [MY-000000] [WSREP] P: 0.0 (euro): State transfer to 1.0 (HongKong) failed: -42 (No message of desired type)
2023-04-24T09:08:59.493085Z 0 [ERROR] [MY-000000] [WSREP] P: /tmp/workspace/aws-galera-4-deb-packages/label/build-debian-10-amd64/deb-build-galera/gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1172: Will never receive state. Need to abort.
WSREP_SST: [ERROR] Parent mysqld process (PID:944) terminated unexpectedly. (20230424 09:09:00.834)
/usr//bin/wsrep_sst_rsync: line 632: kill: (-944) - No such process
WSREP_SST: [INFO] Joiner cleanup. rsync PID: 1112 (20230424 09:09:00.835)
2023-04-24T09:09:00.967975Z 0 [Warning] [MY-010918] [Server] 'default_authentication_plugin' is deprecated and will be removed in a future release. Please use authentication_policy instead.
2023-04-24T09:09:00.967985Z 0 [Note] [MY-013932] [Server] BuildID[sha1]=be908760de15cf7847a1ff7c6de6ed578fd58718
2023-04-24T09:09:00.967992Z 0 [Note] [MY-010949] [Server] Basedir set to /usr/.
2023-04-24T09:09:00.968004Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.32-26.13) starting as process 1217
2023-04-24T09:09:00.971878Z 0 [Note] [MY-012366] [InnoDB] Using Linux native AIO
2023-04-24T09:09:00.972024Z 0 [Note] [MY-010747] [Server] Plugin 'FEDERATED' is disabled.
2023-04-24T09:09:00.972079Z 0 [Note] [MY-010747] [Server] Plugin 'ndbcluster' is disabled.
2023-04-24T09:09:00.972094Z 0 [Note] [MY-010747] [Server] Plugin 'ndbinfo' is disabled.
2023-04-24T09:09:00.972103Z 0 [Note] [MY-010747] [Server] Plugin 'ndb_transid_mysql_connection_map' is disabled.
2023-04-24T09:09:00.973289Z 1 [ERROR] [MY-011011] [Server] Failed to find valid data directory.
2023-04-24T09:09:00.973399Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2023-04-24T09:09:00.973423Z 0 [ERROR] [MY-010119] [Server] Aborting
2023-04-24T09:09:00.973445Z 0 [Note] [MY-010120] [Server] Binlog end
2023-04-24T09:09:00.973493Z 0 [Note] [MY-010733] [Server] Shutting down plugin 'MyISAM'
2023-04-24T09:09:00.973510Z 0 [Note] [MY-010733] [Server] Shutting down plugin 'InnoDB'
2023-04-24T09:09:00.973521Z 0 [Note] [MY-010733] [Server] Shutting down plugin 'CSV'
2023-04-24T09:09:00.973561Z 0 [Note] [MY-010733] [Server] Shutting down plugin 'daemon_keyring_proxy_plugin'
2023-04-24T09:09:00.973768Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.32-26.13)  Galera Cluster for MySQL.
Terminated

If anyone can help I would really apprechiate.

Here is my my.cnf on the 2nd node (donor node has only other IP)

[mysqld]
lc_messages_dir = /usr/share/mysql-8.0
lc-messages     = en_US
wsrep_provider  = /usr/lib/galera/libgalera_smm.so
sql-mode        = 'STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'
pid-file        = /var/run/mysqld/mysqld.pid
socket          = /var/run/mysqld/mysqld.sock
datadir         = /var/lib/mysql
log-error       = /var/log/mysql/error.log
binlog_format   = ROW
bind-address    = 0.0.0.0
default_storage_engine                  = innodb
innodb_autoinc_lock_mode                = 2
innodb_flush_log_at_trx_commit          = 0
innodb_buffer_pool_size                 = 122M
wsrep_provider_options          = "gcache.size=300M; gcache.page_size=300M"
wsrep_cluster_name              = "myclustername"
wsrep_cluster_address           = "gcomm://***.***.245.37,***.***.184.113,***.***.117.240"
wsrep_sst_method                = rsync
#wsrep_sst_method                = clone
#wsrep_sst_auth                  = *******:********
wsrep_node_address              = "***.***.184.113"
wsrep_node_name                 = "HongKong"

[mysql_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

I have no clue what I am doing wrong

[Colin Charles]

are all the ports open in the google firewall setting? 4568 for ist? and so on? https://galeracluster.com/library/documentation/firewall-settings.html