Migrate large database to galera cluster

104 views
Skip to first unread message

Hugo

unread,
Jan 15, 2018, 10:13:35 AM1/15/18
to codership
Hello,

I would like to migrate a large database from mysql 5.5.38 to our galera cluster 10.0.33
initially I wanted to dump the database and then restore the DB, but it takes too much time (arround 12h).

The DB size is arround 170 Gio

So I was wondering is there a way to create a master slave relation as follow :

- master : old server mysql 5.5.38
- slave : galera cluster

As galera is a 4 nodes cluster, which one will pull the query from master ? Is this a working setup ?

Regards,

Matthew Frederico

unread,
Jan 24, 2018, 12:02:10 PM1/24/18
to codership
I would like to migrate a large database from mysql 5.5.38 to our galera cluster 10.0.33
initially I wanted to dump the database and then restore the DB, but it takes too much time (arround 12h).

The DB size is arround 170 Gio

We are currently using RDS and evaluating Galera for how feasible it may be in a multimaster multi-node environment.   Most of our data calls are reads, however we have about a 3GB database so bear that in mind as a benchmark for this.


  • On Export
  • Regular mysqldump took about 8 - 10 minutes to pull our databases (3GB) from remote Amazon RDS. 
  • using mydumper - dropped that time down to about 3 minutes.
Loading the export back took about 10 minutes into a primary node galera cluster instance (t2.small) even with myloader.  The slow import culprit appears to be transactional locks, which can be turned off.  So maybe do some estimation on performance from that.


Hugo

unread,
Feb 6, 2018, 4:08:21 AM2/6/18
to codership
Hi,

I'll have a look. But clearly the horus of process are coming from the restore part.
Can you be more specific on disabling the transactional locks ?

Regards,
Reply all
Reply to author
Forward
0 new messages