Checksum on three TokuDB System

[vinoth kumar ramachandran]

Hi Team,

Our team is using TokuDB : version  | 5.5.41-tokudb-7.5.5.

we are loading data to three systems. we want to setup data validation process to make sure the data correctness. Looking for best suggestions.

we want to make sure the following

---1.      Record count

---2.      Checksum

Data load Approach

File1 ===> System1: stage table ===> System 1: target table

File1 ===> System2: stage table ===> System 2: target table

File1 ===> System3: stage table ===> System 3: target table

Thanks,

Vinoth

[Phil]

Are they replicas of each other?  If you set them up using MySQL replication you can then use percona's pt-table-checksum/pt-table-sync tools to check the consistency.

Phil

[vinoth kumar ramachandran]

Is there any other solution without MySQL replication?  Our Setup is like primary, HA and DR.

--
You received this message because you are subscribed to the Google Groups "tokudb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tokudb-user...@googlegroups.com.
To post to this group, send email to tokud...@googlegroups.com.
Visit this group at http://groups.google.com/group/tokudb-user.
For more options, visit https://groups.google.com/d/optout.

[Phil]

If you're not using replication, how are you getting data from primary into the HA and DR databases?

Phil

[vinoth kumar ramachandran]

We have separate ETL jobs to DR and HA server. Same source file is used to load the data into 3 hosts.

Thanks,

Vinoth

[Phil]

Fair enough.  I THINK you can still use percona toolkit to sync between non-replicating databases using pt-table-checksum or pt-table-sync.  Have a look.

But if the data is not changing once it is loaded in, why the concern about checksum?  If you ARE changing the data after its loaded in, why not use replication?

Phil