Hello Bhaskar -
I run the filter on the receiver end, both servers have the same specs
If I run the filter using cat ( `-filter=/usr/bin/cat` ), it runs about 20% slower than without using filter
I have tried increasing the receiver’s buffer pool and the replication speed increased significantly, it is now within acceptable range for our requirements. I will try to improve this further by using replication helper processes.
Can you recommends a number for helper processes based on server’s specs (e.g: 4 CPU cores = 8 writers …)
Also, if Go is not the most optimal language, what would you recommend for implementing a filter?
As the source server on production is running on AIX, I cannot use C/C++ without writing a custom Kafka library, which is part of the reasons why I wanted to create a replication process without needing to backup and restore the source database in the first place, to run the receiver on other platform.
Thanks and Best Regards,
- Hieu Nguyen