Oracle Debezium GoldenGate vs LogMiner

[karthik narayan]

Hi Chris 

We are currently using Oracle Goldengate for CDC. Our Volume of ingestion is huge, we have 70 shards and during peak time 1 Million records get ingested in an hour.. We are planning to dockerize our environment. We are using debezium for mysql and postresql and evaluating debezium for oracle as well. Our oracle databases runs on AWS RDS,  there is no single documentation from AWS whether xstream can be enabled. I checked with AWS support, and they confirmed there is no offical documentation which confirms there is no support.We can kind of conclude oracle Xstreams is not suppored on AWS RDS So now we are left with LogMiner and Goldengate. I wanted to understand the performance of LogMiner when load is high and is there any gap any functionality. Would you suggest for high loads better to use goldengate. 

[Chris Cranford]

Hi Karthik,

So we do have users who move that much, and some who move substantially more data, in that same time period.  One million rows/hour is approximately 278 events/second, which is more than reasonable and actually lower than what we aim for :).  As for gaps, that highly depends entirely on your use cases of GoldeGate.  Most common use cases such as data replication, transformation, bigdata, and eventual consistency for microservices is all possible with Debezium for Oracle, just to name a few.

If you have any more specific questions, I'd be welcomed to answer those.

Thanks
CC

On 4/30/22 13:12, karthik narayan wrote:

Hi Chris 

We are currently using Oracle Goldengate for CDC. Our Volume of ingestion is huge, we have 70 shards and during peak time 1 Million records get ingested in an hour.. We are planning to dockerize our environment. We are using debezium for mysql and postresql and evaluating debezium for oracle as well. Our oracle databases runs on AWS RDS,  there is no single documentation from AWS whether xstream can be enabled. I checked with AWS support, and they confirmed there is no offical documentation which confirms there is no support.We can kind of conclude oracle Xstreams is not suppored on AWS RDS So now we are left with LogMiner and Goldengate. I wanted to understand the performance of LogMiner when load is high and is there any gap any functionality. Would you suggest for high loads better to use goldengate. 

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/33e9838a-39e2-4458-a458-8de0d387d8cen%40googlegroups.com.