Corporate env - massive Oracle DBs

[David Saggese Banhos]

Hi  everyone,

   

    That's my first email here, and I hope I won't disturb this group much.

    I've been working on Fintech most of my career, and Debezuim looks like a great facilitator to expose the required data from Oracle DB datasets over Kafka.

    Most of the time I have to deal with two constraints: massive amounts of data, and low latency (traders have very short patience...).

    I read a good part of the tutorial and docs, but I could not find much about the capabilities and performance for the Oracle Debezium connector.

  Does anyone work on a similar env? If so, were there any problems encountered?

Regards,

David

LinkedIn: https://sg.linkedin.com/in/davidbanhos

  

    

[Chris Cranford]

Hi David -

To be frank, the Oracle license prevents us from disclosing any absolute performance numbers, as much as we would like to. But I can say that we have  community and commercial users relying on Debezium where Oracle is generating several hundreds of gigs of redo changes per hour. Of course massive is often a relative term in my experience, so it may be helpful if you can speak in more absolutes in terms of numbers of concurrent transactions, the transaction sizes, number of captured tables & their widths, and the disparity between changes to captured versus non-captured tables.

Other important influences on performance do include:

    * Hardware - making sure you have the CPU/IO power
    * IO contention - how contended is the Oracle redo system system with existing load
    * Database tuning

Could you share more detail, if possible?

Thanks,
-cc

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAELZ7m8gUUXT4Uh3zFAoLco6YhaCiDR8c%2B3AXaz_TVMY2jHV5Q%40mail.gmail.com.