Hi
For debezium 2.5 and oracle.
I want to include some new tables in my Debezium Oracle connector, but they don’t have a defined primary key. When I asked the DBA, they gave me one column that’s unique and told me to treat it as a surrogate key.
My connector is currently running in snapshot.mode=initial, and the snapshot is still in progress.
How can I safely add these new tables to the connector while the snapshot is running?
--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/617bc7b3-56aa-40e0-9288-a4d60ffab109n%40googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/69e38318-fa37-41d9-ab26-be6e6e24504a%40gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJt55aQex9xrfNA%2B_CRDWzhY%2BO%2BJgM5r%2BdrVFVr13kQvEw%40mail.gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJuZjxoc45o7vS_Sty0hOiRp0cu8LASBnmzg05mF_SeAwA%40mail.gmail.com.
Hi Chris,
Yes, we are using schema.history.internal.store.only.captured.tables.ddl = true
.
what may be drawbacks of using false because it seems to be straightforward while adding new tables.
I had a question regarding incremental snapshots through the signal table — how does it work when the table doesn’t have a primary key defined?
The DBA mentioned that one of the columns is unique. In this case, should the DBA alter the table to define that column as a primary key? Or is there a way to handle this through connector configuration without modifying the table schema
You received this message because you are subscribed to a topic in the Google Groups "debezium" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/debezium/eprO8bnk-es/unsubscribe.
To unsubscribe from this group and all its topics, send an email to debezium+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/5015a351-7dad-406f-9089-034595611caf%40gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJts8_gPR5ju4LFcBO3ZknS24w82SSU-Pk_WcoSFJ9UrhQ%40mail.gmail.com.
Hi Chris, thanks for the response.
As we prepare to move to the production database, I had a quick question: If we need to add new tables later on, what’s the recommended approach?
Should we follow the method outlined in theDebezium Connector for Oracle :: Debezium Documentation— based on schema change detection — or is there a better alternative for production environments?
Also, if we do follow that method, how can we ensure there’s no data loss during the period when the connector is paused and the new tables are being added?
Appreciate your guidance on this!
Regards,To view this discussion visit https://groups.google.com/d/msgid/debezium/61f806da-4d41-4961-8fc4-096b883076fb%40gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJuAkMfZAuCPYB0aiaUfSwdpBknE%2BAkeJXgW7s8PVLwVDA%40mail.gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/b150980f-a6e2-4c2b-84c8-0ee2746f7e4c%40gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJuP1%2BR7c%2BAHsjfbqXi4jOdHCuDTyeNrs9jKGeKhcpT%3D3Q%40mail.gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/62428c5f-dbcc-46ca-91c8-0b03fd13cd0b%40gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJsr_fZTcfaj3FnOCRCXk4-Fzb3OjGWM4213JjTyj%3DKJJg%40mail.gmail.com.
Hi Chris,
I followed these steps to add a new table:
Paused the connector
Added the new table to the configuration
Changed the snapshot mode to schema_only_recovery
Restarted the connector
However, I don’t see the schema for the new table being captured in the schema history topic. Could you help me understand what might be missing or if there’s an additional step required?
I am worried because in production I don't want to delete schema history topics for adding new tables.
Thanks,
Ramesh
To view this discussion visit https://groups.google.com/d/msgid/debezium/91ecfb6f-f2f9-44ea-8c06-ff5842509d27%40gmail.com.
To view this discussion visit https://groups.google.com/d/msgid/debezium/CAG%2BsLJu_JCZ0Js95ZxSGZfG9rmpnm8qnpMUrWDcRUDSRyFg-dw%40mail.gmail.com.