Oracle debezium incremental snapshots

[Reddy Anand]

Hello,

am new to debezium and currently doing poc on this stuff,we have connector setting to include tables "Reddy.ORDERS, Reddy.ORDERS_LINE_ITEM, SVCREDDY.DEBEZIUM_SIGNAL"

 we are getting below error

Caused by: io.debezium.DebeziumException: Online REDO LOG files or archive log files do not contain the offset scn 474823979341.  Please perform a new snapshot.

we have increased archive redo log retention to 7 days and still getting error in 2 days after resetting offsets.

Further digging into debezium_signal,not sure why its doing incremental snapshot for all tables in reddy schema(reddy.*)

SQL> select * from  SVCREDDY  .DEBEZIUM_SIGNAL;

ID                                         TYPE
------------------------------------------ --------------------------------
DATA
--------------------------------------------------------------------------------
E5BFF41XXX           execute-snapshot
{"data-collections": ["Reddy.*"],"type":"incremental"}

E5BFFXXX           execute-snapshot
{"data-collections": ["Reddy.*"],"type":"incremental"}

any advise?Is it Normal?

Reddy

[Chris Cranford]

Hi

Looking at the code, I believe you've identified a bug in the incremental snapshot functionality.  Could you please raise a Jira and be sure to include your full connector configuration and the signal you've specified below?

Ideally, if your table include list explicitly specifies the 3 tables you've specified then the incremental snapshot process should have only triggered for the two tables ORDERS and ORDERS_LINE_ITEM; however, the current behavior does not seem to restrict the tables based on the configured filters, only that the table has a schema record in the in-memory relational model, which would be the case if schema.history.internal.store.only.captured.tables.ddl is set to its default of false.

Thanks!
Chris

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/9f737b7f-4bf8-4c72-8955-603265705b96n%40googlegroups.com.

[Chris Cranford]

In that case, please raise a Jira.

Thanks,
Chris

On 3/28/23 18:29, Reddy Anand wrote:

HI Chris,

Thanks for your response, schema.history.internal.store.only.captured.tables.ddl might be taking default as it not explicitly set anywhere.

Thanks-R

To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/dfae453a-2409-4b1a-a18c-a9e0ed97f3f5n%40googlegroups.com.