Logminer connector not creating any topic in Oracle 19c on RDS

[Emanuele Meazzo]

Hello Everybody,

I have a strange issue with the Oracle connector that is blocking a POC I'm creating.

I'm able to set everything up, I get no errors, but I see no topics in my connector nor I see any events coming in from kafka.

Here are the details of my environment:

1. Local Docker connector built with compose
2. Oracle 19c hosted on AWS RDS

docker-compose.yaml is attached

This is the connector configuration I'm deploying:

{

  "name": "inventory-connector",

  "config": {

    "connector.class" : "io.debezium.connector.oracle.OracleConnector",

    "tasks.max" : "1",

    "database.server.name" : "XXX",

    "database.hostname" : XXXXXXXXXXXX",

    "database.port" : "1521",

    "database.user" : "LOGMINER",

    "database.password" : "XXXXXXXXX",

    "database.dbname" : "XXX",

"database.schema" : "XXX",

    "database.connection.adapter" : "LOGMINER",

    "database.history.kafka.bootstrap.servers" : "kafka:9092",

    "database.history.kafka.topic": "schema-changes.inventory",

"snapshot.mode": "schema_only"

}

}

What else can I check? I see no errors anywhere in the docker console output and kafka seems to have a connected session in the DB so it's reaching it for sure :/

[Emanuele Meazzo]

And of course the connector is shown as registered when asking Debezium

[Chris Cranford]

Hi Emanuele -

I have a couple questions, if I may.  What version of Debezim are you using?  Is your Oracle 19c environment using container/pluggable databases?  Did you setup the user/tablespaces as indicated in the documentation?  Could you enable trace logging and provide us with the logs? 

Thanks
Chris

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/e9c8f414-0fb1-467d-9498-d70b19eb147an%40googlegroups.com.

[Emanuele Meazzo]

Hello Chris,

thanks for the support, I managed to get it working now :)
For future reference, here are my specs:

• Oracle 19c with non-pluggable dbs

User and tablespace set up as in the docs, but with some changes to the permissions due to the different RDS commands

The issue was that I didn't specify the "schema.include.list" attribute in the connector configuration, and hence it was trying to get ALL the data from ALL the schemas; unfortunately, being in a dev instance, I had some invalid objects, which made the topic configuration crash.

I've added both schema.include.list and schema.exclude.list to my config and only the desired schema was fetched, allowing the topic creation process to complete and finally the connector to work :)

I now have a weird issue where int fields are treated as strings, but I'll probably open another conversation for it

[Chris Cranford]

Hi Emanuele -

Just a quick follow-up, you wouldn't happen to be specifying `decimal.handling.mode` as `string` would you?

To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/f5bb71fd-fb40-451d-b9b4-3176414acdc7n%40googlegroups.com.

[Emanuele Meazzo]

Hey Chris,

nope, I didn't modify that value.

I tried to reconfigure the connector specifiying  "decimal.handling.mode": "precise" , but that's the same.

I see something like this:

ORACLE

• INSERT INTO TESTTABLE
• VALUES (1,'hey hey hey hey');
• COMMIT;

Console Output:
"payload":{"before":null,"after":{"ID":"AQ==","VALUE":"hey hey hey hey"}