Debezium Oracle include.list not working

136 views
Skip to first unread message

Joao Augusto Fernandes Barbosa

unread,
Jul 30, 2024, 4:53:14 PM7/30/24
to debezium
I'm trying to get a specif table in Oracle. I have already other connectors using MySql.
My Oracle Connector is as follow:
kind: KafkaConnector
metadata:
name: protheus-connector
labels:
strimzi.io/cluster: protheus-connect
spec:
class: io.debezium.connector.oracle.OracleConnector
tasksMax: 1
config:
database.dbname: "***"
database.hostname: "*.*.*.*"
database.port: "1521"
database.user: "**"
database.password: "**"
database.tablename.case.insensitive: "true"
database.history.store.only.captured.tables.ddl: "true"
table.include.list: <schema_a>.<table>
archive.log.hours: 6
topic.prefix: protheus
tasks.max: "1"
schema.history.internal.kafka.bootstrap.servers: my-cluster-kafka-plain-bootstrap:9092
schema.history.internal.kafka.topic: "protheus.protheus"
My Connect:
kind: KafkaConnect
metadata:
name: protheus-connect
annotations:
spec:
replicas: 1
bootstrapServers: my-cluster-kafka-plain-bootstrap:9092
config:
group.id: protheus-connect
config.storage.topic: protheus-connect-configs
offset.storage.topic: protheus-connect-offset
status.storage.topic: protheus-connect-status
key.converter: org.apache.kafka.connect.json.JsonConverter
value.converter: org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable: false
value.converter.schemas.enable: false
num.partitions: 3
offset.storage.replication.factor: 3
producer.acks: 1
producer.batch.size: 862144
producer.buffer.memory: 104857600
producer.compression.type: lz4
producer.max.request.size: 5242880
status.storage.replication.factor: 3
image: ecr/debezium_oracle_protheus:latest
resources:
limits:
memory: 4Gi
requests:
cpu: "1.0"
memory: 4Gi
jvmOptions:
-Xms: 2560m
-Xmx: 2560m
metricsConfig:
type: jmxPrometheusExporter
valueFrom:
configMapKeyRef:
key: metrics-config-protheus.yml
name: connect-metrics-protheus

However, I can not get my table. The process register a different table:
[protheus-connector|task-0]     Registering 'dbname.<random_schema_b>.<random_table>'
Both schema and table does exist in my DB, but I do not want them.
I've tried to set only my schema.include.list to schema_a, but it does not work.
Also, I've tried to set table.include.list to another table from schema_b to check if it could be a schema misconfiguring. Again, it start the register of all the schema_b and get an error.

Usually the error is: can not read properties of table <wrong_schema>.<wrong_table>.
help pls I don't know what could I do :((((

Esta mensagem e seus anexos são destinados apenas às pessoas a que foram endereçadas, e podem conter informação privilegiada e/ou confidencial. Se você receber essa mensagem por engano, por favor, apague-a e notifique o remetente imediatamente. Qualquer cópia, armazenagem, disseminação ou divulgação, total ou parcial, por pessoa que não seja o destinatário desta mensagem, é proibida.

This message and any attachments is intended for the named addressee(s) only and may contain information that is privileged and/or confidential. If you receive this message in error, please delete it and immediately notify the sender. Any copying, storage, dissemination or disclosure, either whole or partial, by a person who is not the named addressee is prohibited.

Chris Cranford

unread,
Jul 30, 2024, 4:57:27 PM7/30/24
to debe...@googlegroups.com
I think we answered this on Zulip [1].  Let us know if there are any other questions.

Thanks,
-cc

[1]: https://debezium.zulipchat.com/#narrow/stream/348250-community-oracle/topic/Wrong.20Schema.2FTable/near/455212122
--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/eb5d2420-dbca-4198-90c2-b5e84d6450c3n%40googlegroups.com.

Reply all
Reply to author
Forward
0 new messages