rg.apache.kafka.common.errors.InvalidConfigurationException: Value must be between 1 and 2160 Parameter name: RetentionTimeInHours

11 views
Skip to first unread message

Suraj Gandhi

unread,
Jul 10, 2024, 12:41:43 AMJul 10
to debezium
Hello Everyone

I am running Kafka Connect (Oracle Debezium Connector Installed) on my local machine. The Kafka Connect is connected to Azure Event Hub. I have configured Oracle 21c Enterprise DB running on my local docker.

When I run the Kafka Connect I can see 3 event hub getting created in Azure Event Hub i.e connect-cluster-configs, connect-cluster-offsets, connect-cluster-status

But When I send a POST request to Kafka Connect to make the connection. I am getting following error:

java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.InvalidConfigurationException: Value must be between 1 and 2160
Parameter name: RetentionTimeInHours
Actual value was 2562047788015.

I am not sure where I am going wrong. I tried searching the issue but nothing seems to work. I even tried to mention retention.ms parameter while sending the POST request but no luck.

Following is the body of POST request:-
{
  "name": "customers-connector",
  "config": {
    "connector.class": "io.debezium.connector.oracle.OracleConnector",
    "tasks.max": "1",
    "database.hostname": "localhost",
    "database.port": "1521",
    "database.user": "c##dbzuser",
    "database.password": "dbz",
    "database.dbname": "ORCLCDB",
    "database.pdb.name": "ORCLPDB1",
    "database.server.name": "server1",
    "table.include.list": "C##DBZUSER.CUSTOMERS",
    "topic.prefix": "ABC",
    "schema.history.internal.kafka.topic": "customers",
    "schema.history.internal.kafka.bootstrap.servers": "namespace.servicebus.windows.net:9093",
    "schema.history.internal.producer.security.protocol": "SASL_SSL",
    "schema.history.internal.producer.sasl.mechanism": "PLAIN",
    "schema.history.internal.producer.sasl.jaas.config": "org.apache.kafka.common.security.plain.PlainLoginModule required username=\"$ConnectionString\" password=\"Endpoint=sb://namespace.servicebus.windows.net/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=XXXXXXXXX\";",
    "schema.history.internal.consumer.security.protocol": "SASL_SSL",
    "schema.history.internal.consumer.sasl.mechanism": "PLAIN",
    "schema.history.internal.consumer.sasl.jaas.config": "org.apache.kafka.common.security.plain.PlainLoginModule required username=\"$ConnectionString\" password=\"Endpoint=sb://namespace.servicebus.windows.net/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=XXXXXXXXX\";",
    "database.encrypt": "true",
    "database.trustServerCertificate": "true",
    "retention.ms": "604800000"
  }
}

Any help is highly appreciated.


Thanks you

jiri.p...@gmail.com

unread,
Jul 11, 2024, 7:22:26 AMJul 11
to debezium
Hi,

I am afraid it relaset to the internal schema history topic - customers in your case. Could you please try to create it in advance?

Jiri

Reply all
Reply to author
Forward
0 new messages