schema_only option for snapshot.mode

830 views
Skip to first unread message

satyajit vegesna

unread,
Jul 17, 2017, 6:25:52 PM7/17/17
to debezium
Hi All,

i am trying to setup debezium with schema_only snapshot.mode option.

When i try to create a connector using kafka rest api , with "snapshot.mode":"schema_only", i get the below error,

curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" *********:8083/connectors -d '{ "name": "deb-staging", "config": { "connector.class": "io.debezium.connector.mysql.MySqlConnector", "tasks.max": "1", "database.hostname": "*******", "database.port": "3306", "database.user": "******", "database.password": "******", "database.server.id": "9923684", "database.server.name": "********", "database.whitelist": "snap_production","database.history.kafka.bootstrap.servers": "********:9092", "database.history.kafka.topic": "deb-staging-snap-history", "snapshot.mode": "schema_only" }}'


But for the same above curl command, when i replace the snapshot.mode:never or others, it works fine, the only problem is with schema_only.
Any help would be highly appreciated.


HTTP/1.1 400 Bad Request

Date: Mon, 17 Jul 2017 22:22:43 GMT

Content-Type: application/json

Content-Length: 357

Server: Jetty(9.2.15.v20160210)


{"error_code":400,"message":"Connector configuration is invalid and contains the following 1 error(s):\ndatabase.list is referred in the dependents, but not defined.\nConfiguration is not defined: database.list\nValue must be one of never, when_needed, initial\nYou can also find the above list of errors at the endpoint `/{connectorType}/config/validate`"}

Randall Hauch

unread,
Jul 17, 2017, 7:32:07 PM7/17/17
to debezium
What version of Kafka Connect are you using? What version of Debezium? 

The strange thing is that the MySQL connector does not have a "database.list" configuration property (as reported in the error response), but the MongoDB connector does. Any chance that you've use the same connector name for both?

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+unsubscribe@googlegroups.com.
To post to this group, send email to debe...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/debezium/6c64111d-c384-4a0e-a86c-a990281839e2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

satyajit vegesna

unread,
Jul 18, 2017, 1:20:51 PM7/18/17
to debezium
Hi Randall,

Confluent version:3.2.1

And just to let you know, i am not using Mongo connector but using specific mysql connector.

Regards,
Satyajit.


On Monday, 17 July 2017 16:32:07 UTC-7, Randall Hauch wrote:
What version of Kafka Connect are you using? What version of Debezium? 

The strange thing is that the MySQL connector does not have a "database.list" configuration property (as reported in the error response), but the MongoDB connector does. Any chance that you've use the same connector name for both?
On Mon, Jul 17, 2017 at 5:25 PM, satyajit vegesna <varma.s...@gmail.com> wrote:
Hi All,

i am trying to setup debezium with schema_only snapshot.mode option.

When i try to create a connector using kafka rest api , with "snapshot.mode":"schema_only", i get the below error,

curl -i -X POST -H "Accept:application/json" -H "Content-Type:application/json" *********:8083/connectors -d '{ "name": "deb-staging", "config": { "connector.class": "io.debezium.connector.mysql.MySqlConnector", "tasks.max": "1", "database.hostname": "*******", "database.port": "3306", "database.user": "******", "database.password": "******", "database.server.id": "9923684", "database.server.name": "********", "database.whitelist": "snap_production","database.history.kafka.bootstrap.servers": "********:9092", "database.history.kafka.topic": "deb-staging-snap-history", "snapshot.mode": "schema_only" }}'


But for the same above curl command, when i replace the snapshot.mode:never or others, it works fine, the only problem is with schema_only.
Any help would be highly appreciated.


HTTP/1.1 400 Bad Request

Date: Mon, 17 Jul 2017 22:22:43 GMT

Content-Type: application/json

Content-Length: 357

Server: Jetty(9.2.15.v20160210)


{"error_code":400,"message":"Connector configuration is invalid and contains the following 1 error(s):\ndatabase.list is referred in the dependents, but not defined.\nConfiguration is not defined: database.list\nValue must be one of never, when_needed, initial\nYou can also find the above list of errors at the endpoint `/{connectorType}/config/validate`"}

--
You received this message because you are subscribed to the Google Groups "debezium" group.
To unsubscribe from this group and stop receiving emails from it, send an email to debezium+u...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages