Unable to start ksql kafka connect for SQL Server Debezium

[Paul Gobin]

Hey guys, I am testing out ksql and SQLServer connector, I followed the directions and everything looks good, However, I am unable to get the SQLServer connector to start. below is my .json file etc.

Any help would be much appreciated.

register-sqlserver.json config file:

{

 "name": "ttmain-connector",

 "config": {

     "connector.class" : "io.debezium.connector.sqlserver.SqlServerConnector",

     "tasks.max" : "1",

     "database.server.name" : "server1",

     "database.hostname" : "SQLBilling64.bvn.com",

     "database.port" : "1433",

     "database.user" : "qauser",

     "database.password" : "xxxx",

     "database.dbname" : "PGTroubleTicketPOC",

"table.whitelist": "dbo.TTMain", 

     "database.history.kafka.bootstrap.servers" : "bvdevkelklxvm.bvn.com:9092",

     "database.history.kafka.topic": "schema-changes.ttmain"

     }

 }

 

start command:

sudo ./connect-standalone ../etc/kafka/connect-standalone.properties ../etc/kafka-connect-sqlserver/register-sqlserver.json 

error:

[2019-11-10 05:59:33,872] ERROR Failed to create job for ../etc/kafka-connect-sqlserver/register-sqlserver.json (org.apache.kafka.connect.cli.ConnectStandalone:110)

[2019-11-10 05:59:33,881] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:121)

java.util.concurrent.ExecutionException: org.apache.kafka.connect.runtime.rest.errors.BadRequestException: Connector config {"config"={, "database.user"="qauser",, "database.port"="1433",, "database.server.name"="server1",, "connector.class"="io.debezium.connector.sqlserver.SqlServerConnector",, "tasks.max"="1",, "database.history.kafka.topic"="schema-changes.ttmain", "name"="ttmain-connector",, "database.hostname"="SQLBilling64.bvn.com",, {=, "database.password"="xxx",, "database.dbname"="PGTroubleTicketPOC",, "database.history.kafka.bootstrap.servers"="bvdevkelklxvm.bvn.com:9092",, }=, "table.whitelist"="dbo.TTMain", } contains no connector type

        at org.apache.kafka.connect.util.ConvertingFutureCallback.result(ConvertingFutureCallback.java:79)

        at org.apache.kafka.connect.util.ConvertingFutureCallback.get(ConvertingFutureCallback.java:66)

        at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:118)

Caused by: org.apache.kafka.connect.runtime.rest.errors.BadRequestException: Connector config {"config"={, "database.user"="qauser",, "database.port"="1433",, "database.server.name"="server1",, "connector.class"="io.debezium.connector.sqlserver.SqlServerConnector",, "tasks.max"="1",, "database.history.kafka.topic"="schema-changes.ttmain", "name"="ttmain-connector",, "database.hostname"="SQLBilling64.bvn.com",, {=, "database.password"="xxxx",, "database.dbname"="PGTroubleTicketPOC",, "database.history.kafka.bootstrap.servers"="bvdevkelklxvm.bvn.com:9092",, }=, "table.whitelist"="dbo.TTMain", } contains no connector type

        at org.apache.kafka.connect.runtime.AbstractHerder.validateConnectorConfig(AbstractHerder.java:287)

        at org.apache.kafka.connect.runtime.standalone.StandaloneHerder.putConnectorConfig(StandaloneHerder.java:192)

        at org.apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:115)

[2019-11-10 05:59:33,888] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:66

Thanks

Paul

[Tim Fox]

Hey Paul,

Could you post this on the user group? This one is for development discussions :)

The user group is here: https://groups.google.com/forum/#!forum/ksql-users

Many thanks

[Paul Gobin]

Hey @tfox thanks for the quick response, I posted the issue on the ksql-users group.

Quick question, if I would like to do some dev work for this project, what do I need to do? This is a really cool project and I think there's really great potential and alot of excitement with this project.

Regards

Paul

[Tim Fox]

Hey Paul,

Thanks for your interest. I'm sure we can find something for you :) 

I'd recommend starting out with something small - e.g. a small bugfix or enhancement. Perhaps something like https://github.com/confluentinc/ksql/issues/2954 ? 

But feel free to look at other GitHub issues, in particular https://github.com/confluentinc/ksql/issues?utf8=%E2%9C%93&q=is%3Aopen+is%3Aissue+label%3Auser-experience and https://github.com/confluentinc/ksql/issues?utf8=%E2%9C%93&q=is%3Aopen+is%3Aissue++label%3Abug+ in case anything else catches your eye.

Also, please join us on our development Slack channel #ksql-dev - we're there most of the time during the week, and we can answer any questions or give guidance.

Thanks!

[Tim Fox]

I'd also recommend (if you haven't done already) taking a look at https://github.com/confluentinc/ksql/blob/master/CONTRIBUTING.md which has lots of info on setting up the project for development, and development workflow :)