Kafka connect: connecting JDBC source using Sql server
2,411 views
Skip to first unread message
akarshika lowe
Dec 6, 2016, 7:47:33 AM12/6/16
to Confluent Platform
Hi,
I am using kafka connect to load data from SQL SERVER. After giving the connection details when I am trying to build connection it is giving incorrect port number, though the details are correct. The driver I am using is sqljdbc42.jar. Is there any other driver also I need to add? Do I need to use striim?
Dustin Cote
Dec 6, 2016, 11:47:23 AM12/6/16
to confluent...@googlegroups.com
Is there a specific error message you are getting? Would you mind uploading the configuration for the connector? The port should be specified in the `connection.url` property for the connector as described in this example.
I'm not sure if you'd need another driver based on the description, but if you are getting the wrong port, then likely it's to do with the `connection.url` setting.
On Tue, Dec 6, 2016 at 7:47 AM, akarshika lowe <akarsh...@gmail.com> wrote:
Hi,I am using kafka connect to load data from SQL SERVER. After giving the connection details when I am trying to build connection it is giving incorrect port number, though the details are correct. The driver I am using is sqljdbc42.jar. Is there any other driver also I need to add? Do I need to use striim?
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6a54b7d1-fadd-44ea-b3c8-c36a351f77b5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
ak
Dec 8, 2016, 5:15:31 AM12/8/16
to Confluent Platform
Hi,
I am able to connect to the sqlserver but I am not able to connect to a particular schema, There are many schema in my database. When I give this connection string :
jdbc:sqlserver://<ip>:<portname>;database=<Databasename>;user=**;password=****
it fetches all the tables from all schemas. I am not able to hit a particular schema.Even if i mention schema name in the connection string still it is not working. Since it fetches all the tables I am getting this error:
ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='AWBuildVersion', query='null', topicPrefix='test-sqlserver-jdbc-Person.Address', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid column name 'AddressID'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
Dustin Cote
Dec 9, 2016, 8:50:13 AM12/9/16
to confluent...@googlegroups.com
It's a little hard to tell if you have done this without the configuration, but have you setup a `table.whitelist` or `table.blacklist` in your connector configuration? There is also a `schema.pattern` option if you want to filter for certain schemas.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/64430b9e-fc5b-4f13-b495-c1bf512f7669%40googlegroups.com.
akarshika lowe
Dec 12, 2016, 2:10:51 AM12/12/16
to confluent...@googlegroups.com
Hi,
I am getting the following error. It is saying invalid object name though the table name is correct.
incrementing.column.name = AddressID
validate.non.null = true
query =
batch.max.rows = 100
table.blacklist = []
table.poll.interval.ms = 60000
table.whitelist = [Address]
mode = incrementing
topic.prefix = test-sqlserver-jdbc-
tables = [Address]
poll.interval.ms = 5000
connection.url = jdbc:sqlserver://10.243.25.40:1433;database=AdventureWorks2012;user=***;password=*****
(io.confluent.connect.jdbc.JdbcSourceTaskConfig:178)
[2016-12-12 12:28:39,207] INFO Created connector test-sqlserver-jdbc-autoincrement (org.apache.kafka.connect.cli.ConnectStandalone:91)
[2016-12-12 12:28:39,643] INFO Source task WorkerSourceTask{id=test-sqlserver-jdbc-autoincrement-0} finished initialization and start (org.apache.kafka.connect.runtime.WorkerSourceTask:138)
[2016-12-12 12:28:39,698] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
[2016-12-12 12:28:44,079] WARN could not create Dir using jarFile from url file:/home/confluent-3.0.0_bkp/bin/../share/java/kafka/kafka.jar. skipping. (org.reflections.Reflections:104)
java.util.zip.ZipException: zip file is empty
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:219)
at java.util.zip.ZipFile.<init>(ZipFile.java:149)
at java.util.jar.JarFile.<init>(JarFile.java:166)
at java.util.jar.JarFile.<init>(JarFile.java:130)
at org.reflections.vfs.Vfs$DefaultUrlTypes$1.createDir(Vfs.java:212)
at org.reflections.vfs.Vfs.fromURL(Vfs.java:99)
at org.reflections.vfs.Vfs.fromURL(Vfs.java:91)
at org.reflections.Reflections.scan(Reflections.java:237)
at org.reflections.Reflections.scan(Reflections.java:204)
at org.reflections.Reflections.<init>(Reflections.java:129)
at org.apache.kafka.connect.runtime.AbstractHerder.connectorPlugins(AbstractHerder.java:268)
at org.apache.kafka.connect.runtime.AbstractHerder$1.run(AbstractHerder.java:377)
at java.lang.Thread.run(Thread.java:745)
[2016-12-12 12:28:44,749] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
[2016-12-12 12:28:45,786] INFO Reflections took 10422 ms to scan 262 urls, producing 12009 keys and 79109 values (org.reflections.Reflections:229)
[2016-12-12 12:28:50,109] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
[2016-12-12 12:28:55,162] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Inv
On Fri, Dec 9, 2016 at 7:20 PM, Dustin Cote <dus...@confluent.io> wrote:
It's a little hard to tell if you have done this without the configuration, but have you setup a `table.whitelist` or `table.blacklist` in your connector configuration? There is also a `schema.pattern` option if you want to filter for certain schemas.
On Thu, Dec 8, 2016 at 5:15 AM, ak <akarsh...@gmail.com> wrote:
Hi,I am able to connect to the sqlserver but I am not able to connect to a particular schema, There are many schema in my database. When I give this connection string :jdbc:sqlserver://<ip>:<portname>;database=<Databasename>;user=**;password=****
it fetches all the tables from all schemas. I am not able to hit a particular schema.Even if i mention schema name in the connection string still it is not working. Since it fetches all the tables I am getting this error:
ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='AWBuildVersion', query='null', topicPrefix='test-sqlserver-jdbc-Person.Address', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid column name 'AddressID'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/64430b9e-fc5b-4f13-b495-c1bf512f7669%40googlegroups.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCneZ-LcZ7zmKODAN7WAV_JrFFEZ6UQ6z0dBszj1Qh5sE4Vw%40mail.gmail.com.
akarshika lowe
Dec 12, 2016, 2:11:33 AM12/12/16
to confluent...@googlegroups.com
Hi,
I am getting the following error. It is saying invalid object name though the table name is correct.
incrementing.column.name = AddressID
validate.non.null = true
query =
batch.max.rows = 100
table.blacklist = []
table.poll.interval.ms = 60000
table.whitelist = [Address]
mode = incrementing
topic.prefix = test-sqlserver-jdbc-
tables = [Address]
poll.interval.ms = 5000
connection.url = jdbc:sqlserver://<ip>:1433;database=AdventureWorks2012;user=***;password=*****
It's a little hard to tell if you have done this without the configuration, but have you setup a `table.whitelist` or `table.blacklist` in your connector configuration? There is also a `schema.pattern` option if you want to filter for certain schemas.
On Thu, Dec 8, 2016 at 5:15 AM, ak <akarsh...@gmail.com> wrote:
Hi,I am able to connect to the sqlserver but I am not able to connect to a particular schema, There are many schema in my database. When I give this connection string :jdbc:sqlserver://<ip>:<portname>;database=<Databasename>;user=**;password=****
it fetches all the tables from all schemas. I am not able to hit a particular schema.Even if i mention schema name in the connection string still it is not working. Since it fetches all the tables I am getting this error:
ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='AWBuildVersion', query='null', topicPrefix='test-sqlserver-jdbc-Person.Address', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid column name 'AddressID'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/64430b9e-fc5b-4f13-b495-c1bf512f7669%40googlegroups.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCneZ-LcZ7zmKODAN7WAV_JrFFEZ6UQ6z0dBszj1Qh5sE4Vw%40mail.gmail.com.
Dustin Cote
Dec 12, 2016, 11:17:53 AM12/12/16
to confluent...@googlegroups.com
It looks like an access problem to me for the table 'Address'. Does the user in the connection string have access to the table? Are you able to access other tables in this database via the connector?
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCneZ-LcZ7zmKODAN7WAV_JrFFEZ6UQ6z0dBszj1Qh5sE4Vw%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHdFKf7UWXhJ82E9sszYRxevWDneErLx2Z7CALh5sEs4Ng%40mail.gmail.com.
akarshika lowe
Dec 13, 2016, 4:48:08 AM12/13/16
to confluent...@googlegroups.com
Hi,
What do you mean by TimestampIncrementingTableQuerier in sqlserver. I am getting this error though i have access to this table "Address".
ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
On Tue, Dec 6, 2016 at 10:17 PM, Dustin Cote <dus...@confluent.io> wrote:
Is there a specific error message you are getting? Would you mind uploading the configuration for the connector? The port should be specified in the `connection.url` property for the connector as described in this example.I'm not sure if you'd need another driver based on the description, but if you are getting the wrong port, then likely it's to do with the `connection.url` setting.
On Tue, Dec 6, 2016 at 7:47 AM, akarshika lowe <akarsh...@gmail.com> wrote:
Hi,I am using kafka connect to load data from SQL SERVER. After giving the connection details when I am trying to build connection it is giving incorrect port number, though the details are correct. The driver I am using is sqljdbc42.jar. Is there any other driver also I need to add? Do I need to use striim?
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6a54b7d1-fadd-44ea-b3c8-c36a351f77b5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCnebzr7poEsc6ngSAx-nvf%2BgeBvdWYvCxJaXjhh8XeKWXVA%40mail.gmail.com.
Dustin Cote
Dec 13, 2016, 12:03:35 PM12/13/16
to confluent...@googlegroups.com
This is the querier specified in the connector. The code for which is here. I'm curious if you can try running against a different table because maybe something is incorrect in the way you have specified the location of the table?
On Tue, Dec 13, 2016 at 4:48 AM, akarshika lowe <akarsh...@gmail.com> wrote:
Hi,What do you mean by TimestampIncrementingTableQuerier in sqlserver. I am getting this error though i have access to this table "Address".ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
On Tue, Dec 6, 2016 at 10:17 PM, Dustin Cote <dus...@confluent.io> wrote:
Is there a specific error message you are getting? Would you mind uploading the configuration for the connector? The port should be specified in the `connection.url` property for the connector as described in this example.I'm not sure if you'd need another driver based on the description, but if you are getting the wrong port, then likely it's to do with the `connection.url` setting.On Tue, Dec 6, 2016 at 7:47 AM, akarshika lowe <akarsh...@gmail.com> wrote:Hi,--I am using kafka connect to load data from SQL SERVER. After giving the connection details when I am trying to build connection it is giving incorrect port number, though the details are correct. The driver I am using is sqljdbc42.jar. Is there any other driver also I need to add? Do I need to use striim?
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6a54b7d1-fadd-44ea-b3c8-c36a351f77b5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCnebzr7poEsc6ngSAx-nvf%2BgeBvdWYvCxJaXjhh8XeKWXVA%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcJrdU%3DqHWwnBeSTiz_4H%3DdZkAYzcS0wT3SKa5mU6CVjQ%40mail.gmail.com.
akarshika lowe
Dec 16, 2016, 2:40:39 AM12/16/16
to confluent...@googlegroups.com
Hi,
I am able to connect to the dbo schema, but when I am trying for some other schemas it is not working. I am not able to connect to tables of different schemas except that of dbo in sql server. Like, If i will try for address table in schema Person it is not connecting but if I try for a table in dbo schema it is connecting. So , Is there a way to connect to different shcemas. It is not hitting other schemas.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcJrdU%3DqHWwnBeSTiz_4H%3DdZkAYzcS0wT3SKa5mU6CVjQ%40mail.gmail.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCnebzVteLWEFQUMPS%2B4rSQ1fOqYw9oHvkKifN%2BVR2N0VNSg%40mail.gmail.com.
Dustin Cote
Dec 16, 2016, 8:35:06 AM12/16/16
to confluent...@googlegroups.com
I'm not totally familiar with SQL server JDBC specifically, but StackOverflow would suggest you should be setting the default schema for the user connecting to the database:
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsubscribe@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCnebzVteLWEFQUMPS%2B4rSQ1fOqYw9oHvkKifN%2BVR2N0VNSg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcyrpQB3vDeXKt7KxhWN308wAYChunsaVx5%3DfwGE%3Di-pg%40mail.gmail.com.
Boboc Sabin
Feb 7, 2017, 8:00:23 AM2/7/17
to Confluent Platform
Hello everyone,
I am having the same issue. I would like to connect to a MS SqlServer and I've specified the table which I want,
table.whitelist=TableName, but I get the following error:
I am having the same issue. I would like to connect to a MS SqlServer and I've specified the table which I want,
table.whitelist=TableName, but I get the following error:
com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'TableName'.
On Friday, December 16, 2016 at 3:35:06 PM UTC+2, Dustin Cote wrote:
I'm not totally familiar with SQL server JDBC specifically, but StackOverflow would suggest you should be setting the default schema for the user connecting to the database:
On Fri, Dec 16, 2016 at 2:40 AM, akarshika lowe <akarsh...@gmail.com> wrote:
Hi,I am able to connect to the dbo schema, but when I am trying for some other schemas it is not working. I am not able to connect to tables of different schemas except that of dbo in sql server. Like, If i will try for address table in schema Person it is not connecting but if I try for a table in dbo schema it is connecting. So , Is there a way to connect to different shcemas. It is not hitting other schemas.
On Tue, Dec 13, 2016 at 10:33 PM, Dustin Cote <dus...@confluent.io> wrote:
This is the querier specified in the connector. The code for which is here. I'm curious if you can try running against a different table because maybe something is incorrect in the way you have specified the location of the table?
On Tue, Dec 13, 2016 at 4:48 AM, akarshika lowe <akarsh...@gmail.com> wrote:
Hi,What do you mean by TimestampIncrementingTableQuerier in sqlserver. I am getting this error though i have access to this table "Address".ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
On Tue, Dec 6, 2016 at 10:17 PM, Dustin Cote <dus...@confluent.io> wrote:
Is there a specific error message you are getting? Would you mind uploading the configuration for the connector? The port should be specified in the `connection.url` property for the connector as described in this example.I'm not sure if you'd need another driver based on the description, but if you are getting the wrong port, then likely it's to do with the `connection.url` setting.
On Tue, Dec 6, 2016 at 7:47 AM, akarshika lowe <akarsh...@gmail.com> wrote:
Hi,I am using kafka connect to load data from SQL SERVER. After giving the connection details when I am trying to build connection it is giving incorrect port number, though the details are correct. The driver I am using is sqljdbc42.jar. Is there any other driver also I need to add? Do I need to use striim?
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6a54b7d1-fadd-44ea-b3c8-c36a351f77b5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCnebzr7poEsc6ngSAx-nvf%2BgeBvdWYvCxJaXjhh8XeKWXVA%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcJrdU%3DqHWwnBeSTiz_4H%3DdZkAYzcS0wT3SKa5mU6CVjQ%40mail.gmail.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCnebzVteLWEFQUMPS%2B4rSQ1fOqYw9oHvkKifN%2BVR2N0VNSg%40mail.gmail.com.
--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcyrpQB3vDeXKt7KxhWN308wAYChunsaVx5%3DfwGE%3Di-pg%40mail.gmail.com.
akarshika lowe
Mar 7, 2017, 7:34:15 AM3/7/17
to confluent...@googlegroups.com, sanjeev pandey, Neha sareen
Hi,
I am trying to connect sqlserver using confluent. I am facing following issues:
1. When I am trying to connect to default schema i.e. dbo , connection is built but it is not able to fetch data into the consumer.
The connection details that I am using are:
name=test-sqlserver-jdbc-autoincrement
connector.class=io.confluent.connect.jdbc.JdbcSourceConnector
tasks.max=1
connection.url=jdbc:sqlserver://********:1433;database=AdventureWorks2012;user=****;password=****
mode=incrementing
incrementing.column.name=ErrorLogID
topic.prefix=test3-sqlserver-jdbc-
table.whitelist=ErrorLog
schema.registry=dbo
2. When I am trying to connect to any other schema, the producer is throwing error :
connection details that i am using are :
name=test-sqlserver-jdbc-autoincrement
connector.class=io.confluent.connect.jdbc.JdbcSourceConnector
tasks.max=1
connection.url=jdbc:sqlserver://********:1433;database=AdventureWorks2012;user=****;password=****
mode=incrementing
incrementing.column.name=AddressID
topic.prefix=test3-sqlserver-jdbc-
table.whitelist=Address
schema.registry=Person
Error :
INFO Source task WorkerSourceTask{id=test-sqlserver-jdbc-autoincrement-0} finished initialization and start (org.apache.kafka.connect.runtime.WorkerSourceTask:138)
[2017-03-07 17:55:47,041] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test3-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
[2017-03-07 17:55:52,124] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test3-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
[2017-03-07 17:55:53,684] INFO Reflections took 9299 ms to scan 262 urls, producing 12112 keys and 79402 values (org.reflections.Reflections:229)
[2017-03-07 17:55:57,181] ERROR Failed to run query for table TimestampIncrementingTableQuerier{name='Address', query='null', topicPrefix='test3-sqlserver-jdbc-', timestampColumn='null', incrementingColumn='AddressID'}: com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name 'Address'. (io.confluent.connect.jdbc.JdbcSourceTask:239)
Please, look into the issue.
Regards,
Akarshika Lowe
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcyrpQB3vDeXKt7KxhWN308wAYChunsaVx5%3DfwGE%3Di-pg%40mail.gmail.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCneaUTHW%2B_kParQfs0FmxLV3sUoP27zvDdnmw57QdANiM0g%40mail.gmail.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAPYKfHcyrpQB3vDeXKt7KxhWN308wAYChunsaVx5%3DfwGE%3Di-pg%40mail.gmail.com.
--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/niQUd4SYwCE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACOCneaUTHW%2B_kParQfs0FmxLV3sUoP27zvDdnmw57QdANiM0g%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages