Exception in thread "WorkerSinkTask-topic6-hive2-0" java.lang.NullPointerException

[Srinivas Kandula]

Unable to import an SQL table which has null values into hive using confluent . Throwing error as below.

Config Using Bulk Import option 

ERROR Thread WorkerSinkTask-topic6-hive2-0 exiting with uncaught exception:  (org.apache.kafka.connect.util.ShutdownableThread:84)

java.lang.NullPointerException

        at io.confluent.connect.avro.AvroData.toConnectData(AvroData.java:863)

        at io.confluent.connect.avro.AvroData.toConnectData(AvroData.java:946)

        at io.confluent.connect.avro.AvroData.toConnectData(AvroData.java:751)

        at io.confluent.connect.avro.AvroConverter.toConnectData(AvroConverter.java:103)

        at org.apache.kafka.connect.runtime.WorkerSinkTask.convertMessages(WorkerSinkTask.java:266)

        at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:175)

        at org.apache.kafka.connect.runtime.WorkerSinkTaskThread.iteration(WorkerSinkTaskThread.java:90)

        at org.apache.kafka.connect.runtime.WorkerSinkTaskThread.execute(WorkerSinkTaskThread.java:58)

        at org.apache.kafka.connect.util.ShutdownableThread.run(ShutdownableThread.java:82)

Exception in thread "WorkerSinkTask-topic6-hive2-0" java.lang.NullPointerException

        at io.confluent.connect.avro.AvroData.toConnectData(AvroData.java:863)

        at io.confluent.connect.avro.AvroData.toConnectData(AvroData.java:946)

        at io.confluent.connect.avro.AvroData.toConnectData(AvroData.java:751)

        at io.confluent.connect.avro.AvroConverter.toConnectData(AvroConverter.java:103)

        at org.apache.kafka.connect.runtime.WorkerSinkTask.convertMessages(WorkerSinkTask.java:266)

        at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:175)

        at org.apache.kafka.connect.runtime.WorkerSinkTaskThread.iteration(WorkerSinkTaskThread.java:90)

        at org.apache.kafka.connect.runtime.WorkerSinkTaskThread.execute(WorkerSinkTaskThread.java:58)

        at org.apache.kafka.connect.util.ShutdownableThread.run(ShutdownableThread.java:82)

[Ewen Cheslack-Postava]

I think you're running into the bug that this PR fixed: https://github.com/confluentinc/schema-registry/pull/280

-Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3af4ddaf-8dec-41c3-ab90-fbc8256e9063%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Srinivas Kandula]

Thank you Ewen, 

From the post I can make out that patch has been deployed 7 days ago. So, Do we need to download the latest version and try with JDBC and HDFS connectors ?

Also, can you let us know the latest version of the software where patch is being applied .

[Ewen Cheslack-Postava]

Srinivas,

There's not an updated version of the packages yet. If you wanted to get the fix faster, you could grab the source code and build a version from master -- it should work fine with the existing release.

-Ewen

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/f44f7f87-553b-4487-943b-62bb2ea83b94%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Venkatesh Rudraraju]

Hi,

I hit this problem as well, where my avro schema has 'null' options and when the Avro data object contains 'null' values, I see the above mentioned exception. 

I built the schema registry from master and still its the same issue.

- Do I need to build other services from master too ? 

- What is the schedule for next release candidate ?

Thanks,

Venkatesh

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/f44f7f87-553b-4487-943b-62bb2ea83b94%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

[Ewen Cheslack-Postava]

Venkatesh,

And you replaced the jars for the AvroConverter, i.e. kafka-connect-avro-converter-*.jar, with the ones built from master and still see the issue after restarting connect? I was a bit brief with the explanation, but the bug was with the AvroConverter. The code for that just happens to live in the schema-registry repository (along with the Avro serializers).

-Ewen

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/f44f7f87-553b-4487-943b-62bb2ea83b94%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen

--

You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/fa20abbd-599a-4196-b6de-3d5b3e631ec1%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen