Kafka indexing service task failing

42 views
Skip to first unread message

SAURABH JAIN

unread,
Sep 13, 2016, 11:02:48 AM9/13/16
to Druid User
Hey ,

I am getting the following error while running kafka indexing task. Don't know where the issue is. Even there are no OOM exception on any node.

2016-09-13T14:54:26,746 ERROR [task-runner-0-priority-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[KafkaIndexTask{id=index_kafka_prism-data-1_6527924d30d09d3_coghdpjo, type=index_kafka, dataSource=prism-data-1}]
java.lang.NullPointerException
	at java.nio.ByteBuffer.wrap(ByteBuffer.java:396) ~[?:1.8.0_101]
	at io.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:412) ~[?:?]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.9.1.2-SNAPSHOT.jar:0.9.1.2-SNAPSHOT]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.9.1.2-SNAPSHOT.jar:0.9.1.2-SNAPSHOT]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_101]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_101]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_101]
	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101]

Any suggestion what we are doing wrong and what is causing this issue.

Thanks,
Saurabh

Gian Merlino

unread,
Sep 13, 2016, 12:41:40 PM9/13/16
to druid...@googlegroups.com
Hey Saurabh,

I believe this would occur if you have a message with a null value. I raised this PR to fix that: https://github.com/druid-io/druid/pull/3453

In the meantime hopefully you can work around this by avoiding null values in your topic.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+unsubscribe@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/3599a273-e792-420c-a78a-c796ac39c488%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
Message has been deleted
0 new messages