Batch Ingestion no longer working - No buckets??

412 views
Skip to first unread message

Marco Boelling

unread,
Apr 19, 2016, 4:14:23 AM4/19/16
to Druid User
Hey everyone. 

I've just moved my WORKING! druid project from my development machines to a production cluster. 
Ever since, my hadoop index job is no longer working. The errors I am getting are:


io.druid.cli.CliHadoopIndexer - failure!!!!

java.lang.reflect.InvocationTargetException

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.7.0_79]

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[?:1.7.0_79]

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.7.0_79]

at java.lang.reflect.Method.invoke(Method.java:606) ~[?:1.7.0_79]

at io.druid.cli.CliHadoopIndexer.run(CliHadoopIndexer.java:120) [druid-services-0.8.3.jar:0.8.3]

at io.druid.cli.Main.main(Main.java:99) [druid-services-0.8.3.jar:0.8.3]

Caused by: java.lang.RuntimeException: java.lang.RuntimeException: No buckets?? seems there is no data to index.

at io.druid.indexer.IndexGeneratorJob.run(IndexGeneratorJob.java:211) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:321) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:321) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:132) ~[druid-services-0.8.3.jar:0.8.3]

at io.druid.cli.Main.main(Main.java:99) ~[druid-services-0.8.3.jar:0.8.3]

... 6 more

Caused by: java.lang.RuntimeException: No buckets?? seems there is no data to index.

at io.druid.indexer.IndexGeneratorJob.run(IndexGeneratorJob.java:160) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:321) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:96) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.indexer.JobHelper.runJobs(JobHelper.java:321) ~[druid-indexing-hadoop-0.8.3.jar:0.8.3]

at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:132) ~[druid-services-0.8.3.jar:0.8.3]

at io.druid.cli.Main.main(Main.java:99) ~[druid-services-0.8.3.jar:0.8.3]

... 6 more



I am working with the same data and the same ingestion spec. The only thing different ist the hadoop version (2.6.2 instead of 2.6.1)


Can anyone help me?

Gian Merlino

unread,
Apr 19, 2016, 5:05:53 AM4/19/16
to druid...@googlegroups.com
Hey Marco,

This can mean that your job couldn't find any input files, or it couldn't find any rows in those files that matched your job's "intervals".

Try double-checking that your input files are present on the configured filesystem, and that there are actually rows matching your "intervals". Also try double-checking that the timestamps are being interpreted the same way on the server vs. on your local machine – differing time zones can be a culprit here.

Gian

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To post to this group, send email to druid...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/c4f8f02a-8220-40d3-bc15-d908240ee1c1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages