Hive druid integration error.

62 views
Skip to first unread message

prashant kumar

unread,
Dec 13, 2017, 8:13:07 AM12/13/17
to Druid Development

The error I am facing is:-

     Number of reduce tasks not specified. Estimated from input data size: 1
     In order to change the average load for a reducer (in bytes):
     set hive.exec.reducers.bytes.per.reducer=<number>
     In order to limit the maximum number of reducers:
     set hive.exec.reducers.max=<number>
     In order to set a constant number of reducers:
     set mapreduce.job.reduces=<number>
     java.io.FileNotFoundException: File does not exist: 
     /usr/lib/hive/lib/hive-druid-handler-2.3.0.jar
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1530)
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1523)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1


The error saying is unable to find "/usr/lib/hive/lib/hive-druid-handler-2.3.0.jar" Although I am using hive hive-2.3.2.
In order to overcome the above problem have downloaded jar and restarted Hadoop. But it is not solved yet. 


Pawan Goyal

unread,
Apr 10, 2018, 7:18:45 AM4/10/18
to Druid Development
use below command to add the jar to the classpath.

hive --auxpath /usr/local/Cellar/hive/2.3.1/libexec/lib/hive-druid-handler-2.3.1.jar,/usr/local/Cellar/hive/2.3.1/libexec/lib/RoaringBitmap-0.5.18.jar

Reply all
Reply to author
Forward
0 new messages