"Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found"

[Manling Li]

hi,

I am configuring Druid to ingest data from MapR-FS, by referring to the solution provided by https://groups.google.com/forum/#!msg/druid-user/yrWOnfI3FWc/fLuVWzuuBQAJ, I run into an error as follows,  does anybody know which jar files conflict? 

   

2018-11-14T18:16:43,903 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient - Task Id : attempt_201811070801_3156_m_000000_0, Status : FAILED on node cdc-hpcblx007-08
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2208)
	at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:195)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:662)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:352)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:278)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:421)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
	at org.apache.hadoop.mapred.Child.main(Child.java:267)
Caused by: java.lang.ClassNotFoundException: Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2114)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2206)
	... 8 more

2018-11-14T18:16:57,070 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient - Task Id : attempt_201811070801_3156_m_000000_1, Status : FAILED on node cdc-hpcblx016-08
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2208)
	at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:195)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:662)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:352)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:278)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:421)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
	at org.apache.hadoop.mapred.Child.main(Child.java:267)
Caused by: java.lang.ClassNotFoundException: Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2114)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2206)
	... 8 more

2018-11-14T18:17:12,162 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient - Task Id : attempt_201811070801_3156_m_000000_2, Status : FAILED on node cdc-hpcblx016-09
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2208)
	at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:195)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:662)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:352)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:278)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:421)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
	at org.apache.hadoop.mapred.Child.main(Child.java:267)
Caused by: java.lang.ClassNotFoundException: Class io.druid.indexer.DetermineHashedPartitionsJob$DetermineCardinalityMapper not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2114)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2206)
	... 8 more

2018-11-14T18:17:28,320 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient - Job job_201811070801_3156 failed with state FAILED due to: NA
2018-11-14T18:17:28,367 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient - Counters: 7
2018-11-14T18:17:28,369 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -   Job Counters 
2018-11-14T18:17:28,370 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Failed map tasks=1
2018-11-14T18:17:28,370 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Launched map tasks=4
2018-11-14T18:17:28,370 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Rack-local map tasks=4
2018-11-14T18:17:28,370 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Total time spent by all maps in occupied slots (ms)=37691
2018-11-14T18:17:28,370 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Total time spent by all reduces in occupied slots (ms)=0
2018-11-14T18:17:28,371 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Total time spent by all maps waiting after reserving slots (ms)=0
2018-11-14T18:17:28,371 INFO [task-runner-0-priority-0] org.apache.hadoop.mapred.JobClient -     Total time spent by all reduces waiting after reserving slots (ms)=0
2018-11-14T18:17:28,372 ERROR [task-runner-0-priority-0] io.druid.indexer.DetermineHashedPartitionsJob - Job failed: job_201811070801_3156
2018-11-14T18:17:28,373 ERROR [task-runner-0-priority-0] io.druid.indexing.common.task.HadoopIndexTask - Got invocation target exception in run(), cause: 
java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(II)[Lorg/apache/hadoop/mapreduce/TaskCompletionEvent;
	at io.druid.indexer.Utils.getFailureMessage(Utils.java:136) ~[druid-indexing-hadoop-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexer.DetermineHashedPartitionsJob.run(DetermineHashedPartitionsJob.java:128) ~[druid-indexing-hadoop-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexer.JobHelper.runSingleJob(JobHelper.java:368) ~[druid-indexing-hadoop-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexer.HadoopDruidDetermineConfigurationJob.run(HadoopDruidDetermineConfigurationJob.java:58) ~[druid-indexing-hadoop-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexing.common.task.HadoopIndexTask$HadoopDetermineConfigInnerProcessingRunner.runTask(HadoopIndexTask.java:558) ~[druid-indexing-service-0.12.3-iap7.jar:0.12.3-iap7]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_151]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_151]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_151]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_151]
	at io.druid.indexing.common.task.HadoopIndexTask.runInternal(HadoopIndexTask.java:295) ~[druid-indexing-service-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:232) [druid-indexing-service-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:457) [druid-indexing-service-0.12.3-iap7.jar:0.12.3-iap7]
	at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:429) [druid-indexing-service-0.12.3-iap7.jar:0.12.3-iap7]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_151]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_151]
2018-11-14T18:17:28,387 INFO [task-runner-0-priority-0] io.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Unregistering chat handler[index_hadoop_testcsv_maprfs_hadoop_2018-11-14T18:15:59.861Z]
2018-11-14T18:17:28,387 INFO [task-runner-0-priority-0] io.druid.indexing.overlord.TaskRunnerUtils - Task [index_hadoop_testcsv_maprfs_hadoop_2018-11-14T18:15:59.861Z] status changed to [FAILED].
2018-11-14T18:17:28,389 INFO [task-runner-0-priority-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
  "id" : "index_hadoop_testcsv_maprfs_hadoop_2018-11-14T18:15:59.861Z",
  "status" : "FAILED",
  "duration" : 83078,
  "errorMsg" : "java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(II)[Lorg/apache..." 

} 

The relate ingest spec is as follows:

    "tuningConfig" : {

      "type" : "hadoop",

      "partitionsSpec" : {

        "type" : "hashed",

        "targetPartitionSize" : 5000000

      },

        "forceExtendableShardSpecs" : true,

             

       "jobProperties" : {

        "mapreduce.job.user.classpath.first":true,

        "mapreduce.job.classloader": true,

        "mapreduce.task.classpath.user.precedence" : "true", 

        "mapred.map.child.java.opts" : "-Duser.timezone=UTC",

        "mapred.reduce.child.java.opts" : "-Duser.timezone=UTC"

        }

  } 

},  

     "hadoopDependencyCoordinates":["org.apache.hadoop:hadoop-client:2.7.3"],