Any thoughts on this error?

[Jeremiah Rounds]

Hello!

I have been trying to setup a new Hadoop/Rhipe installation on a
cluster. I have been operating on the assumption that my installation
was wrong. That assumption got me through a round of errors, and
finally I got things to the point where rhinit(TRUE,TRUE) ran without
error.

I tried to run your airplane download MapReduce example and I got
this:
--------------------------------------------------------------------------------------------------------------------------------------------------------
> j <- rhex(z,async=TRUE)

----------------------------------------
Running: /ln/cluster_node_image/hadoop/bin/hadoop jar /ln/
cluster_node_image/R/lib64/R/library/Rhipe/java/Rhipe.jar
org.godhuli.rhipe.RHMR /tmp/Rtmp1HjJAM/rhipe349bcb8e
----------------------------------------
11/10/20 15:50:00 WARN conf.Configuration:
mapred.used.genericoptionsparser is deprecated. Instead, use
mapreduce.client.genericoptionsparser.used
11/10/20 15:50:00 WARN conf.Configuration: mapred.compress.map.output
is deprecated. Instead, use mapreduce.map.output.compress
11/10/20 15:50:00 WARN conf.Configuration:
mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use
mapreduce.job.jvm.numtasks
11/10/20 15:50:00 WARN conf.Configuration: mapred.reduce.tasks is
deprecated. Instead, use mapreduce.job.reduces
11/10/20 15:50:00 WARN conf.Configuration: mapred.task.timeout is
deprecated. Instead, use mapreduce.task.timeout
/airline/data/
11/10/20 15:50:00 WARN conf.Configuration: mapred.task.id is
deprecated. Instead, use mapreduce.task.attempt.id
11/10/20 15:50:00 INFO mapreduce.JobSubmitter: Cleaning up the staging
area hdfs://spica:54310/ln/hadoop_local_data/hadoop.tmp.dir/mapred/staging/jrounds/.staging/job_201110201549_0001
Exception in thread "main" java.lang.IncompatibleClassChangeError:
Found interface org.apache.hadoop.mapreduce.JobContext, but class was
expected
at
org.godhuli.rhipe.LApplyInputFormat.getSplits(LApplyInputFormat.java:
84)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:
401)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:
418)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:
338)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:960)
at org.godhuli.rhipe.RHMR.submitAndMonitorJob(RHMR.java:295)
at org.godhuli.rhipe.RHMR.run(RHMR.java:135)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
at org.godhuli.rhipe.RHMR.fmain(RHMR.java:93)
at org.godhuli.rhipe.PersonalServer.rhex(PersonalServer.java:495)
at org.godhuli.rhipe.PersonalServer.startme(PersonalServer.java:555)
at org.godhuli.rhipe.PersonalServer.main(PersonalServer.java:593)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:
25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Error in if (sz < 0) { : argument is of length zero

---------------------------------------------------------------------------------------------------------------------------------------------------------------

I spent a few days coming at it from the perspective that there was
still something wrong with my install, and that is still a good bet.
Perhaps you recognize these error messages? In the meantime, I am
going to revert to an older version of Hadoop then the newest to get
rid of the depreciation warnings. Perhaps that will do something? We
shall see!

Any thoughts or hunches appreciated!

[Jeremiah Rounds]

Downgrading to Hadoop version 20.2 worked. Wouldn't take this as
gospel yet as my Hadoop cluster administration skills are definately
weak, but there could be a version change compatibility issue in our
future.

[Saptarshi Guha]

Hmm, what version did you try (the one that didn't work?)

[Jeremiah Rounds]

It was version 21.0

[Saptarshi Guha]

Yes, haven't coded for this version. Primarily because Cloudera hasn't
made it their default.
I want to match their version.

Regards
Saptarshi