Re: [rhipe] RHipe with CDH4.0 giving error of incompatible Class change
275 views
Skip to first unread message
Saptarshi Guha
Oct 9, 2012, 5:40:38 PM10/9/12
to rh...@googlegroups.com
Makes me think you dont have R on the nodes:
Cannot run program
"/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
java.io.IOException: error=2, No such file or directory
On Tue, Oct 9, 2012 at 5:02 AM, Sanjay Bagal <sbba...@gmail.com> wrote:
> Hi All ,
> I am using Rhipe 0.69 with CDH4.0 and i getting the problem.
> Here is my sample code and Error
>
> Sample Code: ‘Rhipe’
>
> library(Rhipe)
>
> Sys.setenv(HADOOP_HOME="/hadoop/mr-runtime")
>
> Sys.setenv(HADOOP_BIN="/hadoop/mr-runtime/bin")
>
>
> rhinit()
>
> m.ex1.1 <- expression({
>
> lapply(seq_along(map.values), function(r) {
>
> v <- map.values[[r]]
>
> k <- map.keys[[r]]
>
> rhcollect(k, mean(v$Petal.Length))
>
> })
>
> })
>
>
> z <- rhmr(map=m.ex1.1,
>
> ifolder="/user/hduser/bySpecies/*",
>
> ofolder="/user/hduser/sandhya/output",
>
> inout=c("sequence", "sequence"),
>
> mapred=list(mapred.reduce.tasks=1)
>
> )
>
> test<-rhex(z, async=FALSE)
>
>
> Error: ‘Rhipe’
>
> ----------------------------------------
>
> Running: /hadoop/mr-runtime/bin/hadoop jar
> /home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/java/Rhipe.jar
> org.godhuli.rhipe.RHMR /tmp/RtmpHPMcwi/rhipe65d2ee61a18
>
> ----------------------------------------
>
> 12/10/05 15:18:12 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
>
> 12/10/05 15:18:13 INFO input.FileInputFormat: Total input paths to process :
> 1
>
> 12/10/05 15:18:13 INFO rhipe.RHMR: Tracking URL ---->
> http://din55002903:50030/jobdetails.jsp?jobid=job_201210041557_0019
>
> 12/10/05 15:18:13 INFO mapred.JobClient: Running job: job_201210041557_0019
>
> 12/10/05 15:18:14 INFO mapred.JobClient: map 0% reduce 0%
>
> 12/10/05 15:18:37 INFO mapred.JobClient: Task Id :
> attempt_201210041557_0019_m_000000_0, Status : FAILED
>
> java.lang.RuntimeException: configuration exception
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:173)
>
> at org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> at org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:416)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: java.io.IOException: Cannot run program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> ... 9 more
>
> Caused by: java.io.IOException: java.
>
> attempt_201210041557_0019_m_000000_0: java.io.IOException: Cannot run
> program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> attempt_201210041557_0019_m_000000_0: at
> org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> attempt_201210041557_0019_m_000000_0: at
> org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> attempt_201210041557_0019_m_000000_0: at
> org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> attempt_201210041557_0019_m_000000_0: at
> java.security.AccessController.doPrivileged(Native Method)
>
> attempt_201210041557_0019_m_000000_0: at
> javax.security.auth.Subject.doAs(Subject.java:416)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> attempt_201210041557_0019_m_000000_0: Caused by: java.io.IOException:
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.UNIXProcess.<init>(UNIXProcess.java:164)
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.ProcessImpl.start(ProcessImpl.java:81)
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:468)
>
> attempt_201210041557_0019_m_000000_0: ... 10 more
>
> 12/10/05 15:18:43 INFO mapred.JobClient: Task Id :
> attempt_201210041557_0019_m_000000_1, Status : FAILED
>
> java.lang.RuntimeException: configuration exception
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:173)
>
> at org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> at org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:416)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: java.io.IOException: Cannot run program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> ... 9 more
>
> Caused by: java.io.IOException: java.
>
> attempt_201210041557_0019_m_000000_1: WARNING:
> org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use
> org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
> files.
>
> attempt_201210041557_0019_m_000000_1: java.io.IOException: Cannot run
> program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> attempt_201210041557_0019_m_000000_1: at
> org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> attempt_201210041557_0019_m_000000_1: at
> org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> attempt_201210041557_0019_m_000000_1: at
> org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> attempt_201210041557_0019_m_000000_1: at
> java.security.AccessController.doPrivileged(Native Method)
>
> attempt_201210041557_0019_m_000000_1: at
> javax.security.auth.Subject.doAs(Subject.java:416)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> attempt_201210041557_0019_m_000000_1: Caused by: java.io.IOException:
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.UNIXProcess.<init>(UNIXProcess.java:164)
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.ProcessImpl.start(ProcessImpl.java:81)
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:468)
>
> attempt_201210041557_0019_m_000000_1: ... 10 more
>
> 12/10/05 15:18:50 INFO mapred.JobClient: Task Id :
> attempt_201210041557_0019_m_000000_2, Status : FAILED
>
> java.io.IOException: MROutput/MRErrThread
> failed:java.lang.IncompatibleClassChangeError: Found interface
> org.apache.hadoop.mapreduce.TaskInputOutputContext, but class was expected
>
> at org.godhuli.rhipe.RHMRHelper$MROutputThread.run(RHMRHelper.java:334)
>
>
> at
> org.godhuli.rhipe.RHMRHelper.checkOuterrThreadsThrowable(RHMRHelper.java:236)
>
> at org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:67)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:416)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Job complete: job_201210041557_0019
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Counters: 7
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Job Counters
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Failed map tasks=1
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Launched map tasks=4
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Data-local map tasks=4
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all maps in
> occupied slots (ms)=35607
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all reduces in
> occupied slots (ms)=0
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all maps
> waiting after reserving slots (ms)=0
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all reduces
> waiting after reserving slots (ms)=0
>
> result:256
>
> Error in readBin(f1, "raw", f2) : invalid 'n' argument
>
>
>
> Thanks,
> Sanjay
>
Cannot run program
"/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
java.io.IOException: error=2, No such file or directory
On Tue, Oct 9, 2012 at 5:02 AM, Sanjay Bagal <sbba...@gmail.com> wrote:
> Hi All ,
> I am using Rhipe 0.69 with CDH4.0 and i getting the problem.
> Here is my sample code and Error
>
> Sample Code: ‘Rhipe’
>
> library(Rhipe)
>
> Sys.setenv(HADOOP_HOME="/hadoop/mr-runtime")
>
> Sys.setenv(HADOOP_BIN="/hadoop/mr-runtime/bin")
>
>
> rhinit()
>
> m.ex1.1 <- expression({
>
> lapply(seq_along(map.values), function(r) {
>
> v <- map.values[[r]]
>
> k <- map.keys[[r]]
>
> rhcollect(k, mean(v$Petal.Length))
>
> })
>
> })
>
>
> z <- rhmr(map=m.ex1.1,
>
> ifolder="/user/hduser/bySpecies/*",
>
> ofolder="/user/hduser/sandhya/output",
>
> inout=c("sequence", "sequence"),
>
> mapred=list(mapred.reduce.tasks=1)
>
> )
>
> test<-rhex(z, async=FALSE)
>
>
> Error: ‘Rhipe’
>
> ----------------------------------------
>
> Running: /hadoop/mr-runtime/bin/hadoop jar
> /home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/java/Rhipe.jar
> org.godhuli.rhipe.RHMR /tmp/RtmpHPMcwi/rhipe65d2ee61a18
>
> ----------------------------------------
>
> 12/10/05 15:18:12 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
>
> 12/10/05 15:18:13 INFO input.FileInputFormat: Total input paths to process :
> 1
>
> 12/10/05 15:18:13 INFO rhipe.RHMR: Tracking URL ---->
> http://din55002903:50030/jobdetails.jsp?jobid=job_201210041557_0019
>
> 12/10/05 15:18:13 INFO mapred.JobClient: Running job: job_201210041557_0019
>
> 12/10/05 15:18:14 INFO mapred.JobClient: map 0% reduce 0%
>
> 12/10/05 15:18:37 INFO mapred.JobClient: Task Id :
> attempt_201210041557_0019_m_000000_0, Status : FAILED
>
> java.lang.RuntimeException: configuration exception
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:173)
>
> at org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> at org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:416)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: java.io.IOException: Cannot run program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> ... 9 more
>
> Caused by: java.io.IOException: java.
>
> attempt_201210041557_0019_m_000000_0: java.io.IOException: Cannot run
> program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> attempt_201210041557_0019_m_000000_0: at
> org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> attempt_201210041557_0019_m_000000_0: at
> org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> attempt_201210041557_0019_m_000000_0: at
> org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> attempt_201210041557_0019_m_000000_0: at
> java.security.AccessController.doPrivileged(Native Method)
>
> attempt_201210041557_0019_m_000000_0: at
> javax.security.auth.Subject.doAs(Subject.java:416)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> attempt_201210041557_0019_m_000000_0: at
> org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> attempt_201210041557_0019_m_000000_0: Caused by: java.io.IOException:
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.UNIXProcess.<init>(UNIXProcess.java:164)
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.ProcessImpl.start(ProcessImpl.java:81)
>
> attempt_201210041557_0019_m_000000_0: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:468)
>
> attempt_201210041557_0019_m_000000_0: ... 10 more
>
> 12/10/05 15:18:43 INFO mapred.JobClient: Task Id :
> attempt_201210041557_0019_m_000000_1, Status : FAILED
>
> java.lang.RuntimeException: configuration exception
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:173)
>
> at org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> at org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:416)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: java.io.IOException: Cannot run program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> at org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> ... 9 more
>
> Caused by: java.io.IOException: java.
>
> attempt_201210041557_0019_m_000000_1: WARNING:
> org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use
> org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
> files.
>
> attempt_201210041557_0019_m_000000_1: java.io.IOException: Cannot run
> program
> "/home/hduser/R/i686-pc-linux-gnu-library/2.14/Rhipe/libs/imperious.so":
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
>
> attempt_201210041557_0019_m_000000_1: at
> org.godhuli.rhipe.RHMRHelper.setup(RHMRHelper.java:158)
>
> attempt_201210041557_0019_m_000000_1: at
> org.godhuli.rhipe.RHMRMapper.setup(RHMRMapper.java:84)
>
> attempt_201210041557_0019_m_000000_1: at
> org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:52)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> attempt_201210041557_0019_m_000000_1: at
> java.security.AccessController.doPrivileged(Native Method)
>
> attempt_201210041557_0019_m_000000_1: at
> javax.security.auth.Subject.doAs(Subject.java:416)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> attempt_201210041557_0019_m_000000_1: at
> org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> attempt_201210041557_0019_m_000000_1: Caused by: java.io.IOException:
> java.io.IOException: error=2, No such file or directory
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.UNIXProcess.<init>(UNIXProcess.java:164)
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.ProcessImpl.start(ProcessImpl.java:81)
>
> attempt_201210041557_0019_m_000000_1: at
> java.lang.ProcessBuilder.start(ProcessBuilder.java:468)
>
> attempt_201210041557_0019_m_000000_1: ... 10 more
>
> 12/10/05 15:18:50 INFO mapred.JobClient: Task Id :
> attempt_201210041557_0019_m_000000_2, Status : FAILED
>
> java.io.IOException: MROutput/MRErrThread
> failed:java.lang.IncompatibleClassChangeError: Found interface
> org.apache.hadoop.mapreduce.TaskInputOutputContext, but class was expected
>
> at org.godhuli.rhipe.RHMRHelper$MROutputThread.run(RHMRHelper.java:334)
>
>
> at
> org.godhuli.rhipe.RHMRHelper.checkOuterrThreadsThrowable(RHMRHelper.java:236)
>
> at org.godhuli.rhipe.RHMRMapper.run(RHMRMapper.java:67)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:645)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:416)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Job complete: job_201210041557_0019
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Counters: 7
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Job Counters
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Failed map tasks=1
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Launched map tasks=4
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Data-local map tasks=4
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all maps in
> occupied slots (ms)=35607
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all reduces in
> occupied slots (ms)=0
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all maps
> waiting after reserving slots (ms)=0
>
> 12/10/05 15:18:58 INFO mapred.JobClient: Total time spent by all reduces
> waiting after reserving slots (ms)=0
>
> result:256
>
> Error in readBin(f1, "raw", f2) : invalid 'n' argument
>
>
>
> Thanks,
> Sanjay
>
Kamlesh Kshirsagar
Dec 18, 2013, 11:15:13 AM12/18/13
to rh...@googlegroups.com, saptars...@gmail.com
Hello,
I am using Cloudera single node VMware to install rhipe on it.
I am installed rhipe already when i try the command rhinit().
I get following error message.
13/12/18 07:49:06 ERROR security.UserGroupInformation: Unable to find JAAS classes:com.sun.security.auth.UnixPrincipal not found in gnu.gcj.runtime.SystemClassLoader{urls=[file:/home/cloudera/R/x86_64-redhat-linux-gnu-library/3.0/rJava/java/boot/], parent=gnu.gcj.runtime.ExtensionClassLoader{urls=[], parent=null}}
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/client-0.20/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/client-0.20/slf4j-log4j12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/client/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/client/slf4j-log4j12.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
13/12/18 07:49:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
java.io.IOException: failure to login
at java.lang.Throwable.<init>(libgcj.so.10)
at java.lang.Throwable.<init>(libgcj.so.10)
at java.lang.Exception.<init>(libgcj.so.10)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:694)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:573)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2464)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2456)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2323)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:351)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:163)
at org.godhuli.rhipe.PersonalServer.run(PersonalServer.java:321)
at java.lang.reflect.Method.invoke(libgcj.so.10)
at RJavaTools.invokeMethod(RJavaTools.java:386)
Caused by: javax.security.auth.login.LoginException: could not load module com.sun.security.auth.module.UnixLoginModule
at javax.security.auth.login.LoginContext.lookupModule(libgcj.so.10)
at javax.security.auth.login.LoginContext.<init>(libgcj.so.10)
at org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:527)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:672)
...9 more
Caused by: java.lang.ClassNotFoundException
at RJavaClassLoader.findClass(RJavaClassLoader.java:383)
at java.lang.ClassLoader.loadClass(libgcj.so.10)
at java.lang.ClassLoader.loadClass(libgcj.so.10)
at java.lang.Class.forName(libgcj.so.10)
at javax.security.auth.login.LoginContext.lookupModule(libgcj.so.10)
...12 more
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl, :
java.lang.NullPointerException
when i run
rhoptions()$runner
[1] "R CMD /usr/lib64/R/library/Rhipe/bin/RhipeMapReduce --slave --silent --vanilla"
inspite of setting the path for rhoptions still the error doesnt go.
Please could you help me with this.
Regards,
Kamlesh
Reply all
Reply to author
Forward
0 new messages