ERROR IN STREAMING JOB

10 views
Skip to first unread message

vinay

unread,
May 6, 2015, 11:25:33 AM5/6/15
to rh...@googlegroups.com
hi sir,

This is my program code and error message :

small.ints = to.dfs(1:10)
15/05/05 22:01:05 INFO util.NativeCodeLoader: Loaded the native-hadoop library
15/05/05 22:01:05 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
15/05/05 22:01:05 INFO compress.CodecPool: Got brand-new compressor
> mapreduce(
+ input = small.ints,
+ map = function(k, v)
+ {
+ lapply(seq_along(v), function(r){
+ x <- runif(v[[r]])
+ keyval(r,c(max),min(x))
+ })
+ })
packageJobJar: [/app/hadoop/tmp/hadoop-unjar6376116358821475638/] [] /tmp/streamjob2302049389214578652.jar tmpDir=null
15/05/05 22:01:22 INFO mapred.FileInputFormat: Total input paths to process : 1
15/05/05 22:01:22 INFO streaming.StreamJob: getLocalDirs(): [/app/hadoop/tmp/mapred/local]
15/05/05 22:01:22 INFO streaming.StreamJob: Running job: job_201505051844_0004
15/05/05 22:01:22 INFO streaming.StreamJob: To kill this job, run:
15/05/05 22:01:22 INFO streaming.StreamJob: /usr/local/hadoop/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:54311 -kill job_201505051844_0004
15/05/05 22:01:22 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201505051844_0004
15/05/05 22:01:23 INFO streaming.StreamJob: map 0% reduce 0%
15/05/05 22:03:30 INFO streaming.StreamJob: map 100% reduce 100%
15/05/05 22:03:30 INFO streaming.StreamJob: To kill this job, run:
15/05/05 22:03:30 INFO streaming.StreamJob: /usr/local/hadoop/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:54311 -kill job_201505051844_0004
15/05/05 22:03:30 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201505051844_0004
15/05/05 22:03:30 ERROR streaming.StreamJob: Job not successful. Error: # of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201505051844_0004_m_000000
15/05/05 22:03:30 INFO streaming.StreamJob: killJob...
Streaming Command Failed!
Error in mr(map = map, reduce = reduce, combine = combine, vectorized.reduce, :
hadoop streaming failed with error code 1

Also i'm attaching log file. please someone help me to solve out. I'm running out with time, at least tell me possible solution
error.txt
Reply all
Reply to author
Forward
0 new messages