Groups
Groups
Sign in
Groups
Groups
rhipe
Conversations
About
Send feedback
Help
ERROR IN STREAMING JOB
10 views
Skip to first unread message
vinay
unread,
May 6, 2015, 11:25:33 AM
5/6/15
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to rh...@googlegroups.com
hi sir,
This is my program code and error message :
small.ints = to.dfs(1:10)
15/05/05 22:01:05 INFO util.NativeCodeLoader: Loaded the native-hadoop library
15/05/05 22:01:05 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
15/05/05 22:01:05 INFO compress.CodecPool: Got brand-new compressor
> mapreduce(
+ input = small.ints,
+ map = function(k, v)
+ {
+ lapply(seq_along(v), function(r){
+ x <- runif(v[[r]])
+ keyval(r,c(max),min(x))
+ })
+ })
packageJobJar: [/app/hadoop/tmp/hadoop-unjar6376116358821475638/] [] /tmp/streamjob2302049389214578652.jar tmpDir=null
15/05/05 22:01:22 INFO mapred.FileInputFormat: Total input paths to process : 1
15/05/05 22:01:22 INFO streaming.StreamJob: getLocalDirs(): [/app/hadoop/tmp/mapred/local]
15/05/05 22:01:22 INFO streaming.StreamJob: Running job: job_201505051844_0004
15/05/05 22:01:22 INFO streaming.StreamJob: To kill this job, run:
15/05/05 22:01:22 INFO streaming.StreamJob: /usr/local/hadoop/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:54311 -kill job_201505051844_0004
15/05/05 22:01:22 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201505051844_0004
15/05/05 22:01:23 INFO streaming.StreamJob: map 0% reduce 0%
15/05/05 22:03:30 INFO streaming.StreamJob: map 100% reduce 100%
15/05/05 22:03:30 INFO streaming.StreamJob: To kill this job, run:
15/05/05 22:03:30 INFO streaming.StreamJob: /usr/local/hadoop/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:54311 -kill job_201505051844_0004
15/05/05 22:03:30 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201505051844_0004
15/05/05 22:03:30 ERROR streaming.StreamJob: Job not successful. Error: # of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201505051844_0004_m_000000
15/05/05 22:03:30 INFO streaming.StreamJob: killJob...
Streaming Command Failed!
Error in mr(map = map, reduce = reduce, combine = combine, vectorized.reduce, :
hadoop streaming failed with error code 1
Also i'm attaching log file.
please someone help me to solve out. I'm running out with time, at least tell me possible solution
error.txt
Reply all
Reply to author
Forward
0 new messages