part-r-00000 file is empty

165 views
Skip to first unread message

Ishit Vyas

unread,
Aug 10, 2017, 5:12:18 AM8/10/17
to HIPI Users
hadoop jar helloWorld1.jar sampleimages.hib sampleimgs2
17/08/10 13:12:52 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
17/08/10 13:12:53 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
17/08/10 13:12:53 INFO input.FileInputFormat: Total input paths to process : 1
Spawned 1map tasks
17/08/10 13:12:53 INFO mapreduce.JobSubmitter: number of splits:1
17/08/10 13:12:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1502343966424_0016
17/08/10 13:12:53 INFO impl.YarnClientImpl: Submitted application application_1502343966424_0016
17/08/10 13:12:53 INFO mapreduce.Job: The url to track the job: http://ishit-VirtualBox:8088/proxy/application_1502343966424_0016/
17/08/10 13:12:53 INFO mapreduce.Job: Running job: job_1502343966424_0016
17/08/10 13:12:58 INFO mapreduce.Job: Job job_1502343966424_0016 running in uber mode : false
17/08/10 13:12:58 INFO mapreduce.Job:  map 0% reduce 0%
17/08/10 13:13:02 INFO mapreduce.Job:  map 100% reduce 0%
17/08/10 13:13:06 INFO mapreduce.Job:  map 100% reduce 100%
17/08/10 13:13:06 INFO mapreduce.Job: Job job_1502343966424_0016 completed successfully
17/08/10 13:13:07 INFO mapreduce.Job: Counters: 49
    File System Counters
        FILE: Number of bytes read=6
        FILE: Number of bytes written=237785
        FILE: Number of read operations=0
        FILE: Number of large read operations=0
        FILE: Number of write operations=0
        HDFS: Number of bytes read=760999
        HDFS: Number of bytes written=0
        HDFS: Number of read operations=6
        HDFS: Number of large read operations=0
        HDFS: Number of write operations=2
    Job Counters
        Launched map tasks=1
        Launched reduce tasks=1
        Data-local map tasks=1
        Total time spent by all maps in occupied slots (ms)=1893
        Total time spent by all reduces in occupied slots (ms)=1428
        Total time spent by all map tasks (ms)=1893
        Total time spent by all reduce tasks (ms)=1428
        Total vcore-milliseconds taken by all map tasks=1893
        Total vcore-milliseconds taken by all reduce tasks=1428
        Total megabyte-milliseconds taken by all map tasks=1938432
        Total megabyte-milliseconds taken by all reduce tasks=1462272
    Map-Reduce Framework
        Map input records=4
        Map output records=0
        Map output bytes=0
        Map output materialized bytes=6
        Input split bytes=119
        Combine input records=0
        Combine output records=0
        Reduce input groups=0
        Reduce shuffle bytes=6
        Reduce input records=0
        Reduce output records=0
        Spilled Records=0
        Shuffled Maps =1
        Failed Shuffles=0
        Merged Map outputs=1
        GC time elapsed (ms)=88
        CPU time spent (ms)=1040
        Physical memory (bytes) snapshot=581476352
        Virtual memory (bytes) snapshot=12319563776
        Total committed heap usage (bytes)=541065216
    Shuffle Errors
        BAD_ID=0
        CONNECTION=0
        IO_ERROR=0
        WRONG_LENGTH=0
        WRONG_MAP=0
        WRONG_REDUCE=0
    File Input Format Counters
        Bytes Read=760880
    File Output Format Counters
        Bytes Written=0
hduser@ishit-VirtualBox:~/hipi/examples/helloWorld1/build/libs$ hadoop fs -cat sampleimgs2/part-r-00000

When I execute this, it gives no output and part-r-00000 file size is 0. I have implemented the program same as given in official website.
How to solve it?

Reply all
Reply to author
Forward
0 new messages