[Hadoop-studio-users] Waiting to find target node: 10.0.3.100:50010

[Shuja Rehman]

Hi All
I have write a map reduce program which runs fine locally but when i try to run on cluster using karmasphere studio, it gives me following exception.

10/07/29 22:23:45 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively
10/07/29 22:24:04 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
10/07/29 22:24:28 INFO hdfs.DFSClient: Exception in createBlockOutputStream java.net.ConnectException: Connection timed out
10/07/29 22:24:28 INFO hdfs.DFSClient: Abandoning block blk_-1705756597124132029_13219
10/07/29 22:24:29 INFO hdfs.DFSClient: Waiting to find target node: 10.0.3.100:50010
10/07/29 22:24:56 INFO hdfs.DFSClient: Exception in createBlockOutputStream java.net.ConnectException: Connection timed out
10/07/29 22:24:56 INFO hdfs.DFSClient: Abandoning block blk_1907340228342902708_13219
10/07/29 22:24:57 INFO hdfs.DFSClient: Waiting to find target node: 10.0.3.100:50010
10/07/29 22:25:24 INFO hdfs.DFSClient: Exception in createBlockOutputStream java.net.ConnectException: Connection timed out
10/07/29 22:25:24 INFO hdfs.DFSClient: Abandoning block blk_-3206366551708537272_13219
10/07/29 22:25:25 INFO hdfs.DFSClient: Waiting to find target node: 10.0.3.100:50010
10/07/29 22:25:53 INFO hdfs.DFSClient: Exception in createBlockOutputStream java.net.ConnectException: Connection timed out
10/07/29 22:25:53 INFO hdfs.DFSClient: Abandoning block blk_7206737195034796208_13219
10/07/29 22:25:53 INFO hdfs.DFSClient: Waiting to find target node: 10.0.3.100:50010
10/07/29 22:25:59 WARN hdfs.DFSClient: DataStreamer Exception: java.io.IOException: Unable to create new block.
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2845)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288)

10/07/29 22:25:59 WARN hdfs.DFSClient: Error Recovery for block blk_7206737195034796208_13219 bad datanode[0] nodes == null
10/07/29 22:25:59 WARN hdfs.DFSClient: Could not get block locations. Source file "/var/lib/hadoop-0.20/cache/hadoop/mapred/system/job_201007121353_0015/job.jar" - Aborting...
Jul 29, 2010 10:25:59 PM ParserDriver main
SEVERE: null
java.net.ConnectException: Connection timed out
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:2870)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2826)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288)
10/07/29 22:25:59 ERROR hdfs.DFSClient: Exception closing file /var/lib/hadoop-0.20/cache/hadoop/mapred/system/job_201007121353_0015/job.jar : java.net.ConnectException: Connection timed out
java.net.ConnectException: Connection timed out
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:2870)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2826)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2102)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2288)
BUILD SUCCESSFUL (total time: 2 minutes 14 seconds)



I think its trying to connect using local ip of server not the global ip. Any clue ????


--
Regards
Shuja-ur-Rehman Baig
_________________________________
MS CS - School of Science and Engineering
Lahore University of Management Sciences (LUMS)
Sector U, DHA, Lahore, 54792, Pakistan
Cell: +92 3214207445