how to handle "org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException"

[air]

after restarting the scribe service , there are some exceptions like the follwing, is there any way to avoid this ?:

Exception in thread "Thread-285" org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create file /user/hive/warehouse/rawdata/economy/economy_12_1_1_2012-05-16/economy_12_1_1_2012-05-16_00000 for DFSClient_795050923 on client 192.168.85.116, because this file is already being created by NN_Recovery on 192.168.85.116

        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.recoverLeaseInternal(FSNamesystem.java:1381)

        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1221)

        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFile(FSNamesystem.java:1400)

        at org.apache.hadoop.hdfs.server.namenode.NameNode.append(NameNode.java:614)

        at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)

        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)

        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:396)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)

        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428)

        at org.apache.hadoop.ipc.Client.call(Client.java:1107)

        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)

        at $Proxy0.append(Unknown Source)

        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)

        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)

        at $Proxy0.append(Unknown Source)

        at org.apache.hadoop.hdfs.DFSClient.append(DFSClient.java:745)

        at org.apache.hadoop.hdfs.DistributedFileSystem.append(DistributedFileSystem.java:209)

        at org.apache.hadoop.fs.FileSystem.append(FileSystem.java:679)

Call to org.apache.hadoop.conf.FileSystem::append((Lorg/apache/hadoop/fs/Path;)Lorg/apache/hadoop/fs/FSDataOutputStream;) failed!

--
不学习，不知道

[wendylw...@gmail.com]

We are providing HADOOP online training from hyderabad india. HADOOP online training is having good demand in the market, Our HADOOP online training faculty is very much experienced and highly qualified and dedicated.

Our HADOOP online training program is job oriented. After completion of HADOOP online training with us you should be able to work on any kind of project. After completion of HADOOP online training our dedicated team will be supporting you.

 Please contact us for HADOOP online training Demo in our rstrainings.com is the bes HADOOP online training Institute in Hyderabad, India.

HADOOP Online Training Course Content :

1.INTRODUCTION

·         What is Hadoop?

·         History of Hadoop

·         Building Blocks - Hadoop Eco-System

·         Who is behind Hadoop?

·         What Hadoop is good for and what it is not

 2.HDFS

·         Configuring HDFS

·         Interacting With HDFS

·         HDFS Permissions and Security

·         Additional HDFS Tasks

·         HDFS Overview and Architecture

·         HDFS Installation

·         Hadoop File System Shell

·         File System Java API

 3.MAPREDUCE

·         Map/Reduce Overview and Architecture

·         Installation

·         Developing Map/Red Jobs

·         Input and Output Formats

·         Job Configuration

·         Job Submission

·         Practicing Map Reduce Programs (atleast 10 Map Reduce Algorithms )

 

4.Getting Started With Eclipse ID:

·         Configuring Hadoop API on Eclipse IDE

·         Connecting Eclipse IDE to HDFS

5.Hadoop Streaming

6.Advanced MapReduce Features

·         Custom Data Types

·         Input Formats

·         Output Formats

·         Partitioning Data

·         Reporting Custom Metrics

·         Distributing Auxiliary Job Data

7.Distributing Debug Scripts

8.Using Yahoo Web Services

9.Pig

·         Pig Overview

·         Installation

·         Pig Latin

·         Pig with HDFS

 10. Hive

·         Hive Overview

·         Installation

·         Hive QL

·         Hive Unstructured Data Analyzation

·         Hive Semistructured Data Analyzation

 11.HBase

·         HBase Overview and Architecture

·         HBase Installation

·         HBase Shell

·         CRUD operations

·         Scanning and Batching

·         Filters

·         HBase Key Design

12.ZooKeeper

·         Zoo Keeper Overview

·         Installation

·         Server Mantainace

 13.Sqoop

·         Sqoop Overview

·         Installation

·         Imports and Exports

 14.CONFIGURATION

·         Basic Setup

·         Important Directories

·         Selecting Machines

·         Cluster Configurations

·         Small Clusters: 2-10 Nodes

·         Medium Clusters: 10-40 Nodes

·         Large Clusters: Multiple Racks

15.Integrations

16.Putting it all together

·         Distributed installations

·         Best Practices

http://www.rstrainings.com/hadoop-online-training.html

 

[anitha...@gmail.com]

hi you have gathered a valuable information on hadoop...., I am looking for content like this and i am much impressed with the information and nice course content, thanks a lot for the Information regarding hadoop Online Training.

[govindul...@gmail.com]