will scribe lose data when directly writing data to HDFS

145 views
Skip to first unread message

panfei

unread,
Jun 19, 2012, 10:20:29 PM6/19/12
to scribe...@googlegroups.com
 for some power problem, half of the datanodes in the cluster down, we found that there are some data lost, is this a expected problem ?

thanks

--
不学习,不知道

inder singh

unread,
Aug 21, 2012, 11:38:34 PM8/21/12
to scribe...@googlegroups.com
Did you happen to debug this as what the root cause was.

ballbillow

unread,
Sep 15, 2012, 3:41:52 AM9/15/12
to scribe...@googlegroups.com
scribe正常关闭应该是不会又数据丢失的,异常关闭有可能还没有将其缓存的数据写入,这样就丢了。

在 2012年6月20日星期三UTC+8上午10时20分29秒,panfei写道:

Jameson Li

unread,
Sep 19, 2012, 10:28:36 PM9/19/12
to scribe...@googlegroups.com
maybe not the scribe problem, as the data from scribe to hdfs maybe write ok, but then yours datanode down , and then the data lose.

专注于Mysql,MSSQL,Oracle,Hadoop
Reply all
Reply to author
Forward
0 new messages