range server core dump

13 views
Skip to first unread message

swin

unread,
Apr 17, 2008, 8:46:26 AM4/17/08
to Hypertable Development
when we use one or two range server insert more then 20GB data or
more, the range serve always core dump.we use the API write our own
load app.
some infomation:
$ tail DfsBroker.hadoop.log
INFO: [/127.0.0.1:33533 ; Thu Apr 17 19:26:41 CST 2008] Disconnect -
COMM broken connection : Closing all open handles from /
127.0.0.1:33533
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcher.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:233)
at sun.nio.ch.IOUtil.read(IOUtil.java:206)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:
207)
at
org.hypertable.AsyncComm.IOHandlerData.run(IOHandlerData.java:99)
at org.hypertable.AsyncComm.Reactor.run(Reactor.java:82)
at java.lang.Thread.run(Thread.java:595)

$ tail Hypertable.RangeServer.log
1208431586 INFO Hypertable.RangeServer : (/home/hadoop/hypertable/src/
cc/Hypertable/RangeServer/RangeServer.cc:1274) Compacting
session_raw[ff972356f3338599..ffcac87341574c9].default because
cumulative log size of 410413945 exceeds threshold 200000000
1208431586 INFO Hypertable.RangeServer : (/home/hadoop/hypertable/src/
cc/Hypertable/RangeServer/RangeServer.cc:1274) Compacting
session_raw[ffcac87341574c9..ÿÿ].default because cumulative log size
of 410413945 exceeds threshold 200000000
1208431586 FATAL Hypertable.RangeServer : (/home/hadoop/hypertable/src/
cc/Hypertable/RangeServer/Range.cc:300) Unable to determine split row
for range site_index[www.sina.cn..www.sina.com]

$ gdb Hypertable.RangeServer core.21318
(gdb) bt
#0 0x000000302af2e2ed in raise () from /lib64/tls/libc.so.6
#1 0x000000302af2fa3e in abort () from /lib64/tls/libc.so.6
#2 0x0000000000506c99 in Hypertable::Range::get_split_row
(this=0x12627e90)
at /home/hadoop/hypertable/src/cc/Hypertable/RangeServer/Range.cc:
300
#3 0x00000000005070db in Hypertable::Range::do_split
(this=0x12627e90)
at /home/hadoop/hypertable/src/cc/Hypertable/RangeServer/Range.cc:
357
#4 0x00000000004fd151 in Hypertable::MaintenanceTaskSplit::execute
(this=0x2ad7cb34f0)
at /home/hadoop/hypertable/src/cc/Hypertable/RangeServer/
MaintenanceTaskSplit.cc:38
#5 0x0000000000520e77 in
Hypertable::MaintenanceQueue::Worker::operator() (this=0x504191a8)
at /home/hadoop/hypertable/src/cc/Hypertable/RangeServer/
MaintenanceQueue.h:87
#6 0x0000000000520d21 in
boost::detail::function::void_function_obj_invoker0<Hypertable::MaintenanceQueue::Worker,
void>::invoke (function_obj_ptr=@0x504191a8)
at /home/hadoop/hypertable/src/cc/boost-1_34-fix/boost/function/
function_template.hpp:158
#7 0x0000002a95576dc7 in boost::function0<void,
std::allocator<boost::function_base> >::operator() ()
from /usr/local/lib/libboost_thread-gcc34-mt-1_34_1.so.1.34.1
#8 0x0000002a95576407 in boost::thread_group::join_all () from /usr/
local/lib/libboost_thread-gcc34-mt-1_34_1.so.1.34.1
#9 0x000000302b80610a in start_thread () from /lib64/tls/
libpthread.so.0
#10 0x000000302afc6003 in clone () from /lib64/tls/libc.so.6
#11 0x0000000000000000 in ?? ()

and in the terminal print:
1208342198 INFO LogLoad : (/home/work/hypertable_install/hypertable/
src/cc/AsyncComm/ConnectionManager.cc:257) Event: type=DISCONNECT
"COMM connect error" from=10.23.2.35:38060; Problem connecting to Root
RangeServer, will retry in 8 seconds...
1208342206 INFO LogLoad : (/home/work/hypertable_install/hypertable/
src/cc/AsyncComm/ConnectionManager.cc:257) Event: type=DISCONNECT
"COMM connect error" from=10.23.2.35:38060; Problem connecting to Root
RangeServer, will retry in 8 seconds...

Anybody can help me?

Doug Judd

unread,
Apr 17, 2008, 12:18:35 PM4/17/08
to hyperta...@googlegroups.com
Hi Swin,

The following error message is the root of the problem ...

"1208431586 FATAL Hypertable.RangeServer : (/home/hadoop/hypertable/src/
cc/Hypertable/RangeServer
/Range.cc:300) Unable to determine split row
for range site_index[www.sina.cn..www.sina.com]"

How many entries are you loading that have row key "www.sina.cn" or "www.sina.com" ?  I'm guessing that you're probably loading a lot of these.  There is an assert (which generates the above error) that fires if the system cannot find a good split row, which would be the case if a Range was "full", but only consisted of two rows.  That appears to be what's going on.

Can you send me a sample of the data you're loading?  In particular, what do your values look like?  I would like to recreate it in my environment.  Thanks!

- Doug

P.S. What version of the code are you using?  Also, what version of Hadoop?

swin

unread,
Apr 18, 2008, 3:46:41 AM4/18/08
to Hypertable Development
hadoop version is 0.15.1.

I think increase the range size my be ok , how can I do?

Thanks!

On 4月18日, 上午12时18分, "Doug Judd" <d...@zvents.com> wrote:
> Hi Swin,
>
> The following error message is the root of the problem ...
>
> "1208431586 FATAL Hypertable.RangeServer : (/home/hadoop/hypertable/src/
> cc/Hypertable/RangeServer
>
>
>
> > /Range.cc:300) Unable to determine split row
> > for range site_index[www.sina.cn..www.sina.com]"
>
> How many entries are you loading that have row key "www.sina.cn" or "www.sina.com" ? I'm guessing that you're probably loading a lot of these.
> There is an assert (which generates the above error) that fires if the
> system cannot find a good split row, which would be the case if a Range was
> "full", but only consisted of two rows. That appears to be what's going on.
>
> Can you send me a sample of the data you're loading? In particular, what do
> your values look like? I would like to recreate it in my environment.
> Thanks!
>
> - Doug
>
> P.S. What version of the code are you using? Also, what version of Hadoop?
>

Doug Judd

unread,
Apr 18, 2008, 7:28:27 PM4/18/08
to hyperta...@googlegroups.com
Hi Swin,

You'll have to shut the system down and then add the following line to your config file:

Hypertable.RangeServer.Range.MaxBytes=1G

Or something along those lines.  By default this property is set to 200M  Make sure this config file change gets propagated to all of the machines in your cluster.  Then re-start the servers.

- Doug

Doug Judd

unread,
Apr 20, 2008, 4:50:10 PM4/20/08
to hyperta...@googlegroups.com
I've made a small fix for this and pushed the change into the tree.  It should allow you to get twice as far before it crashes.  See http://code.google.com/p/hypertable/wiki/SourceCode?tm=4 for instructions on how to pull the latest tree.  I've also filed Issue #96 to support large rows.

- Doug

swin

unread,
Apr 29, 2008, 4:33:50 AM4/29/08
to Hypertable Development
After updating to the latest version and increasing range size to 2G,
we tested inserting 200GB data with no problem, but when insert 270GB
data
it core dump:
$ tail -n 50 Hypertable.RangeServer.log
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1370) Compacting
session_raw[f00e0dffb3aee998..f0d843044b70d77a].default because
cumulative log size of 227149388 exceeds threshold 200000000
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1370) Compacting
session_raw[f82226ff6218e50d..f9869aeb4af34ca0].default because
cumulative log size of 227149388 exceeds threshold 200000000
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1370) Compacting
site_index[imgcache.qq.com..tb.265.com].default because cumulative log
size of 227149388 exceeds threshold 200000000
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1370) Compacting site_index[tb.
265.com..www.chinaglw.com].default because cumulative log size of
227149388 exceeds threshold 200000000
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1370) Compacting
site_index[www.chinaglw.com..ÿÿ].default because cumulative log size
of 227149388 exceeds threshold 200000000
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/AccessGroup.cc:256) Starting Merging Compaction
(METADATA.default)
RangeServer::update
Table Name = session_raw
Table ID = 1
Generation = 1
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 3 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 5 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 7 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 10 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 12 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 16 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 17 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 18 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 21 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 22 (0 split off)
updates to 'session_raw'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1020) Dropped 0 updates (out-of-
range)
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1034) drj mem=510085901
items=2094364 vm-est761409581
RangeServer::update
Table Name = site_index
Table ID = 2
Generation = 1
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 888 (0 split off)
updates to 'site_index'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 2034 (0 split off)
updates to 'site_index'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:983) Added 3051 (0 split off)
updates to 'site_index'
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1020) Dropped 0 updates (out-of-
range)
1209438752 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/RangeServer.cc:1034) drj mem=510238162
items=2097415 vm-est761927962
1209438782 INFO Hypertable.RangeServer : (/home/work/hypertable/src/cc/
Hypertable/RangeServer/HyperspaceSessionHandler.cc:37) Hyperspace
session state change: JEOPARDY
1209438792 ERROR Hypertable.RangeServer : (/home/work/hypertable/src/
cc/Hyperspace/Session.cc:336) Hyperspace 'attrset' error,
name=files.default : COMM request timeout
1209438792 ERROR Hypertable.RangeServer : (/home/work/hypertable/src/
cc/Hyperspace/Session.cc:338) Event: type=ERROR "COMM request timeout"
from=10.23.245.152:38070
1209438842 ERROR Hypertable.RangeServer : (/home/work/hypertable/src/
cc/Hypertable/RangeServer/HyperspaceSessionHandler.cc:44) Hyperspace
session expired. Exiting...
RangeServer::create_scanner
Table Name = METADATA
Table ID = 0
Generation = 1
StartRow = ""
EndRow = "0:ÿÿ"
RowLimit = 0
MaxVersions = 0
Columns = Files
StartRow =
StartRowInclusive = 0
EndRow = ÿÿ
EndRowInclusive = 0
MinTime = 0
MaxTime = 18446744073709551615

On 4月21日, 上午4时50分, "Doug Judd" <d...@zvents.com> wrote:
> I've made a small fix for this and pushed the change into the tree. It
> should allow you to get twice as far before it crashes. Seehttp://code.google.com/p/hypertable/wiki/SourceCode?tm=4for instructions on
> how to pull the latest tree. I've also filed Issue
> #96<http://code.google.com/p/hypertable/issues/detail?id=96>to support
> large rows.
>
> - Doug
>

Doug Judd

unread,
Apr 29, 2008, 1:38:02 PM4/29/08
to hyperta...@googlegroups.com
Hi Swin,

Can you post or send me the Hyperspace.log file?

- Doug

swin

unread,
Apr 30, 2008, 6:05:53 AM4/30/08
to Hypertable Development
$ tail -n 50 Hyperspace.log
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=176 gid=3991 headerLen=16 totalLen=26
from=10.23.245.152:36756
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:634) close(session=1134, handle=3991)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=DISCONNECT
from=10.23.245.152:36756
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerKeepaliveHandler.cc:94) Session handle 1135 created
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
AsyncComm/IOHandler.h:75) Event: type=CONNECTION_ESTABLISHED
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=2 gid=0 headerLen=16 totalLen=26
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=3 gid=1818 headerLen=16 totalLen=51
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/
master, flags=0x1, eventMask=0x1)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=4 gid=3996 headerLen=16 totalLen=36
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=3996,
name=address)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=5 gid=3045 headerLen=16 totalLen=63
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/
tables/session_raw, flags=0x1, eventMask=0x0)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=6 gid=3997 headerLen=16 totalLen=37
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=3997,
name=table_id)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=7 gid=3997 headerLen=16 totalLen=35
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=3997,
name=schema)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=8 gid=3997 headerLen=16 totalLen=26
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:634) close(session=1135, handle=3997)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=9 gid=1618 headerLen=16 totalLen=49
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/root,
flags=0x1, eventMask=0x1)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=10 gid=2425 headerLen=16 totalLen=60
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/
tables/METADATA, flags=0x1, eventMask=0x0)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=11 gid=3999 headerLen=16 totalLen=35
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=3999,
name=schema)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=12 gid=3999 headerLen=16 totalLen=26
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:634) close(session=1135, handle=3999)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=13 gid=2916 headerLen=16 totalLen=62
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/
tables/site_index, flags=0x1, eventMask=0x0)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=14 gid=4000 headerLen=16 totalLen=37
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=4000,
name=table_id)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=15 gid=4000 headerLen=16 totalLen=35
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=4000,
name=schema)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=16 gid=4000 headerLen=16 totalLen=26
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:634) close(session=1135, handle=4000)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=17 gid=1618 headerLen=16 totalLen=49
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/root,
flags=0x1, eventMask=0x1)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=18 gid=2425 headerLen=16 totalLen=60
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=1135, fname=/hypertable/
tables/METADATA, flags=0x1, eventMask=0x0)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=19 gid=4002 headerLen=16 totalLen=35
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=4002,
name=schema)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=20 gid=4002 headerLen=16 totalLen=26
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:634) close(session=1135, handle=4002)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=21 gid=3998 headerLen=16 totalLen=37
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=3998,
name=location)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=24 gid=4001 headerLen=16 totalLen=37
from=10.23.245.152:36771
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:713) attrget(session=1135, handle=4001,
name=location)
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:248) Expiring session 1134
1209438728 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:258) Destroying handle 3989
1209438752 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/ServerConnectionHandler.cc:54) Event: type=MESSAGE
protocol=hyperspace id=2773687 gid=1618 headerLen=16 totalLen=49
from=10.23.245.152:48937
1209438752 INFO Hyperspace.Master : (/home/work/hypertable/src/cc/
Hyperspace/Master.cc:434) open(sessionId=5, fname=/hypertable/root,
flags=0x1, eventMask=0x0)

On 4月30日, 上午1时38分, "Doug Judd" <d...@zvents.com> wrote:
> Hi Swin,
>
> Can you post or send me the Hyperspace.log file?
>
> - Doug
>

Doug Judd

unread,
Apr 30, 2008, 3:15:12 PM4/30/08
to hyperta...@googlegroups.com
Hi Swin,

It looks like the Hyperspace default timeouts may be cranked down little too low.  Can you modify your hypertable.cfg file by adding the following lines:

Hyperspace.Lease.Interval=60
Hyperspace.KeepAlive.Interval=15
Hyperspace.GracePeriod=180

Then push this configuration file out to all of your nodes, shut down the servers, restart them, and try your test again.  Please let me know if this fixes your problem  Thanks.

- Doug

Doug Judd

unread,
Apr 30, 2008, 6:37:04 PM4/30/08
to hyperta...@googlegroups.com
Hi Swin,

What is the machine configuration you are using?  How many nodes?  Are they all on the same switch?  Are you running on top of HDFS? 

- Doug

swin

unread,
May 4, 2008, 8:14:13 AM5/4/08
to Hypertable Development
hi:
I tested on another cluster,there's no problem, I think there's
something wrong
with the HDFS. I will check it and test again.

thanks.

On 5月1日, 上午6时37分, "Doug Judd" <d...@zvents.com> wrote:
> Hi Swin,
>
> What is the machine configuration you are using? How many nodes? Are they
> all on the same switch? Are you running on top of HDFS?
>
> - Doug
>
> On Wed, Apr 30, 2008 at 12:15 PM, Doug Judd <d...@zvents.com> wrote:
> > Hi Swin,
>
> > It looks like the Hyperspace default timeouts may be cranked down little
> > too low. Can you modify your hypertable.cfg file by adding the following
> > lines:
>
> > Hyperspace.Lease.Interval=60
> > Hyperspace.KeepAlive.Interval=15
> > Hyperspace.GracePeriod=180
>
> > Then push this configuration file out to all of your nodes, shut down the
> > servers, restart them, and try your test again. Please let me know if this
> > fixes your problem Thanks.
>
> > - Doug
>
> ...
>
> 阅读更多 >>
Reply all
Reply to author
Forward
0 new messages