0.9.5.0 "pre"-release available

[Doug Judd]

Hypertable 0.9.5.0 pre-release is now available for download at http://www.hypertable.org/download.html.

NOTE: you may have to hit refresh in your browser to get the correct download

Version 0.9.5.0.pre:

(2011-03-24)

    Master overhaul

    MetaLog overhaul

    Asynchronous Scanner API

    Upgraded to Thrift 0.6.0

    Upgraded to CDH3B4

    Added sys/RS_METRICS

    Fixed bug in monitoring system that was calculating buggy Cell and Byte read/write rates.

    Added METADATA-split master failover tests

    Added MasterClient-TransparentFailover test; fix bugs that turned up

    Added VERSION_MISC_SUFFIX to version string for 0.9.5.0.pre release.

    Added delete_count to CellStoreV5Trailer which stores the number of delete records in the CS.

    Added list of replaced files to CellStoreV5.

    Fixed soft_limit regression

    Fixed intermittent test failues due to exit(); Got rid of valgrind warnings

    Added two-phase master requests

    Fixed warnings

    Upgraded version number to 0.9.5.0

    Cleaned up prune threshold limits; Got rid of warnings

    Fixed deadlock in ResponseManager

    Fixed data loss bug - made CommitLog close synchronous; fixed async scanner bug

    [Issue 579]  metalog backup verification causing intermittent test failures. Fixed

    Added regression tests for stopping synchronous and asynchronous scanners abruptly before scan completes.

    Fixed deadlock in TableScannerAsync code.

    Added needs_compaction flag to RangeServer::load_range method.

    [Issue 578]  Deadlock in async scanner. Fixed

    Added ht_master_client shell program with shutdown command

    Fixed hyperspace-reconnect test

    Fixed monitoring server initialization problem

    Minor fix to dot jpg file generation.

    added start_time,end_time as http query params

    Close cell store file before removing directory

    Create <data dir>/run folder if required

    Fixed a bunch of minor issues.

    [Issue 577]  RangeServer::commit_log_sync should respect group commit. Fixed

    Added regression tests and bug fixes for Future API.

    Performance and functional bug fixes to TableScanner class.

    Implemented changes to C++ and Thrift clients to support asynchronous scanners. -TODO: add tests for Php and Python 

    Fixed a bug that was causing the METADATA-split-recovery test to fail intermittently.

    issue 552: Ensure Hyperspace handles get closed; Naming cleanup

    Fixed incorrect CellStoreTrailerV5 version check caught by assert

    Added CellStoreV5; Monitoring system improvements (avg. key & value size)

    added new column to table stats

    Added file_count to StatsTable; Fixed compression ratio computation

    Got rid of read_ids flag in Schema parse API

    "changes to header labels"

    Monitoring UI Changes, Sorting options for stats summary

    Updated clean-database.sh script to reflect new rsml backup location

    added invalidate methods for table name changes

    bunch of changes to Monitoring UI changes (reading from json and got rid google graphs which gives summary) Added Ta

    Fixes to monitoring & stats gathering

    Fixed bugs caught by Andy Thalmann (ScanContext copy ctor bug)

    added table names to json , removing unnecessary code

    Fixed minor monitoring/stats gathering bugs

    issue 563: fixed METADATA split test

    bunch of changes to Monitoring UI changes (reading from json and got rid google graphs which gives summary) Added Ta

    Added Hypertable.RangeServer.CellStore.SkipNotFound

    issue 559: Prevent transfer log from getting linked in twice

    issue 552: Ensure Hyperspace handles get closed; Naming cleanup

    [Issue 505] Client-no-log-sync regression failure

    issue 537: Fixed RangeServer shutdown hang

    issue 542: Only write last-dfs file if it doesn't exist

    issue 544: Set default RangeServer memory limit to 50%

    issue 553: Schema HQL render wrap table name in quotes if necessary

    issue 545: Reduced random-write-read test to 1/5 the size

    [Issue 551] Upgraded to QuickLZ 1.5

    Fixed bugs related to MasterGc and live file tracking

    Renamed MoveStart and MoveDone RSML operations to RelinquishStart and RelinquishDone.

    Made changes to BalanceStarted/Done and RangeMoveLoaded/Acknowledged MML entries.

    Added code for additional MML entries.

    Changed MasterMetaLog to garbage collect entries during recovery.

    Added MoveStart and MoveDone RSML entries.

    Changed RangeServerMetaLog to garbage collect entries during recovery.

    Fixed rare bug that caused root range corruption

    issue 547: Found and fixed more race conditions

    Fixed excessive maintenance scheduling during low memory condition

    Fixed deadlocks uncovered recently

    Fixed race cond in drop_table; Fixed RangeServer::update bug

    Changed DfsBroker.Local.DirectIO default to false

    Fixed some stats gathering issues discovered in sys/RS_METRICS

    issue 531: Fixed bug in load_generator that caused intermittent drop of last cells

    Added RangeServer::relinquish_range() (with RSML update code stubbed out)

    Added Hyperspace::Session::open() method with no callback; code cleanup

    Use "scanned" cells/bytes for load metrics; Added paging info to load metrics

    Fixed recently introduced "bad ProxyName" problem

    Do not reduce the limit below the minimum

    Scan and filter rows fix and optimization

    Config property "Hypertable.RangeServer.LowMemoryLimit.Percentage" has been added

    Added disk_used, disk_estimate, and compression_ratio to StatsTable

    Fixed revision number problem in CommitLogReader with link entries

    Renamed Master::report_split() to Master::move_range()

    Added MML

    Fixed monitoring stats; fixed JSON output for RS summary

    Monitoring overhaul part 1

    new rangeserver stats

    changes to use new rangeserver summary data

    Destroy comm has been fixed

    HQL scan and filter rows option added

    Logic changed to setup row intervals in case of scan and filter rows

    Optimization for scan and filter rows

    Scan and filter rows has been implemented (Issue 525)

    check for negative resolution

    issues with config

    Added resolution param to rrd page

    Fixed monitoring stats; fixed JSON output for RS summary

    Monitoring overhaul part 1

    Check for zero-lengthed row and skip in LoadDataSource

    Allow NULL strings to be passed into FlyweightString

    Fixed bad memory reference in RangeServer::FillScanBlock

    cleanup has been added

    Added prepend_md5 tool

    Redirect thrift output to HT logger

    Assignment operator added

    Support empty qualifier filtering

    Recursive option added to the hyperspace readdirattr command

    Recursivly option added to the hyperspace readdirattr command

    Include sub entries for get_listing/NamespaceListing, readdir_attr/DirEntryAttr

    Fixed syntax error recently intoduced into Ceph broker code

    Added StrictHostKeyChecking=no to rsync

    Added regexp filtering to DUMP TABLE command.

    Added optimization for row and qualifier regex matching.

    Added script to compare test runs times and detect potential performance regressions.

    Cleaned up SELECT [CELLS] Hql command.

    Removed DfsBroker.Host from default hypertable.cfg; Cleaned up DFS Port properties

    Fixed bug in Hyperspace caused by Reactor thread directly calling BerkeleyDbFilesystem on disconnect.

    Improved Master handling of already assigned location in register_server

    Fixed performance regression in ScanContext by using set instead of hash_set for exact qualifiers

[Quest Yarbrough]

Hey Doug,
I ran into some issues when compiling this new version of HyperTable.
I'm running Thrift version 0.5.0

[ 95%] Building CXX object src/cc/ThriftBroker/CMakeFiles/
HyperThrift.dir/gen-cpp/HqlService.cpp.o
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp: In
member function ‘void
Hypertable::ThriftGen::HqlServiceProcessor::process_hql_exec(int32_t,
apache::thrift::protocol::TProtocol*,
apache::thrift::protocol::TProtocol*, void*)’:
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1125:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1128:
error: ‘TProcessorContextFreer’ is not a member of ‘apache::thrift’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1128:
error: expected ‘;’ before ‘freer’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1130:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1137:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1139:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1151:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1164:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1171:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1174:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp: In
member function ‘void
Hypertable::ThriftGen::HqlServiceProcessor::process_hql_query(int32_t,
apache::thrift::protocol::TProtocol*,
apache::thrift::protocol::TProtocol*, void*)’:
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1182:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1185:
error: ‘TProcessorContextFreer’ is not a member of ‘apache::thrift’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1185:
error: expected ‘;’ before ‘freer’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1187:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1194:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1196:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1208:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1221:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1228:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1231:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp: In
member function ‘void
Hypertable::ThriftGen::HqlServiceProcessor::process_hql_exec2(int32_t,
apache::thrift::protocol::TProtocol*,
apache::thrift::protocol::TProtocol*, void*)’:
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1239:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1242:
error: ‘TProcessorContextFreer’ is not a member of ‘apache::thrift’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1242:
error: expected ‘;’ before ‘freer’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1244:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1251:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1253:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1265:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1278:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1285:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1288:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp: In
member function ‘void
Hypertable::ThriftGen::HqlServiceProcessor::process_hql_query2(int32_t,
apache::thrift::protocol::TProtocol*,
apache::thrift::protocol::TProtocol*, void*)’:
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1296:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1299:
error: ‘TProcessorContextFreer’ is not a member of ‘apache::thrift’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1299:
error: expected ‘;’ before ‘freer’
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1301:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1308:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1310:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1322:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1335:
error: ‘eventHandler_’ was not declared in this scope
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1342:
error: void value not ignored as it ought to be
/var/tmp/hypertable/src/cc/ThriftBroker/gen-cpp/HqlService.cpp:1345:
error: ‘eventHandler_’ was not declared in this scope
make[2]: *** [src/cc/ThriftBroker/CMakeFiles/HyperThrift.dir/gen-cpp/
HqlService.cpp.o] Error 1
make[1]: *** [src/cc/ThriftBroker/CMakeFiles/HyperThrift.dir/all]
Error 2
make: *** [all] Error 2

I can compile successfully on HyperTable 0.9.4.0 . Not sure what
changed this version, but thought I'd go ahead and post. Let me know
if you want any more information about my configuration.

On Mar 24, 10:15 pm, Doug Judd <d...@hypertable.com> wrote:
> Hypertable 0.9.5.0 pre-release is now available for download athttp://www.hypertable.org/download.html.

> ...

[Doug Judd]

We upgraded to Thrift 0.6.0 in this release.  Try that version and let us know how it goes.

- Doug

--
You received this message because you are subscribed to the Google Groups "Hypertable User" group.
To post to this group, send email to hyperta...@googlegroups.com.
To unsubscribe from this group, send email to hypertable-us...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/hypertable-user?hl=en.

[Milko Marinov]

Hi Doug,

I'm using the new HT release (0.9.5.0.pre).

When I'm running the select query:

select cells ch1_watts from timeseries_table DISPLAY_TIMESTAMPS;

the following error appears:

I haven't similar problems with 0.9.4.3.

Have you got any hint.

Regards,

Milko

=================================================
01302196318 ERROR hypertable : handle_error
(/home/milko/src/hypertable/src/cc/Hypertable/Lib/TableScannerAsync.cc:196): Received
error: is_create=0 - Hypertable::Exception: Event: type=MESSAGE version=1 total_len=45
header_len=38 header_checksum=-2047765208 flags=0 id=121 gid=491 timeout_ms=0
payload_checksum=0 command=3 from=172.16.0.201:38060 - HYPERTABLE block
compressor block checksum mismatch
1302196318 ERROR hypertable : handle_error
(/home/milko/src/hypertable/src/cc/Hypertable/Lib/TableScannerAsync.cc:213):
Hypertable::Exception: Event: type=MESSAGE version=1 total_len=45 header_len=38
header_checksum=-2047765208 flags=0 id=121 gid=491 timeout_ms=0
payload_checksum=0 command=3 from=172.16.0.201:38060 - HYPERTABLE block
compressor block checksum mismatch
Error: Hypertable::Exception: Event: type=MESSAGE version=1 total_len=45 header_len=38
header_checksum=-2047765208 flags=0 id=121 gid=491 timeout_ms=0
payload_checksum=0 command=3 from=172.16.0.201:38060 - HYPERTABLE block
compressor block checksum mismatch
at bool Hypertable::TableScanner::next(Hypertable::Cell&)
(/home/milko/src/hypertable/src/cc/Hypertable/Lib/TableScanner.cc:81) - HYPERTABLE
block compressor block checksum mismatch

==========================================

**********************************************************
Assoc. Prof. Milko Todorov Marinov, PhD
Department of Computer Systems & Technologies
University of Ruse
8 Studentska Str, 7017 Ruse, BULGARIA
Tel. (+359 82) 888 356, Fax. (+359 82) 845 708
Cell phone: (+359 88) 999 6793
E-mail: MMar...@ecs.uni-ruse.bg
***********************************************************

[Doug Judd]

Hi Milko,

This sounds like a file corruption problem.  I've created issue 605, can you upload all of your log files there?  Also, what DFS are you running on top of?

- Doug

[Doug Judd]

Hi Milko,

Looking back over your previous posts, it looks like you're using KFS.  If that's the case, can you run fsck on KFS to see if it shows any problems?  Also, check the KFS logs to see if they contain any errors.

- Doug

On Thu, Apr 7, 2011 at 10:23 AM, Milko Marinov <MMar...@ecs.uni-ruse.bg> wrote:

[Milko Marinov]

Hi Doug,

I'm going to shift to HADOOP. I have installed it, but now I don't manage to start Hypertable
with Hadoop.

I think that the problem is during the cmake:

-- Found thrift for python
-- Java headers found at: /usr/lib/jvm/java/include
-- Please set HADOOP_INCLUDE_PATH variable for Legacy Hadoop support
-- Please set HADOOP_LIB_PATH variable for Legacy Hadoop support
-- Not building shared libraries. Legacy Hadoop support will be disabled

Could you help me?

Regards,

Milko

[Doug Judd]

Those cmake messages are innocuous, you can ignore them.  Here's what I suggest.  First verify that Hadoop is up and operational by running a few commands such as:

hadoop dfs -ls /

Then make sure Hadoop is out of safe mode:

hadoop dfsadmin -safemode get

Then be sure you've set the HdfsBroker.fs.default.name property in your config file to point to your running HDFS instance.  If you're still having troubles, inspect the Hypertable logs to see if they contain any errors and let us know what you find out.

- Doug

[mmar...@ecs.uni-ruse.bg]

Hi,

I'm a beginner in HADOOP.

I'm trying to shift to HADOOP file system.

But when I'm going to start HT servers after the starting of DFS Broker
(hadoop) and Hyperspace the Master is not run.
Here is the Master log:
===================================================
1302551412 NOTICE Hypertable.Master :
(/home/milko/src/hypertable/src/cc/Common/Config.cc:485) Initializing
Hypertable.Master (Hypertable 0.9.5.0.pre (tarball))...
CPU cores count=8
CephBroker.MonAddr=10.0.1.245:6789
DfsBroker.Local.Root=fs/local
DfsBroker.Port=38030
HdfsBroker.fs.default.name=hdfs://localhost/milko:9000
Hyperspace.GracePeriod=200000
Hyperspace.KeepAlive.Interval=30000
Hyperspace.Lease.Interval=1000000
Hyperspace.Replica.Dir=hyperspace
Hyperspace.Replica.Host=[localhost]
Hyperspace.Replica.Port=38040
Hyperspace.Replica.Workers=20
Hypertable.Master.Port=38050
Hypertable.Master.Reactors=8
Hypertable.Master.Workers=20
Hypertable.RangeServer.MemoryLimit.Percentage=50
Hypertable.RangeServer.Port=38060
Hypertable.RangeServer.Range.SplitSize=1000000000
Hypertable.Verbose=true
Kfs.MetaServer.Name=NODE-0.UNI-RUSE.BG
Kfs.MetaServer.Port=20000
ThriftBroker.Port=38080
dfs-port=38030
grace-period=200000
hs-host=[localhost]
hs-port=38040
keepalive=30000
lease-interval=1000000
pidfile=/home/milko/hypertable/0.9.5.0.pre/run/Hypertable.Master.pid
port=38050
reactors=8
verbose=true
workers=20
1302551412 INFO Hypertable.Master :
(/home/milko/src/hypertable/src/cc/Hypertable/Master/main.cc:260) Obtained
lock on '/hypertable/master'
1302551412 INFO Hypertable.Master :
(/home/milko/src/hypertable/src/cc/Hypertable/Master/main.cc:287)
Successfully Initialized.
1302551413 INFO Hypertable.Master :
(/home/milko/src/hypertable/src/cc/Hypertable/Master/Monitoring.cc:67)
rangeservers monitoring stats dir
/home/milko/hypertable/0.9.5.0.pre/run/monitoring exists
1302551413 INFO Hypertable.Master :
(/home/milko/src/hypertable/src/cc/Hypertable/Master/Monitoring.cc:67)
rangeservers monitoring stats dir
/home/milko/hypertable/0.9.5.0.pre/run/monitoring/tables exists
1302551413 INFO Hypertable.Master :
(/home/milko/src/hypertable/src/cc/Hypertable/Master/Monitoring.cc:67)
rangeservers monitoring stats dir
/home/milko/hypertable/0.9.5.0.pre/run/monitoring/rangeservers exists
1302551413 ERROR Hypertable.Master : main
(/home/milko/src/hypertable/src/cc/Hypertable/Master/main.cc:205):
Hypertable::Exception: Error appending 16 bytes to DFS fd 1 - DFS BROKER
i/o error
at virtual size_t Hypertable::DfsBroker::Client::append(int32_t,
Hypertable::StaticBuffer&, uint32_t)
(/home/milko/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:318)
at virtual size_t Hypertable::DfsBroker::Client::append(int32_t,
Hypertable::StaticBuffer&, uint32_t)
(/home/milko/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:307):
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
/hypertable/servers/master/log/mml/0 could only be replicated to 0 nodes,
instead of

===================================================

BTW, I noticed that hadoop-datanode is not started:

# /sbin/service hadoop-0.20-datanode status
datanode dead but pid file exists

while other daemons are running

Could you help me?

Milko

[Doug Judd]

Take a look at the Hadoop logs.  Are there any errors there that point to what might be the problem?  Also, make sure there is no firewall that is blocking Hadoop traffic.

- Doug

[Milko Marinov]

No firewall.

There are any errors in the following logs:

=========================================
2011-04-12 11:43:19,003 INFO org.apache.hadoop.hdfs.server.datanode.DataNode:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG: host = node-3.uni-ruse.bg/172.16.0.203
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2-CDH3B4
STARTUP_MSG: build = -r 3aa7c91592ea1c53f3a913a581dbfcdfebe98bfe; compiled by
'root' on Mon Feb 21 17:31:12 EST 2011
************************************************************/
2011-04-12 11:43:19,314 INFO org.apache.hadoop.security.UserGroupInformation: JAAS
Configuration already set up for Hadoop, not re-installing.
2011-04-12 11:43:19,499 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:
java.io.IOException: Incompatible namespaceIDs in /var/lib/hadoop-0.20/cache/hdfs/dfs/data:
namenode namespaceID = 1545023549; datanode namespaceID = 1125975556
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:233)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead
......................................................................................

=========================================
12 11:43:25,083 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host = node-3.uni-ruse.bg/172.16.0.203
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2-CDH3B4
STARTUP_MSG: build = -r 3aa7c91592ea1c53f3a913a581dbfcdfebe98bfe; compiled by
'root' on Mon Feb 21 17:31:12 EST 2011
************************************************************/
2011-04-12 11:43:25,623 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2011-04- ........................................................................

2011-04-12 11:43:33,470 WARN org.apache.hadoop.hdfs.DFSClient: Error Recovery for
block null bad datanode[0] nodes == null

.......................................................
==========================================================
2011-04-12 11:43:31,157 INFO org.apache.hadoop.hdfs.server.namenode.NameNode:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = node-3.uni-ruse.bg/172.16.0.203
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2-CDH3B4
STARTUP_MSG: build = -r 3aa7c91592ea1c53f3a913a581dbfcdfebe98bfe; compiled by
'root' on Mon Feb 21 17:31:12 EST 2011
************************************************************/
..............................................................

127.0.0.1:43727: error: java.io.IOException: File /var/lib/hadoop-
0.20/cache/mapred/mapred/system/jobtracker.info could only be replicated to 0 nodes,
instead of 1

........................................................

127.0.0.1:43731: error: java.io.IOException: File /var/lib/hadoop-
0.20/cache/mapred/mapred/system/jobtracker.info could only be replicated to 0 nodes,
instead of 1
====================================================

Milko

On 11 Apr 2011 at 22:19, Doug Judd wrote:

>
> Take a look at the Hadoop logs. Are there any errors there that
> point to what might be the
> problem? Also, make sure there is no firewall that is blocking
> Hadoop traffic.
>
> - Doug
>
> On Mon, Apr 11, 2011 at 1:15 PM, <mmar...@ecs.uni-ruse.bg> wrote:
> Hi,
>
> I'm a beginner in HADOOP.
>
> I'm trying to shift to HADOOP file system.
>
> But when I'm going to start HT servers after the starting of DFS
> Broker
> (hadoop) and Hyperspace the Master is not run.
> Here is the Master log:
> ===================================================
> 1302551412 NOTICE Hypertable.Master :
> (/home/milko/src/hypertable/src/cc/Common/Config.cc:485)
> Initializing
> Hypertable.Master (Hypertable 0.9.5.0.pre (tarball))...
> CPU cores count=8

> CephBroker.MonAddr=MailScanner has detected a possible fraud
> attempt from
> "10.0.1.245:6789" claiming to be MailScanner warning: numerical
> links are often
> malicious: 10.0.1.245:6789

[Milko Marinov]

Hi Doug,

Please reject the problem. I managed to deal with it.

Milko

> =========================================
> 12 11:43:25,083 INFO org.apache.hadoop.mapred.JobTracker:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting JobTracker
> STARTUP_MSG: host = node-3.uni-ruse.bg/172.16.0.203
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.20.2-CDH3B4
> STARTUP_MSG: build = -r 3aa7c91592ea1c53f3a913a581dbfcdfebe98bfe;
> compiled by
> 'root' on Mon Feb 21 17:31:12 EST 2011
> ************************************************************/
> 2011-04-12 11:43:25,623 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenS
> ecretManager:
> Updating the current master key for generating delegation tokens
> 2011-04-
> ....................................................................
> ....
>
> 2011-04-12 11:43:33,470 WARN org.apache.hadoop.hdfs.DFSClient: Error
> Recovery for
> block null bad datanode[0] nodes == null
>
> ......................................................

> ==========================================================
> 2011-04-12 11:43:31,157 INFO
> org.apache.hadoop.hdfs.server.namenode.NameNode:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting NameNode
> STARTUP_MSG: host = node-3.uni-ruse.bg/172.16.0.203
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.20.2-CDH3B4
> STARTUP_MSG: build = -r 3aa7c91592ea1c53f3a913a581dbfcdfebe98bfe;
> compiled by
> 'root' on Mon Feb 21 17:31:12 EST 2011
> ************************************************************/
> .............................................................
>

> 127.0.0.1:43727: error: java.io.IOException: File /var/lib/hadoop-
> 0.20/cache/mapred/mapred/system/jobtracker.info could only be
> replicated to 0 nodes,
> instead of 1
>
> .......................................................
>

[Jbrocker]

Hey Milko

I am facing the same problem when trying to run my Hypertable.Master for the first time

this is output of my hadoop log:

12/05/08 11:46:44 ERROR security.UserGroupInformation: PriviledgedActionException as:dubizzle (auth:SIMPLE) cause:java.io.IOException: File /hypertable/servers/master/log/mml/0 could only be replicated to 0 nodes, instead of 1
12/05/08 11:46:44 INFO ipc.Server: IPC Server handler 0 on 9000, call addBlock(/hypertable/servers/master/log/mml/0, DFSClient_-1180814906, null) from 10.176.206.200:37355: error: java.io.IOException: File /hypertable/servers/master/log/mml/0 could only be replicated to 0 nodes, instead of 1
java.io.IOException: File /hypertable/servers/master/log/mml/0 could only be replicated to 0 nodes, instead of 1
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1520)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:665)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428)

and this is output in my Hypertable.Master log

1336474004 ERROR Hypertable.Master : main (/root/src/hypertable/src/cc/Hypertable/Master/main.cc:246): Hypertable::Exception: Error appending 16 bytes to DFS fd 1 - DFS BROKER i/o error
        at virtual size_t Hypertable::DfsBroker::Client::append(int32_t, Hypertable::StaticBuffer&, uint32_t) (/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:318)
        at virtual size_t Hypertable::DfsBroker::Client::append(int32_t, Hypertable::StaticBuffer&, uint32_t) (/root/src/hypertable/src/cc/DfsBroker/Lib/Client.cc:307): org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /hypertable/servers/master/log/mml/0 could only be replicated to 0 nodes, instead of
1336474035 NOTICE Hypertable.Master : (/root/src/hypertable/src/cc/Common/Config.cc:526) Initializing Hypertable.Master (Hypertable 0.9.5.6 (v0.9.5.6))... 

Can you please tell me how you fixed this?

Thanks :D

> > hypertable-user@googlegroups.com.

> > To unsubscribe from this group, send email to

> > hypertable-user+unsubscribe@googlegroups.com.

> > For more options, visit this group at
> > http://groups.google.com/group/hypertable-user?hl=en.
>
>
> **********************************************************
>      Assoc. Prof. Milko Todorov Marinov, PhD
>  Department of Computer Systems & Technologies
>                 University of Ruse
> 8 Studentska Str, 7017 Ruse, BULGARIA
> Tel. (+359 82) 888 356, Fax. (+359 82) 845 708
> Cell phone: (+359 88) 999 6793
> E-mail: MMar...@ecs.uni-ruse.bg
> ***********************************************************
>
> --
> You received this message because you are subscribed to the Google
> Groups "Hypertable User" group.
> To post to this group, send email to

> hypertable-user@googlegroups.com.

> To unsubscribe from this group, send email to

> hypertable-user+unsubscribe@googlegroups.com.

> For more options, visit this group at
> http://groups.google.com/group/hypertable-user?hl=en.
>

[Doug Judd]

This looks like an HDFS issue.  Are you sure all of the DataNodes are up and running?

- Doug

To view this discussion on the web visit https://groups.google.com/d/msg/hypertable-user/-/HrM7_RwN5OUJ.

To post to this group, send email to hyperta...@googlegroups.com.
To unsubscribe from this group, send email to hypertable-us...@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/hypertable-user?hl=en.

--

Doug Judd

CEO, Hypertable Inc.

[Christoph Rupp]

Hi Raghavender,

this is a really old version of hypertable. If possible then you should upgrade to a newer version.

The error you are facing is caused by hadoop, not by hypertable. The hadoop filesystem ("hdfs") fails to replicate some of the blocks because there are no nodes available. Are you running everything on a single machine? Can you check if the hdfs datanode was started?

bye
Christoph

2012/11/6 Raghavender Duddilla <raghavende...@gmail.com>

I am facing the some thing like this dont know why I am just a kid into hadoop can any one plz help me

============================================
2012-11-04 18:58:59,951 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /hadoop/mapred/system/jobtracker.info could only be replicated to 0 nodes, instead of 1
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1558)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)

        at org.apache.hadoop.ipc.Client.call(Client.java:1070)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
        at $Proxy5.addBlock(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
        at $Proxy5.addBlock(Unknown Source)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3510)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:3373)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2600(DFSClient.java:2589)
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2829)

2012-11-04 18:58:59,951 WARN org.apache.hadoop.hdfs.DFSClient: Error Recovery for block blk_-7659842609383527096_1420 bad datanode[0] nodes == null
2012-11-04 18:58:59,951 WARN org.apache.hadoop.hdfs.DFSClient: Could not get block locations. Source file "/hadoop/mapred/system/jobtracker.info" - Aborting...
2012-11-04 18:58:59,951 WARN org.apache.hadoop.mapred.JobTracker: Writing to file hdfs://ALABAMA:9000/hadoop/mapred/system/jobtracker.info failed!
                                                                                                                                                               77,1          51%

Thanks !!!
=============================================

--
You received this message because you are subscribed to the Google Groups "Hypertable User" group.

To view this discussion on the web visit https://groups.google.com/d/msg/hypertable-user/-/tk8dWHPyflkJ.