Split Size

[patrick...@gmail.com]

In the table view, hannibal shows my split size at about 250MB, and almost all my regions are well above that. I thought that this was showing hbase.hregion.max.filesize, but looking at the dump of hmaster configs (http://hmaster/dump), I see it as 1GB:
<property><name>hbase.hregion.max.filesize</name><value>1073741824</value><source>hbase-default.xml</source></property>

Am I wrong about what "Split Size" is?

Thanks,
Patrick

[Nils Kübler]

Hi Patrick,

The "Split Size" is retrieved via `HTableDescriptor.getMaxFileSize()`.
Did you set an exlicit maxfilesize for the table?
To test this you can enter `describe <tablename>` in the hbase shell and then look for 'MAX_FILESIZE'.

Nils

[Patrick Schless]

Nope, we haven't set an explicit max filesize. Here's the describe:

hbase(main):001:0> describe 'data'
DESCRIPTION                                                                                                                         ENABLED                                                                
 {NAME => 'data', DEFERRED_LOG_FLUSH => 'true', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '1', COMPRESSION => 'SNAPPY', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'
 }]}

true                                                                                                                                                                                              

1 row(s) in 0.8480 seconds

--
You received this message because you are subscribed to a topic in the Google Groups "Hannibal developers & users mailing list" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/hannibal-app/08FD2RD95BQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to hannibal-app...@googlegroups.com.
To post to this group, send email to hannib...@googlegroups.com.
Visit this group at http://groups.google.com/group/hannibal-app.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Nils Kübler]

That's weird.

I just took a look at the HBase source and it seems that if there isn't set an explicit MAX_FILESIZE for the table, indeed 'hbase.hregion.max.filesize' is returned. Could it be possible that this value is read from the client's configuration, not from the HMaster?

I know that's not a great solution, but can you try to set:
<property><name>hbase.hregion.max.filesize</name><value>1073741824</value></property>
in Hannibal's hbase-site.xml to and see what happens?

Thanks
Nils

[Patrick Schless]

Should I have all the hadoop/hmaster configs on the hannibal box? currently I have none (it's a single-purpose VM)

[Nils Kübler]

the hbase-site.xml should be enough. Does this solve your issue?

[Jean-Pierre König]

Hi,

Would you mind writing a recommendation of Hannibal on LinkedIn? http://www.linkedin.com/company/ymc-ag/hannibal-23310691/product?goback=%2Enmp_*1_*1_*1_*1_*1_*1_*1_*1_*1_*1%2Ebzp_*1_*1_*1_*1_*1_*1_*1_*1_*1_*1_ymc*5ag&trk=biz_product

Sincerely,

Jean-Pierre Koenig