Using HBaseWD with Thrift

[Alex Baranau]

RE using HBaseWD with Thrift (changed subject for this part of the thread to be about Thrift).

There's currently no ports to any of the scripting languages (like Python and such). I've added an issue to HBaseWD [1], but I can't promise it will get attention from me, as I'm mostly using Java in the development of the systems..

If you want to work on this, I will be happy to provide any guidance.

Alex Baranau

------

Sematext :: http://sematext.com/ :: Hadoop - HBase - ElasticSearch - Solr

[1] https://github.com/sematext/HBaseWD/issues/16

On Fri, Aug 3, 2012 at 12:44 PM, syed kather <in.a...@gmail.com> wrote:

Team,
   How to do Pre splitting  for HBase table . As i mention in the earlier mail that my rowkey is followed by incremental sequence


when i had created a table like give below . I had notice the startkey and endkey is looking like that

bin/hbase org.apache.hadoop.hbase.util.RegionSplitter ObjectSequence4 -c 3 -f SequenceFamily:ObjectArray:UserArray

Name	Region Server	Start Key	End Key	Requests
ObjectSequence4,,1344011081570.941ae89b0c729c924b80d8cf8b8fa4b8.	slave1:60030		2aaaaaaa	31670
ObjectSequence4,2aaaaaaa,1344011081570.f4c5647be69af33116fc214f913bb312.	slave2:60030	2aaaaaaa	55555554	0
ObjectSequence4,55555554,1344011081570.e5bc298b6915f2b9c42bb28e31c8e640.	master:60030	55555554		0

 Sorry if the question is so simple . I searched in net but i couldnt able to find right one

 Other than that i have another doubt
  I am calling the incrementColumnValue from ThriftAPI . How to call this custom incrementColumnValue   function from ThriftAPI and as i know that 

RowKeyDistributorByOneBytePrefix keyDistributor = new RowKeyDistributorByOneBytePrefix(bucketsCount);

we need to initialize this object only at the begining . I dont have idea how to do that

Now my IncrementColumnValue function looks like

public byte[] incrementColumnValue(final byte[] row, RowKeyDistributorByOneBytePrefix keyDistributor,final byte[] family, final byte[] qualifier, final long amount, boolean writeToWAL, byte bucketsCount) throws IOException
    {
        byte[] key=keyDistributor.getDistributedKey(Bytes.toBytes(incrementColumnValue(keyDistributor.getOriginalKey(row), family, qualifier, amount, true)));
        return key;

    }

[syed kather]

Hi Alex,
    Thanks for your response ..
     Yes  I would like to work on this .Let me know the process .

Thanks and regards
Syed Abdul kather
send from Samsung S3

[syed kather]

As i had disucussed in this earlier mail . I am very much interested to contribute .. i will further update you once it started working .. this is my first contribution too. Let me know is there any process i need to follow

Syed Abdul kather
send from Samsung S3

[Alex Baranau]

That would be really great. There's no formal process: just fork the sources, add needed code and when ready, create a pool request thru github.

But first I think we should may be discuss what is the plan (in the comments at: https://github.com/sematext/HBaseWD/issues/16). I.e. how do you see it's going to be implemented. Just added small comment there. 

Thank you!

Alex Baranau

------

Sematext :: http://sematext.com/ :: Hadoop - HBase - ElasticSearch - Solr

--

Alex Baranau

------

Sematext :: http://blog.sematext.com/ :: Hadoop - HBase - ElasticSearch - Solr