cascading.hbase

143 views
Skip to first unread message

Andrew Purtell

unread,
Jun 6, 2012, 3:44:00 AM6/6/12
to cascadi...@googlegroups.com
On cascading.hbase, this looks like it could use some attention. The
latest HBase release is 0.94.0, compatible with Hadoop 1.0.3. Any API
update for this version would also be compatible with HBase 0.92.x.
Sound good?

Best regards,

- Andy

Ken Krugler

unread,
Jun 6, 2012, 9:35:19 AM6/6/12
to cascadi...@googlegroups.com
Hi Andy,

+1 from me.

We regularly have clients ask about HBase integration with Cascading, and right now my stock answer is that I don't think it's getting much love.

Though maybe I should ask the list - who's actively using HBase with Cascading (either source or sink) and at what scale/level of satisfaction?

Thanks,

-- Ken

--------------------------
Ken Krugler
custom big data solutions & training
Hadoop, Cascading, Mahout & Solr




Oscar Boykin

unread,
Jun 6, 2012, 10:52:16 AM6/6/12
to cascadi...@googlegroups.com
There is also the maple project that has a few cascading 2.0 taps including a port of the cascading hbase tap:

https://github.com/Cascading/maple

I don't know the exact state of the hbase tap, but I know we are using it in production.
--
Oscar Boykin
@posco http://twitter.com/posco

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.

Chris K Wensel

unread,
Jun 6, 2012, 11:31:04 AM6/6/12
to cascadi...@googlegroups.com
I'm wondering if Maple should be exploded into its constituent bits so its contents are more obvious?

This is clearly more overhead, if not more useful, if done as separate projects. A bit less if as individual artifacts.

At minimum listing what's inside would be a start.. grin

and also probably deprecating the other integration projects for Maple somehow.

as an aside, can github Organizations have a page like a project does? /Cascading could probably do with one..

If not we can start a page on the .org site.

ckw

Andrew Purtell

unread,
Jun 6, 2012, 2:41:13 PM6/6/12
to cascadi...@googlegroups.com, cascadi...@googlegroups.com
I'll have a look at what's in Maple. 

    - Andy

Pranav

unread,
Jun 7, 2012, 12:11:52 PM6/7/12
to cascadi...@googlegroups.com
Im planning to use hbase as a source and was wondering if there are plans to update cascading.hbase or if the hbase tap using the new API will be contained only in cascading.maple? 

Thanks,
Pranav.

To post to this group, send email to cascading-user@googlegroups.com.
To unsubscribe from this group, send email to cascading-user+unsubscribe@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To post to this group, send email to cascading-user@googlegroups.com.
To unsubscribe from this group, send email to cascading-user+unsubscribe@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.


--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To post to this group, send email to cascading-user@googlegroups.com.
To unsubscribe from this group, send email to cascading-user+unsubscribe@googlegroups.com.

Andrew Purtell

unread,
Jun 7, 2012, 10:57:12 PM6/7/12
to cascadi...@googlegroups.com, cascadi...@googlegroups.com
I got the sense the notion is to maintain it in cascading.maple and deprecate/drop the separate module. 

    - Andy
To view this discussion on the web visit https://groups.google.com/d/msg/cascading-user/-/HnFfBTtgFfYJ.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.

Oscar Boykin

unread,
Jun 8, 2012, 12:17:45 AM6/8/12
to cascadi...@googlegroups.com
By the way, not to take away from the mystery, but maple was just an
effort between the scalding (Argyris and I) and cascalog (Sam and
Nathan) guys to share some common taps and only have to publish one
jar each time cascading wips were updated.

We use maple in production, so we are going to be keeping it running
and adding features as we need them, but I can't really speak to what
else might happen with the cascading.hbase tap (we just didn't have
commit access and knew we were going to add 3-4 more taps to maple, so
we just made a new project).
>> To post to this group, send email to cascadi...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> cascading-use...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/cascading-user?hl=en.
>>
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "cascading-user" group.
>> To post to this group, send email to cascadi...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> cascading-use...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/cascading-user?hl=en.
>>
>>
>> --
>> Chris K Wensel
>> ch...@concurrentinc.com
>> http://concurrentinc.com
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "cascading-user" group.
>> To post to this group, send email to cascadi...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> cascading-use...@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/cascading-user?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "cascading-user" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/cascading-user/-/HnFfBTtgFfYJ.
> To post to this group, send email to cascadi...@googlegroups.com.
> To unsubscribe from this group, send email to
> cascading-use...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/cascading-user?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "cascading-user" group.
> To post to this group, send email to cascadi...@googlegroups.com.
> To unsubscribe from this group, send email to
> cascading-use...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/cascading-user?hl=en.



--
Oscar Boykin :: @posco :: https://twitter.com/intent/user?screen_name=posco

Nick Dimiduk

unread,
Jun 8, 2012, 2:25:43 AM6/8/12
to cascadi...@googlegroups.com
Has anyone tried/ported Maple with HBase 0.92.x yet? I'd like to write about HBase/Cascading integration for HBase in Action but we're targeting the later release.

Thanks,
-Nick

Pranav

unread,
Jul 21, 2012, 6:14:58 AM7/21/12
to cascadi...@googlegroups.com
Ive tried Maple with HBase 0.92.1. It works, but its pretty raw. For example, it does not support getting all column names for a column family. All column names have to be specified when creating the scheme. 
-Nick

>> To post to this group, send email to cascading-user@googlegroups.com.

>> To unsubscribe from this group, send email to

>> For more options, visit this group at
>> http://groups.google.com/group/cascading-user?hl=en.
>>
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "cascading-user" group.
>> To post to this group, send email to cascading-user@googlegroups.com.

>> To unsubscribe from this group, send email to

>> For more options, visit this group at
>> http://groups.google.com/group/cascading-user?hl=en.
>>
>>
>> --
>> Chris K Wensel
>> ch...@concurrentinc.com
>> http://concurrentinc.com
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "cascading-user" group.
>> To post to this group, send email to cascading-user@googlegroups.com.

>> To unsubscribe from this group, send email to

>> For more options, visit this group at
>> http://groups.google.com/group/cascading-user?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "cascading-user" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/cascading-user/-/HnFfBTtgFfYJ.
> To post to this group, send email to cascading-user@googlegroups.com.

> To unsubscribe from this group, send email to

> For more options, visit this group at
> http://groups.google.com/group/cascading-user?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups
> "cascading-user" group.
> To post to this group, send email to cascading-user@googlegroups.com.

> To unsubscribe from this group, send email to

> For more options, visit this group at
> http://groups.google.com/group/cascading-user?hl=en.




--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To post to this group, send email to cascading-user@googlegroups.com.
To unsubscribe from this group, send email to cascading-user+unsubscribe@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages