Writing HFiles

[gc1888]

Hey Guys,

Is there any examples of a Scheme +  Tap that writes HFiles from a cascading flow?

Thanks,

GC.

[Chris K Wensel]

I don’t see anything on the extensions list.

Though a google search landed me on this

https://github.com/kijiproject/kiji-express

https://github.com/kijiproject/kiji-express/blob/master/kiji-express/src/main/scala/org/kiji/express/flow/framework/hfile/HFileKijiScheme.scala

ckw

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/87884515-40a0-4b4c-8d26-8aab0fa8cb17%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

—

Chris K Wensel

ch...@wensel.net

[gc1888]

I was able to do this by modifying the HFileoutFormat2 to work with the hadoop.mapred library. I then just created a custom Scheme specifying this the output format as HFileoutFormat2.