Read a gziped HIVE table in scalding

[Jing Lu]

Dear Scala Community,

I have a gziped HIVE table and want to read from scalding. The file path looks like this /hive/my.db/mytable/partition=1/part-xxxxx-c000.gz

Is there a standard way to do that for TypedPipe?

Thanks

[Alex Levenson]

Hello,

Not that I know of. If you can find a cascading Tap/Scheme that understands that file format, or a hadoop InputFormat, then you could start gluing together the layers required (Hadoop InputFormat -> cascading Tap -> Scalding Source).

It can be a bit of a pain however to get all those layers together.

Alex

--
You received this message because you are subscribed to the Google Groups "Scalding Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scalding-dev...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/scalding-dev/7b9c705a-e78f-4261-8669-e614b6ec0161%40googlegroups.com.

--

Alex Levenson

@THISWILLWORK