Re: Reading GS files

[Chris K Wensel]

If Hadoop supports gs:// then Cascading supports it. Just know the support may not ship native in Hadoop, but may need to be added to your project or cluster.

See: https://cloud.google.com/dataproc/docs/concepts/connectors/cloud-storage

If you want to access gs:// from Cascading Local mode, you need to use the cascading.tap.local.hadoop.LocalHfsAdaptor class in Cascading 4.

On Oct 18, 2019, at 2:33 AM, Gajendra Dadheech <gajj...@gmail.com> wrote:

Hi

Is there any open source library or existing functionality which allows me to read Google Storage Files [prefixed with gs, e.g. gs://test]

Using HFS thows exception.

Thank you.

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/d8e1ddf5-be8d-4a3f-8a59-18bf8bc114d2%40googlegroups.com.

—

Chris K Wensel

ch...@wensel.net