ORC Reader Input Plugin

33 views
Skip to first unread message

Sudheer Gajula

unread,
Dec 16, 2021, 11:04:37 AM12/16/21
to CDAP User
Hi Team,

Our datasets are mostly on ORC file formats, and there is only Sink plugin for ORC to persist data, Source/input plugin isn't readily available in current develop branch of hydrator. 

Is the plugin available for reading ORC files?

Thanks
Sudheer

Sagar Kapare

unread,
Dec 16, 2021, 12:19:30 PM12/16/21
to CDAP User
Hi Sudheer,

Yes. Your observation is correct! We do not have ORC source plugins at the moment. 
There is open bug to support this already - https://cdap.atlassian.net/browse/PLUGIN-278


Thanks and Regards,
Sagar 

Sudheer Gajula

unread,
Dec 16, 2021, 12:31:03 PM12/16/21
to CDAP User
Hi Sagar,

We are in process of building one for reading, which uses OrcRecordReader to read the records and TypeDescription to derive schema to build StructuredRecord.

Do we have any channel to contribute back at this point?

Thanks
Sudheer

Reply all
Reply to author
Forward
0 new messages