Reading HDFS files to ingest into RDBMS

12 views

Skip to first unread message

Latha P

unread,

Feb 7, 2022, 2:44:15 AM2/7/22

to sdc-user

Hi,

I am looking help if we can read HDFS files and ingest into RDBMS table using streamsets.

I tried hadoop fs origin to read files but wasn't successful in reading the comma delimited files. Please help me with any resources that can help . we are using version 3.2

--Latha

Alejandro Abdelnur

unread,

Feb 7, 2022, 3:18:59 AM2/7/22

to Latha P, sdc-user

Hi Latha,

In order to be able to help you'll have to be a bit more specific.

* Are you using a StreamSets Hadoop stage library that matches the version of your Hadoop HDFS cluster?

* Is your StreamSets HDFS stage able to connect to the Hadoop cluster when verifying the configuration?

* Are you getting any specific parsing error?

Also, note that you are using a version of StreamSets that is quite old.

thanks.

--
You received this message because you are subscribed to the Google Groups "sdc-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sdc-user+u...@streamsets.com.
To view this discussion on the web visit https://groups.google.com/a/streamsets.com/d/msgid/sdc-user/6511cef6-6c00-4897-9ed3-af0eb6cc7409n%40streamsets.com.