Reading HDFS files to ingest into RDBMS

9 views
Skip to first unread message

Latha P

unread,
Feb 7, 2022, 2:44:15 AMFeb 7
to sdc-user
Hi,

I am looking help if we can read HDFS files and ingest into RDBMS table using streamsets.
I tried hadoop fs origin to read files but wasn't successful in reading the comma delimited files. Please help me with any resources that can help . we are using version 3.2
--Latha

Alejandro Abdelnur

unread,
Feb 7, 2022, 3:18:59 AMFeb 7
to Latha P, sdc-user
Hi Latha,

In order to be able to help you'll have to be a bit more specific.

* Are you using a StreamSets Hadoop stage library that matches the version of your Hadoop HDFS cluster?
* Is your StreamSets HDFS stage able to connect to the Hadoop cluster when verifying the configuration?
* Are you getting any specific parsing error?

Also, note that you are using a version of StreamSets that is quite old.

thanks.

--
You received this message because you are subscribed to the Google Groups "sdc-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sdc-user+u...@streamsets.com.
To view this discussion on the web visit https://groups.google.com/a/streamsets.com/d/msgid/sdc-user/6511cef6-6c00-4897-9ed3-af0eb6cc7409n%40streamsets.com.


--
Alejandro
Reply all
Reply to author
Forward
0 new messages