FTP Tap

79 views
Skip to first unread message

Federico Brubacher

unread,
Jun 4, 2012, 9:37:34 AM6/4/12
to cascadi...@googlegroups.com
Has anyone know if there is an FTP tap ? Or has anyone tried to create one ? I'm interested in the possibility of creating one if not.

Best
Fede

--
Federico Brubacher
@fbru02

Ken Krugler

unread,
Jun 4, 2012, 9:55:36 AM6/4/12
to cascadi...@googlegroups.com
On Jun 4, 2012, at 6:37am, Federico Brubacher wrote:

Has anyone know if there is an FTP tap ? Or has anyone tried to create one ? I'm interested in the possibility of creating one if not.

Theoretically you could use the Hfs tap and an ftp:// protocol, and under the hood Hadoop would use the FTPFileSystem.

However in our experience the FTPFileSystem has problems - we spent about a week trying to get it to reliably work with an FTP server, and eventually gave up.

-- Ken

--------------------------
Ken Krugler
custom big data solutions & training
Hadoop, Cascading, Mahout & Solr




Reply all
Reply to author
Forward
0 new messages