Kafka SFTP Source Connector

986 views
Skip to first unread message

spro...@colorado.edu

unread,
Sep 14, 2017, 1:36:07 PM9/14/17
to Confluent Platform
Hello,

We have a need to hook into an SFTP server with a Kafka source connector. However the established Confluent ecosystem seems to only have good support for an FTP connector, which doesn't satisfy our security needs.

I just want to make sure we're not missing something obvious, is our only option at this point to develop our own SFTP connector, assuming we'd rather write our own than use one of the few unmaintained and unsupported open-source SFTP connector implementations floating around?

Thank you,
Spencer

Randall Hauch

unread,
Sep 14, 2017, 5:52:57 PM9/14/17
to confluent...@googlegroups.com
Even though https://www.confluent.io/product/connectors/ only has one row, there are actually two links in that row to:


You can always implement your own connector, but you might consider first looking at both of them and maybe talking to one or both of the communities to see if they're also interested in SFTP support. Just my $0.02.

Best regards,

Randall

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/e0d5577a-9d1b-4a8c-a5f2-66ba42644f1e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

spro...@colorado.edu

unread,
Oct 4, 2017, 4:21:18 PM10/4/17
to Confluent Platform
Belated thanks for the reply! We're trying to roll our own for now but hopefully we can get an implementation into the community.


On Thursday, September 14, 2017 at 3:52:57 PM UTC-6, Randall Hauch wrote:
Even though https://www.confluent.io/product/connectors/ only has one row, there are actually two links in that row to:


You can always implement your own connector, but you might consider first looking at both of them and maybe talking to one or both of the communities to see if they're also interested in SFTP support. Just my $0.02.

Best regards,

Randall
On Thu, Sep 14, 2017 at 12:36 PM, <spro...@colorado.edu> wrote:
Hello,

We have a need to hook into an SFTP server with a Kafka source connector. However the established Confluent ecosystem seems to only have good support for an FTP connector, which doesn't satisfy our security needs.

I just want to make sure we're not missing something obvious, is our only option at this point to develop our own SFTP connector, assuming we'd rather write our own than use one of the few unmaintained and unsupported open-source SFTP connector implementations floating around?

Thank you,
Spencer

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

Randall Hauch

unread,
Oct 5, 2017, 2:24:17 PM10/5/17
to confluent...@googlegroups.com
That'd be great to put it into the community. Be sure to let us know how it goes!

On Wed, Oct 4, 2017 at 3:21 PM, <spro...@colorado.edu> wrote:
Belated thanks for the reply! We're trying to roll our own for now but hopefully we can get an implementation into the community.

On Thursday, September 14, 2017 at 3:52:57 PM UTC-6, Randall Hauch wrote:
Even though https://www.confluent.io/product/connectors/ only has one row, there are actually two links in that row to:


You can always implement your own connector, but you might consider first looking at both of them and maybe talking to one or both of the communities to see if they're also interested in SFTP support. Just my $0.02.

Best regards,

Randall
On Thu, Sep 14, 2017 at 12:36 PM, <spro...@colorado.edu> wrote:
Hello,

We have a need to hook into an SFTP server with a Kafka source connector. However the established Confluent ecosystem seems to only have good support for an FTP connector, which doesn't satisfy our security needs.

I just want to make sure we're not missing something obvious, is our only option at this point to develop our own SFTP connector, assuming we'd rather write our own than use one of the few unmaintained and unsupported open-source SFTP connector implementations floating around?

Thank you,
Spencer

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/1261e84c-f39d-4c70-8098-9e698fce0571%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages