kafka ingestion, how to add encryption and decryption?

52 views
Skip to first unread message

Ellen Shen

unread,
Aug 10, 2022, 1:36:55 PM8/10/22
to Druid User
kafka ingestion, how to add encryption and decryption?
anyone has the experience? Thanks! 
 

Mark Herrera

unread,
Aug 10, 2022, 2:51:54 PM8/10/22
to Druid User
I came across this discussion from last year in the ASF channel. The OP needed:

> to import SSL certificates (Root CA and Sub CA) for a remote kafka cluster that uses a private CA. Any ideas on how SSL certs can be imported into Druid?

The recommendation was to pass consumer properties like `ssl.truststore.location`, along with this reference.

Does any of that help?

Ellen Shen

unread,
Aug 10, 2022, 3:53:11 PM8/10/22
to druid...@googlegroups.com
Mark: 
Thank you for help. 
My question is actually could I find an existing, stable, popular SerDe like this
my kafka producer side can use it serialize it, and then I can easily config it on druid kafka consumer side to decrypt it. 
currently, druid's UI does take file as kafka parameter for certs encr/decr, this means if i use a cert in this process, those certs have to be deployed in every ingestion node(per my understanding). this is another challenge. 

Ellen 

--
You received this message because you are subscribed to a topic in the Google Groups "Druid User" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/druid-user/9gXDp8u0NGw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to druid-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/7c2253a5-4dda-4153-913c-96bdfc289e54n%40googlegroups.com.

Ellen Shen

unread,
Aug 10, 2022, 7:51:49 PM8/10/22
to druid...@googlegroups.com
mark: 
how imply do differently from druid on kafka ingestion which has to deal with encryption? 

Reply all
Reply to author
Forward
0 new messages