How to provide Kafka credentials when security protocol is SASL_SSL

[Adrian Gay]

Hi, I'm struggling connecting Druid 0.15 to a Kafka cluster which  authenticates using security protocol SASL_SSL, ie. truststore & password plus username & password. The Druid Simple SSLContext Provider Module documentation doesn't explain how to do this. Any/all suggestions welcome! Thanks :)

[Vaibhav Vaibhav]

 Hi Adrian gay,

I think you can specify the above details in the Kafka consumer property of the Kafka supervisor specs :

A map of properties to be passed to the Kafka consumer. This must contain a property bootstrap.servers with a list of Kafka brokers in the form: <BROKER_1>:<PORT_1>,<BROKER_2>:<PORT_2>,...

For SSL connections, the keystore, truststore and key passwords can be provided as a Password Provider or String password.

https://druid.apache.org/docs/latest/development/extensions-core/kafka-ingestion.html

https://druid.apache.org/docs/latest/operations/password-provider.html

eg :

  },
  "ioConfig": {
    "topic": "TOPIC_NAME",
    "replicas": 1,
    "taskCount": 9,
    "taskDuration": "PT3600S",
    "consumerProperties": {
      "ssl.keystore.location": "<KEYSTORE PATH>/keystoreFile.jks",
      "ssl.key.password": "$PassWord",
      "bootstrap.servers": "<SERVER>:<PORT>",
      "security.protocol": "SSL",
      "ssl.truststore.location": "<TRUSTSTORE PATH>/truststoreFile.jks",
      "ssl.keystore.password": "PassWord",
      "ssl.truststore.password": "PassWord"
    },

Hope this helps.

Thanks and Regards,

Vaibhav

On Sun, Sep 22, 2019 at 11:44 PM 'Adrian Gay' via Druid User <druid...@googlegroups.com> wrote:

Hi, I'm struggling connecting Druid 0.15 to a Kafka cluster which  authenticates using security protocol SASL_SSL, ie. truststore & password plus username & password. The Druid Simple SSLContext Provider Module documentation doesn't explain how to do this. Any/all suggestions welcome! Thanks :)

--
You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/8ff64b8c-c446-476b-95fd-37c65f37bd4e%40googlegroups.com.

[Adrian Gay]

@Vaibhav

thanks, thats exactly what I needed!

Adrian

[Vaibhav Vaibhav]

Glad to know that @Adrian !!👍.

Thanks and Regards,

Vaibhav

--

You received this message because you are subscribed to the Google Groups "Druid User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-user+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/druid-user/d5aa8b47-0f03-4287-96f7-40c18ed69c55%40googlegroups.com.

[SAMRAKSHINI R S]

Is the KEYSTORE_PATH local path or HTTPS path?

To unsubscribe from this group and stop receiving emails from it, send an email to druid...@googlegroups.com.