3.19.0 - Streamsets Kafka Consumer to Confluent Kafka

16 views
Skip to first unread message

Michael Tod

unread,
Jul 11, 2022, 12:00:26 PM7/11/22
to sdc-user
I'm trying to connect to Confluent Kafka on Streamsets version 3.19.0 I keep receiving this error 
KAFKA_14 - Security properties should be specified in the Security tab, not in the Kafka properties

In the Security Tab there does not seem to be an option to use the sasl.jaas.config API-Key approach. Everything seems to require a truststore etc. 

When using 3.18.2 Streamsets I was able to use the Kafka Config for all the connection info.

Example: 
[
    {
        "key": "ssl.endpoint.identification.algorithm",
        "value": "https"
    },
    {
        "key": "sasl.mechanism",
        "value": "PLAIN"
    },
    {
        "key": "request.timeout.ms",
        "value": "20000"
    },
    {
        "key": "retry.backoff.ms",
        "value": "500"
    },
    {
        "key": "sasl.jaas.config",
        "value": "org.apache.kafka.common.security.plain.PlainLoginModule required username=\"xxxxxxxxxxxxxxxx\" password=\"xxxxxxxxxxxxxxxxxxxxx\";"
    },
    {
        "key": "security.protocol",
        "value": "SASL_SSL"
    },
    {
        "key": "basic.auth.credentials.source",
        "value": "USER_INFO"
    },
    {
        "key": "acks",
        "value": "all"
    },
    {
        "key": "connections.max.idle.ms",
        "value": "60000"
    },
    {
        "key": "metadata.max.age.ms",
        "value": "60000"
    },
    {
        "key": "client.id",
        "value": "dev.ea.mytestapp.arvo.18"
    }
]
Reply all
Reply to author
Forward
0 new messages