Trying to configure Secor with AWS MSK Connect

[Eric Siu]

Hi there,

I am trying to configure Secor to work with AWS MSK Connect. I've been following the instructions listed here:

https://docs.aws.amazon.com/msk/latest/developerguide/msk-connect-connectors.html

I've compiled Secor locally to create a JAR file and uploaded that to an S3 bucket. And linked the connector to that specific JAR file.

As part of the creating the connector, I have to set up some connector configurations. While some of the configurations are optional and some I can figure out, there's some I don't really know. Specifically one mandatory connector configurations is called the connector.class.

I don't really know what that field means for Secor. Would you happen to know more details on this?

Also this may be a more generic question, but can Secor actually be set up and configured to work on AWS MSK Connectors?

Thanks

[hc...@pinterest.com]

I am not sure whether secor supports MSK connector, there needs to a java class implements MSK's Connector interface.

[shourya solanki]

Hi there,

I am trying to set up the secor for aws msk the helm runs fine, but the pod/secor-0 goes into crash loop.

I checked for the logs so what i get is ZOOKEEPER_QUORUM variable not set, launch with -e ZOOKEEPER_QUORUM=zookeeper:2181.

I have set the variable within the configurations.

Please help me with this issue.

Thanks 

[hc...@pinterest.com]

Do you have a host called 'zookeeper'?  this config expects a zookeeper quorum string, such as 

host1:2181/testkafka