How to shutdown or pause a Kafka connect cluster

[Andrew Stevenson]

Hi Guys,

I see Connect has a Rest for creating and updating connectors/task and sinks but how can I shut down a cluster? What I'd like is a rest call to pause and shutdown. I know consumer has pause functionality. 

Thanks

Andrew

[Alex Loddengaard]

Hi Andrew,

You can stop a specific connector by deleting the connector using the REST API [1]. You would need to make this REST call for every connector. If you have a lot of connectors running, you could write a little script that fetches the list of connectors [2] and deletes them one at a time, in a loop.

Or, more extreme, you could kill all worker processes from the command line. Then, to start Connect again, you'll need to restart worker processes and then re-create the connectors using the REST API.

I hope this answers your question.

Alex

[1] http://docs.confluent.io/2.0.0/connect/userguide.html#delete--connectors-(string-name)-

[2] http://docs.confluent.io/2.0.0/connect/userguide.html#get--connectors

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/96c91ca8-8ace-4f78-ad3a-6cc166fb6007%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Alex Loddengaard | Solutions Architect | Confluent

Download Apache Kafka and Confluent Platform: www.confluent.io/download

[Ewen Cheslack-Postava]

Pause/resume for connectors and tasks is planned, but didn't make it into the first release. If you want to you, can track progress on the feature here: https://issues.apache.org/jira/browse/KAFKA-2370

-Ewen

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CACyXnoduCM61hoLW0WGzoRM-ijXdVFcg%2B4FS2Kkms3MjZGvC%2Bw%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Thanks,
Ewen