Re: Configure AWS Load balancer with Kafka Cluster

[Ewen Cheslack-Postava]

If you're using the new producer, you should not need access to zookeeper.

Can you give more details about the commands you are running, error messages, logs, etc?

-Ewen

On Mon, May 1, 2017 at 11:48 PM, Krishna Marupudi <marupudi...@gmail.com> wrote:

I have a 3 node zookeeper and 3 node kafka cluster , configured a internal load balancer and attached the kafka cluster, not able to publish messages to the topic 

things i have tried 

1. tried a internal load balancer with zookeeper and kafka (running on the same instance) which worked ok

2. thinking that the producer needs to communicate with the zookeeper , tired to add zookeeper cluster(not sure if this is correct) to the same load balancer but failed as i am not able to add 2181 port to the health checks of load balancer

Could anyone point me in right direction please . i have attached a screenshot of health check and instances status

Thank You

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/a6132c2e-1888-4721-bc43-3e003c64dfcc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Roger Hoover]

Also, I think you'll need a separate ELB for each broker b/c Kafka clients need direct connections to each broker.  They cannot be randomly load balanced.

On Tue, May 2, 2017 at 11:35 PM, Ewen Cheslack-Postava <ew...@confluent.io> wrote:

If you're using the new producer, you should not need access to zookeeper.

Can you give more details about the commands you are running, error messages, logs, etc?

-Ewen

On Mon, May 1, 2017 at 11:48 PM, Krishna Marupudi <marupudi...@gmail.com> wrote:

I have a 3 node zookeeper and 3 node kafka cluster , configured a internal load balancer and attached the kafka cluster, not able to publish messages to the topic 

things i have tried 

1. tried a internal load balancer with zookeeper and kafka (running on the same instance) which worked ok

2. thinking that the producer needs to communicate with the zookeeper , tired to add zookeeper cluster(not sure if this is correct) to the same load balancer but failed as i am not able to add 2181 port to the health checks of load balancer

Could anyone point me in right direction please . i have attached a screenshot of health check and instances status

Thank You

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.

To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/a6132c2e-1888-4721-bc43-3e003c64dfcc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAE1jLMP%2BhrKzBuPkgf3vuN9WqapsAHPnDvYsWqHM0C23sBYBuw%40mail.gmail.com.