Error producing to topics

[Stuart Wong]

Hey all,

Running into an issue with one of our Kafka Brokers and am hoping someone can provide some insight. We've got a 3-node ZooKeeper ensemble supporting a 3-node Kafka Broker setup with no CPU, memory or file system issues that we can see. When we try to produce to any topic (using the console producer in the extract below) we get:

[2016-03-14 15:28:34,351] ERROR Error when sending message to topic cor.support.test.incoming with key: null, value: 6 bytes with error: Failed to update metadata after 60000 ms. (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)

There's nothing in any of the logs though (i.e. ZooKeeper, or Kafka) that we can see. The only thing in ZooKeeper is the regular:

2016-03-14 15:33:25,972 WARN  [myid:1] [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception

EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket

at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)

at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)

at java.lang.Thread.run(Thread.java:745)

I appreciate any thoughts on this error and/or situation, thanks in advance.

[Stuart Wong]

Well this is quite embarrassing. I was using the wrong port to produce. Using the correct port made things worked (no surprise there).

Thanks.

[Peter Davis]

We just encountered the same problem.  The error message could really use some improvement here.  Would have saved an hour of head-banging :-)

-Peter

[lovecas...@gmail.com]

Is this problem solved? I have met! Thank you!

在 2016年3月14日星期一 UTC+8下午11:35:10，Stuart Wong写道：

[shamim Wilson]

I am facing the same issue. I verified the host and port and they seems to be fine. not sure what am I missing

[Tushar Sudhakar Jee]

Even I have a similar unresolved error raised in a different post:

https://groups.google.com/forum/#!topic/confluent-platform/WeOPP9jVHI0

Any help would be appreciated.

Thanks,

Tushar

[Afsar Alam]

Hi

Probably you are using localhost:9092 in kafka-producer command.Once verify whether in server.properties is listeners=PLAINTEXT://0.0.0.0:9092 or your node IP. If its IP then use your ip in kafka-producer command.

https://stackoverflow.com/questions/38457706/error-error-when-sending-message-to-topic/45421233#45421233

If it does not help,send your server.properties file.

Thanks 

Afsar

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ab4e090-e5a1-4a8e-9e52-4c9b9d27b03d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Tushar Sudhakar Jee]

Hi Afsar,

I used IP in my server.properties.

Its as attached.

Also,

The kafka producer script uses the entire broker list in a format as below:

broker_list=10.0.7.48:9092,10.0.7.217:9092,10.0.10.232:9092,10.0.10.26:9092,10.0.9.159:9092,10.0.1.159:9092,10.0.5 .231:9092,10.0.5.124:9092,10.0.10.247:9092,10.0.11.15:9092,10.0.1.229:9092,10.0.6.169:9092

Thanks.

Tushar

On Wednesday, August 9, 2017 at 9:51:31 PM UTC-7, Afsar Alam wrote:

Hi

Probably you are using localhost:9092 in kafka-producer command.Once verify whether in server.properties is listeners=PLAINTEXT://0.0.0.0:9092 or your node IP. If its IP then use your ip in kafka-producer command.

https://stackoverflow.com/questions/38457706/error-error-when-sending-message-to-topic/45421233#45421233

If it does not help,send your server.properties file.

Thanks 

Afsar

On Mon, Feb 27, 2017 at 11:25 AM, <lovecas...@gmail.com> wrote:

Is this problem solved? I have met! Thank you!

在 2016年3月14日星期一 UTC+8下午11:35:10，Stuart Wong写道：

Hey all,

Running into an issue with one of our Kafka Brokers and am hoping someone can provide some insight. We've got a 3-node ZooKeeper ensemble supporting a 3-node Kafka Broker setup with no CPU, memory or file system issues that we can see. When we try to produce to any topic (using the console producer in the extract below) we get:

[2016-03-14 15:28:34,351] ERROR Error when sending message to topic cor.support.test.incoming with key: null, value: 6 bytes with error: Failed to update metadata after 60000 ms. (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)

There's nothing in any of the logs though (i.e. ZooKeeper, or Kafka) that we can see. The only thing in ZooKeeper is the regular:

2016-03-14 15:33:25,972 WARN  [myid:1] [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception

EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket

at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)

at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)

at java.lang.Thread.run(Thread.java:745)

I appreciate any thoughts on this error and/or situation, thanks in advance.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

[Afsar Alam]

Hi Tushar,

In the provided server.properties there is only one zookeeper info is provided,as you have 3 nodes,you should add all three zookeepers.

By the way,this also should work if that zookeeper is running.

Can you attach all  three zoo.cfg and three kafkas' server.properties?

It will be helpful to sort out.

Regards

Afsar Alam

Hi Afsar,

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ab4e090-e5a1-4a8e-9e52-4c9b9d27b03d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6e30ae4c-76d1-4536-93a5-75824e39e8ee%40googlegroups.com.

[Tushar Sudhakar Jee]

Hi,

1.What do you mean by three kafkas' server.properties or 3 nodes?

I have 9 brokers on different VMs and they have the same server.properties except the brokerid and listeners configuration.
Thanks,

Tushar

Hi Afsar,

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ab4e090-e5a1-4a8e-9e52-4c9b9d27b03d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

[Afsar Alam]

Hi Tushar,

If you can share your all zoo.cfg(zookeeper) files and server.properties files , it will be helpful and I shall point the issue.

In the attached server.properties there is only one zookeeper which is  being pointed by your kafka broker.

If I am not wrong you are  using multi zookeeper in cluster to take care all your  kafka brokers.

Regards

Afsar Alam

Hi Afsar,

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ab4e090-e5a1-4a8e-9e52-4c9b9d27b03d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsubscribe@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6e30ae4c-76d1-4536-93a5-75824e39e8ee%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/b575fba7-2a2e-4cb8-b3a9-14f71ab0f00d%40googlegroups.com.

[Tushar Sudhakar Jee]

Afsar,

Currently in the discussed setup what difference would having multiple zookeepers make ?

I am presently using only one zookeeper for the broker cluster. 

The zookeeper.properties only has dataDir  mentioned.

Thank you,

Tushar

Hi Afsar,

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/3ab4e090-e5a1-4a8e-9e52-4c9b9d27b03d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.

To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/6e30ae4c-76d1-4536-93a5-75824e39e8ee%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.

To post to this group, send email to confluent...@googlegroups.com.