Kafka rest proxy publish request resulting in Java OOM Exception

251 views
Skip to first unread message

SJ

unread,
Nov 23, 2017, 2:30:07 AM11/23/17
to Confluent Platform
Hi confluent community

When i am using below curl request
curl -X POST -H "Content-Type: application/vnd.kafka.json.v2+json"       -H "Accept: application/vnd.kafka.v2+json"       --data '{"records":[{"value":{"foo":"bar"}}]}' "http://ansible-centos-1:8082/topics/k2data"

It results into below error
{"offsets":[{"partition":null,"offset":null,"error_code":50003,"error":"Failed to update metadata after 60000 ms."}],"key_schema_id":null,"value_schema_id":null}

When checked the logs of kafka rest proxy

org.eclipse.jetty.http.HttpParser$IllegalCharacterException: Illegal character 0x0
        at org.eclipse.jetty.http.HttpParser.next(HttpParser.java:398)
        at org.eclipse.jetty.http.HttpParser.quickStart(HttpParser.java:436)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:1216)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:250)
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:748)
[2017-11-23 06:15:40,525] ERROR Uncaught exception in kafka-producer-network-thread | producer-2:  (org.apache.kafka.common.utils.KafkaThread:43)
java.lang.OutOfMemoryError: Java heap space
        at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
        at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
        at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:97)
        at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:75)
        at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:203)
        at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:167)
        at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:381)
        at org.apache.kafka.common.network.Selector.poll(Selector.java:326)
        at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:433)
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:224)
        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:162)
        at java.lang.Thread.run(Thread.java:748)

This error is shown from last few days earlier it was working fine for me.
I have currently kafka cluster of two nodes
First node - 1 zookeeper, 1 kafka server, 1 kafka rest
Second node - 1 kafka server, 1 kafka rest

Early help will be appreciated.

Thanks in advance.
Reply all
Reply to author
Forward
0 new messages