ksql is hanging . cannot get the Kafka node ...

[Phil gib]

My context :

Machine linux/ubuntu  A on the internet  running confluent 3.3.0 with kafka  server config à advertised.listeners = PGHOST://xx.xx.xx.151:9092,PGLOCAL://localhost:9093

Machine B on the internet running kafka producer and sending event to machine A.

 With a kafka producer  ( running on machine A) I see  data messages arriving on the kafka server  machine B . great ! it works

 

My problem happens with ksql  :

I put ksql in the loop with  the following config ksqlserver.properties

bootstrap.servers= xx.xx.xx.151:9092

application.id=ksql_server_quickstart

ksql.command.topic.suffix=commands

listeners=http://localhost:8080

 

or  with  the following config ksqlserver.properties

bootstrap.servers=localhost:9093

application.id=ksql_server_quickstart

ksql.command.topic.suffix=commands

listeners=http://localhost:8080

 

in any case it hangs with  error :     io.confluent.ksql.exception.KafkaResponseGetFailedException: Failed to retrieve kafka topic names

and in the ksql logs

[2017-09-25 14:54:00,675] WARN Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient:589)

…..

 [2017-09-25 14:54:00,928] WARN Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient:589)

 

Ksql cannot get the kafka handle ….  L  ..   whats wrong in my config ?, please ?

 

PS:  My first test of ksql with everything in local on 1 machine was running nicely ..

 

Phil

Best regards

[hoj...@confluent.io]

Hi Phil,

As you mentioned it seems that KSQL server cannot connect to Kafka cluster. Can you write a simple Kafka Streams app in Java or a consumer test to see if you can read the messages from the topic.

Something similar to "https://github.com/apache/kafka/blob/trunk/streams/examples/src/main/java/org/apache/kafka/streams/examples/wordcount/WordCountDemo.java" would be good.

Cheers,

--Hojjat

[Phil gib]

hello hojjat thx for your reply..  . yes i can read from the topic with  a kafaka consumer console

my problem seems to be network, host  related ... listeners ...... i think in the kafka configuration....

the path publisher kafka  ( machine B internet)  --> kafka ( machine A) -> consumer(  machine A  on internet)  works but

the path  ksql   ( machine A) --> kafka  ( machine A) does not work  either if the config for ksqlserver.properties  is

bootstrap.servers=localhost:9093

or

bootstrap.servers= xx.xx.xx.151:9092

best R

phil

--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/PJ9FDzzwy_0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/12c76fa8-caa5-4a72-9bb9-f7d25c212a1a%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.