kafka-rest logs

1,164 views
Skip to first unread message

Teik Hooi Beh

unread,
Feb 8, 2017, 11:18:18 PM2/8/17
to Confluent Platform
Hi, I have just started testing kafka-rest with schema-registry and is successful testing small data schema. Now I am testing with a bigger data schema and have been hitting 500 server error ( I am using postman for the posting). Where are the log files for kafka-rest located? I only see the kafka server logs but nothing on kafka-rest. 

Please advice. Thanks in advance.

Regards
Beh

Guillaume Roger | webpower

unread,
Feb 9, 2017, 4:01:37 AM2/9/17
to Confluent Platform
HI,

I always only have them on stdout (or journalctl as I start kafka-rest via systemd). Without configuring log4j I think that is all there is.

Cheers,

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platf...@googlegroups.com.
To post to this group, send email to confluent...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/95efe68f-72f6-4f70-9c36-b8c17883917a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Guillaume Roger
Senior big data engineer & architect @ Webpower
Koolhovenstraat 1k, 3772 MT, Barneveld, Nederland
guillaume.roger@webpower.nl | +31 (0) 342 423 262

Teik Hooi Beh

unread,
Feb 9, 2017, 8:16:33 PM2/9/17
to confluent...@googlegroups.com
Yup, i change to DEUG level and more info spill out on the stdout. Thanks.

On Thu, Feb 9, 2017 at 10:01 PM, Guillaume Roger | webpower <guillau...@webpower.nl> wrote:
HI,

I always only have them on stdout (or journalctl as I start kafka-rest via systemd). Without configuring log4j I think that is all there is.

Cheers,

On Thu, 9 Feb 2017 at 05:18 Teik Hooi Beh <th...@thbeh.com> wrote:
Hi, I have just started testing kafka-rest with schema-registry and is successful testing small data schema. Now I am testing with a bigger data schema and have been hitting 500 server error ( I am using postman for the posting). Where are the log files for kafka-rest located? I only see the kafka server logs but nothing on kafka-rest. 

Please advice. Thanks in advance.

Regards
Beh

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
--
Guillaume Roger
Senior big data engineer & architect @ Webpower
Koolhovenstraat 1k, 3772 MT, Barneveld, Nederland
guillaume.roger@webpower.nl | +31 (0) 342 423 262

--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/JTHi9ZRfaq0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/CAFPbq5WDv24gXL_D0%2B-AAR-ebb5bECZyMhx8y%2BiQC2Y%3Dvzn9dA%40mail.gmail.com.

Vikrant Kumbhar

unread,
Jan 11, 2018, 4:37:09 PM1/11/18
to Confluent Platform
Hi Beh,

Do you found any solution on this ?
Currently i am facing the same, 500 error issue, Your suggestion can be helpful for me.

Regards,
Vikrant

Manoj Khangaonkar

unread,
Jan 17, 2018, 4:58:35 PM1/17/18
to Confluent Platform
You have to configure etc/kafka-rest/log4.properties to send the logs to a file of your choice.

By default they go only to stdout.

Here is a sample


log4j.rootLogger=INFO, stdout, kafkarestAppender


log4j.appender.stdout=org.apache.log4j.ConsoleAppender

log4j.appender.stdout.layout=org.apache.log4j.PatternLayout

log4j.appender.stdout.layout.ConversionPattern=[%d] %p %m (%c:%L)%n


log4j.appender.kafkarestAppender=org.apache.log4j.DailyRollingFileAppender

log4j.appender.kafkarestAppender.DatePattern='.'yyyy-MM-dd-HH

log4j.appender.kafkarestAppender.File=/opt/confluent-3.3.0/logs/kafkarest.log

log4j.appender.kafkarestAppender.layout=org.apache.log4j.PatternLayout

log4j.appender.kafkarestAppender.layout.ConversionPattern=[%d] %p %m (%c)%n


log4j.logger.io.confluent=INFO

log4j.logger.org.apache=INFO


regards

Vikrant Kumbhar

unread,
Jan 18, 2018, 12:17:46 AM1/18/18
to confluent...@googlegroups.com
Hi Manoj,

Thank you for suggestion.
Just tried to configure  /etc/kafka-rest/log4j.properties the file.

but it not logging internal server error.

I am doing following steps -
  • Created a Kafka Topic
  • Added the topic name in /etc/kafka-con-elasticsearch/quickstart-elasticsearch.properties
  • in command line used below command -
    sudo /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-con-elasticsearch/quickstart-elasticsearch.properties
  • In another command line used below command to post data -
    curl -X POST -H "Content-Type: application/vnd.kafka.json.v2+json" -H "Accept: application/vnd.kafka.v2+json" --data '{"records":[{"value":{"f1":"bar"}}]}' "http://192.168.10.245:8082/topics/vbnvicky9"
  • In response received Internal server error message
Please suggest if i am doing any thing wrong.

--
You received this message because you are subscribed to a topic in the Google Groups "Confluent Platform" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/confluent-platform/JTHi9ZRfaq0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.



--

Best Regards,

Vikrant Kumbhar



Vikrant Kumbhar

unread,
Jan 18, 2018, 12:18:40 AM1/18/18
to Confluent Platform
Hi Manoj,

Thank you for suggestion.
Just tried to configure  /etc/kafka-rest/log4j.properties the file.

but it not logging internal server error.

I am doing following steps -
  • Created a Kafka Topic
  • Added the topic name in /etc/kafka-con-elasticsearch/quickstart-elasticsearch.properties
  • in command line used below command -
    sudo /usr/bin/connect-standalone /etc/schema-registry/connect-avro-standalone.properties /etc/kafka-con-elasticsearch/quickstart-elasticsearch.properties
  • In another command line used below command to post data -
    curl -X POST -H "Content-Type: application/vnd.kafka.json.v2+json" -H "Accept: application/vnd.kafka.v2+json" --data '{"records":[{"value":{"f1":"bar"}}]}' "http://192.168.10.245:8082/topics/vbnvicky9"
  • In response received Internal server error message
Please suggest if i am doing any thing wrong.

Reply all
Reply to author
Forward
0 new messages