Kafka Streams Monitoring?

310 views
Skip to first unread message

vivek sharma

unread,
Feb 16, 2017, 6:38:09 PM2/16/17
to Confluent Platform
Hi Mates - How can I monitor my Kafka Streams job? Is there any free tool available to monitor Kafka Streams job? We can monitor Spark Streaming via YARN Console only What about Kafka Streams?

Michael Noll

unread,
Feb 16, 2017, 6:55:48 PM2/16/17
to confluent...@googlegroups.com
Vivek,

there's no "job" for Kafka Streams, unlike cluster-based frameworks such as Spark or Storm, for which you typically can only use a limited set of monitoring tools.  Instead -- and that is a great benefit -- you write standard Java (or Scala, ...) applications when using Kafka's Streams API, and you can monitor this application with any of the many, many tools that can manage and monitor a Java application.

On top of that, there are many built-in metrics that are exposed by the Streams API (e.g. via JMX or programmatically) that provide you with additional insights into your application.

-Michael



On Thu, Feb 16, 2017 at 3:38 PM, vivek sharma <vivek.gu...@gmail.com> wrote:
Hi Mates - How can I monitor my Kafka Streams job? Is there any free tool available to monitor Kafka Streams job? We can monitor Spark Streaming via YARN Console only What about Kafka Streams?

--
You received this message because you are subscribed to the Google Groups "Confluent Platform" group.
To unsubscribe from this group and stop receiving emails from it, send an email to confluent-platform+unsub...@googlegroups.com.
To post to this group, send email to confluent-platform@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/confluent-platform/8d533093-ec85-4f80-84dd-6210e9cee753%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Reply all
Reply to author
Forward
0 new messages