Storm JMX monitoring

327 views
Skip to first unread message

Vladimir Tretyakov

unread,
Nov 28, 2013, 12:23:57 PM11/28/13
to storm...@googlegroups.com
Hi guys,

Storm is becoming more and more popular and we, Sematext, decided to add Storm support for our monitoring product, called SPM.

Now we are planning to get statistics about Cluster/Supervisors from Nimbus, like the Storm UI does it.

Any chance to get the same data in JMX? It would be easier for the "java world".

PS: Are there plans related to the Thrift version? Will Storm use Thrift 0.7.0 in the long run or are there plans to change it?

Thanks for a very nice tool!

Best regards,
Vladimir."

jayati tiwari

unread,
Nov 28, 2013, 1:01:22 PM11/28/13
to storm...@googlegroups.com
Hi Vladimir,

I have worked on monitoring of Storm using JMX as described in my blog at the following url:


Please let me know if this is what you are looking for.

I shall be happy to contribute it.

Regards,
Jayati


--
You received this message because you are subscribed to the Google Groups "storm-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to storm-user+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Vladimir Tretyakov

unread,
Nov 28, 2013, 1:14:18 PM11/28/13
to storm...@googlegroups.com
Hi Jayati, to be honest I've already read your article, thx for sharing it.

As I've understood you extract JVM's metrics by JMX like "NonHeapMemoryUsage", "HeapMemoryUsage" and others JVM's specific.

I've asked about Storm specific things you can find in Storm UI, for example:

Cluster summary:
  • supervisors count
  • used slots count
  • free slots count
  • executors count
  • asks count
or

Bolts stats like:

  • Emitted
  • Transferred
  • Execute latemcy
  • ...
Is it possible to extract Storm specific things by JMX, are there plans for future about this?

Regards,
Vladimir
Reply all
Reply to author
Forward
0 new messages