Message per sec or monitoring of Streams

[Saurabh Nautiyal]

Hi All,

I am currently utilizing Super Stream to implement a pub/sub architecture for my application. To ensure the system's performance under load, I am conducting a load test on my streams, involving both the publisher and the consumer components. However, while conducting the load test, I have encountered a situation where the management UI does not display any essential metrics, such as messages per second, making it challenging to monitor the streams effectively.

I would greatly appreciate any assistance or guidance on how to enable and view the necessary monitoring metrics, such as messages per second, within the Super Stream management UI during the load testing process. Your support in resolving this matter would be highly valued. 

Thank you!

Saurabh Nautiyal

[Arnaud Cogoluègnes]

The rates for streams are not calculated in the management UI. We do keep counters in Prometheus though [1] (/metrics/per-object endpoint), so you can get rates from Prometheus or use a tool like Grafana for more sophisticated dashboards.

Note you can also use the stream performance tool [2] to simulate your workload. It supports super streams [3]. It outputs rates on the console but it also supports Prometheus [4].

[1] https://rabbitmq.com/prometheus.html

[2] https://rabbitmq.github.io/rabbitmq-stream-java-client/snapshot/htmlsingle/#the-performance-tool

[3] https://rabbitmq.github.io/rabbitmq-stream-java-client/snapshot/htmlsingle/#super-streams-2

[4] https://rabbitmq.github.io/rabbitmq-stream-java-client/snapshot/htmlsingle/#monitoring