Management Plugin Listing Queues Extremely Slow

[Brad Jorgensen]

I have a cluster of RabbitMQ servers with mirrored queues.  I currently have about 5200 queues.  When I go to the queues tab in the management plugin, it takes at least 15 seconds (usually more) before I start receiving data for the list and it usually takes about 5 seconds to receive the data.  The time to receive the data can probably be significantly reduced by enabling gzip compression for the response.  The interface is practically unusable since it takes so long to load.  Is this a known limitation of the plugin or is there anything I can do to improve it?  I am using RabbitMQ 3.4.4 with Erlang 17.3.

[Michael Klishin]

On 26 May 2015 at 20:24:15, Brad Jorgensen (br...@debtpaypro.com) wrote:
> The time to receive the data can probably be significantly reduced
> by enabling gzip compression for the response. The interface
> is practically unusable since it takes so long to load. Is this
> a known limitation of the plugin or is there anything I can do to
> improve it? I am using RabbitMQ 3.4.4 with Erlang 17.3.

The issue can easily be something other than compression (although that may help somewhat),
e.g. when you have queues in multiple vhosts, regardless of the selected vhosts they will
all be loaded before filtering according to the vhost and  your user's permissions.

Management UI certainly has areas where its efficiency is far from optimal.
--
MK

Staff Software Engineer, Pivotal/RabbitMQ

[Ericsson de Oliveira]

I noticed this as well, when i start my services and my consumers count increases.

It looks like if i have too many consumers connected in the cluster, the slower the ui behaves.

I`m using rabbitmq 3.6.6 and erlang 19.0.4

[Michael Klishin]

Scalability limitations of the management plugin (stats DB) prior to RabbitMQ 3.6.7 are fairly well documented by now. See the docs and upgrade to 3.6.10 when you can.

See http://rabbitmq.com/chanelog.html for details.

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Ericsson de Oliveira]

Hi Michael,

i tested a 3.6.9 cluster as well and had the same slow behavior.

Is this fixed only in 3.6.10 version?

[Michael Klishin]

New management plugin was introduced in 3.6.7, as stated in the change log.

Having more consumers means more data will be queried, aggregated and rendered.

The difference starting with 3.6.7 is that the load is distributed across cluster nodes

roughly as well as connections/queues/consumers are.

Possibly relevant:

https://groups.google.com/forum/#!searchin/rabbitmq-users/HTTP$20API$20JSON$20performance%7Csort:relevance/rabbitmq-users/lqaZ32OurXA/HIDwWHswBAAJ

https://github.com/rabbitmq/rabbitmq-management/pull/399

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-users+unsubscribe@googlegroups.com.
To post to this group, send email to rabbitmq-users@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Alexey Lebedeff]

Hi Ericsson,

You may be interested in
https://github.com/rabbitmq/rabbitmq-management/pull/399

From my observations it greatly improves UI responsiveness, but for now
it works only for queues.

Best,
Alexey

Ericsson de Oliveira writes:

> Hi Michael,
>
> i tested a 3.6.9 cluster as well and had the same slow behavior.
>
> Is this fixed only in 3.6.10 version?
>
> Em domingo, 28 de maio de 2017 15:40:41 UTC-3, Michael Klishin escreveu:
>>
>> Scalability limitations of the management plugin (stats DB) prior to
>> RabbitMQ 3.6.7 are fairly well documented by now. See the docs and upgrade
>> to 3.6.10 when you can.
>> See http://rabbitmq.com/chanelog.html for details.
>>
>> On 28 May 2017, at 21:06, Ericsson de Oliveira <csso...@gmail.com

>> email to rabbitmq-user...@googlegroups.com <javascript:>.

>> To post to this group, send email to rabbitm...@googlegroups.com

>> <javascript:>.