rabbitmqctl status and management ui is hang

375 views
Skip to first unread message

马燕龙

unread,
Jun 21, 2019, 3:48:54 AM6/21/19
to rabbitmq-users

Our team do some pressure test on rabbitmq-server, when we create 300 connections and 30,000 channels, the rabbitmq management ui is very slow, sometimes it report could not connect to server error(not the main problem)


One node is hang, we cannot visit the management ui through that node, run rabbitmqctl status is very slow or error sometimes, I'm sure that erlang cookie is right, and only error when channels number is high


The output of rabbitmqctl status is:


Error: unable to perform an operation on node 'rabbit1@BYPLQ-ES-9-104'. Please see diagnostics information and suggestions below.

Most common reasons for this are:


 
* Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues)

 
* CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server)

 * Target node is not running

In addition to the diagnostics info below:

 * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more

 * Consult server logs on node rabbit1@BYPLQ-ES-9-104

 * If target node is configured to use long node names, don'
t forget to use --longnames with CLI tools

DIAGNOSTICS

===========

attempted to contact
: ['rabbit1@BYPLQ-ES-9-104']

rabbit1@BYPLQ
-ES-9-104:

 
* connected to epmd (port 4369) on BYPLQ-ES-9-104

 
* epmd reports node 'rabbit1' uses port 25673 for inter-node and CLI tool traffic

 
* TCP connection succeeded but Erlang distribution failed

 
* TCP connection to remote host has timed out. Is the Erlang distribution using TLS?

Current node details:

 
* node name: 'rabbitmqcli-111187-rabbit@BYPLQ-ES-9-104'

 
* effective user's home directory: /var/lib/rabbitmq

 * Erlang cookie hash: CWpc2gQqoMTY+yCTiDpx+A==


error.png

overview.png


马燕龙

unread,
Jun 24, 2019, 11:04:33 PM6/24/19
to rabbitmq-users
Anyone can answer this question, I need help.

在 2019年6月21日星期五 UTC+8下午3:48:54,马燕龙写道:

Arman Petrosyan

unread,
Jun 25, 2019, 2:03:58 AM6/25/19
to rabbitm...@googlegroups.com
Just try to make small channel count, because each channel  occupies  one ore more mb

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/2c105c2b-f562-4996-a35f-5bcb42f71c5b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

马燕龙

unread,
Jun 25, 2019, 2:33:10 AM6/25/19
to rabbitmq-users
What is the max channel or metadata count per cluster(3 node) support

在 2019年6月25日星期二 UTC+8下午2:03:58,Arman Petrosyan写道:
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitm...@googlegroups.com.

Arman Petrosyan

unread,
Jun 25, 2019, 6:50:27 AM6/25/19
to rabbitm...@googlegroups.com
This related in ram size or disk size

To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.

To post to this group, send email to rabbitm...@googlegroups.com.

Arman Petrosyan

unread,
Jun 25, 2019, 6:52:52 AM6/25/19
to rabbitm...@googlegroups.com
Please read this topic from RabbitMQ in depth book


TIP In creating your client applications, it’s important not to overcomplicate
things with too many channels. On the wire in marshaled frames, channels
are nothing more than an integer value that’s assigned to the messages that
are passed between a server and client; in the RabbitMQ server and client,
they represent more. There are memory structures and objects set up for
each channel. The more channels you have in a connection, the more mem-
ory RabbitMQ must use to manage the message flow for that connection. If
you use them judiciously, you’ll have a happier RabbitMQ server and a less

Luke Bakken

unread,
Jun 25, 2019, 8:42:55 PM6/25/19
to rabbitmq-users
Hello,

Are you monitoring system statistics? https://www.rabbitmq.com/monitoring.html

More than likely you are overloading some aspect of your servers - disk I/O, CPU or network throughput.

Luke

Michael Klishin

unread,
Jun 30, 2019, 5:53:22 PM6/30/19
to rabbitmq-users
Also worth mentioning here: connection metrics (specifically churn) and monitoring [1].


--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To post to this group, send email to rabbitm...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.


--
MK

Staff Software Engineer, Pivotal/RabbitMQ
Reply all
Reply to author
Forward
0 new messages