Number of Dynamic Temporary Queues can be created

47 views
Skip to first unread message

bobba

unread,
Sep 19, 2023, 6:19:58 PM9/19/23
to rabbitmq-users
Hi all,

I am trying to build a queue system, in our flow we will be creating a multiple dynamic temporary queues for the clients.If I need to done to support of around 50000 dynamic temporary queues, to support these 50000 temporary queues,What are the things I need change for the system requirement and what are the things that I need to be handle in both server and client side.These dynamic temporary queues will be created using the STOMP protocol.  


If anyone have suggestions or have some clues on How it can be handled, It would be really appreciated.

Thanks,
Bhargav

Michal Kuratczyk

unread,
Sep 20, 2023, 2:45:44 AM9/20/23
to rabbitm...@googlegroups.com
We don't use the terms "dynamic" nor "temporary" in the context of the queues, so it's not clear what you mean.

Having 50000 queues is not impossible (there are systems with more), but of course at this scale it's definitely something you need to test and not just rely on a mailing list question.

A few things to consider:
* how many of them are "active" at a given time (an idle queue is very cheap, but if all queues receive messages often, that's a much different workload)
* how many messages per second per queue during peaks
* message size - in classic queues, which you should use for such workload, messages are stored differently based on the message size (4kb is the default threshold)
* queue declaration/deletions per second (how often are new queues declared and old queues deleted - this kind of work requires separate testing as the code paths involved are very different than during message flow)

Using 3.12 with classic queues v2 is a good starting point.


--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/2040b8e4-558a-4447-ada0-e984ecd28a37n%40googlegroups.com.


--
Michał
RabbitMQ team
Reply all
Reply to author
Forward
0 new messages