Quorum queue huge size issue, but it's empty

719 views
Skip to first unread message

Ivan Hilario Puertas

unread,
Mar 15, 2021, 7:53:02 AM3/15/21
to rabbitmq-users

I'm facing the following issue; the segment files o a quorum queue are occupying almost all disk space (11GB), but checking the queue, it is empty since one month ago.

Additional info:
RabbitMQ 3.8.9
Erlang 23.1.2

Queue details atteched.

Best regards and thanks in advance!

AMQPDestination_details_1.pngAMQPDestination_details_2.png

Ivan Hilario Puertas

unread,
Mar 15, 2021, 7:56:44 AM3/15/21
to rabbitmq-users
Is there any mechanism to "compact" mnesia files or is it due to some other type of issue or feature?

Karl Nilsson

unread,
Mar 15, 2021, 8:11:36 AM3/15/21
to rabbitmq-users
Hi,

Do you have applications that continuously poll the queue using basic.get? We fixed an issue in 3.8.10 around this as each basic get request is an entry in the quorum queue raft log and before 3.8.10 it would never truncate this log if there was no other traffic. You could try upgrading to the latest version, currently 3.8.14.

For now you could also try to issue a purge request through the ui and see if that forces a log truncation.


Cheers
Karl

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/17d8e5db-61b8-407d-b34f-9d17cc2e8be2n%40googlegroups.com.


--
Karl Nilsson
Message has been deleted
Message has been deleted
Message has been deleted
Message has been deleted
Message has been deleted
Message has been deleted

Gerhard Lazu

unread,
Mar 15, 2021, 8:49:34 AM3/15/21
to rabbitmq-users
If you are using basic.get, please read this https://www.rabbitmq.com/consumers.html#fetching

Could your use-case benefit from a more efficient way of consuming messages?

Ivan Hilario Puertas

unread,
Mar 15, 2021, 9:12:50 AM3/15/21
to rabbitmq-users
Hi all,

@Karl, purging the queue the disk is freeded. We are planing to upgrade to  3.8.14.

On the other hand, I will resend fetching info https://www.rabbitmq.com/consumers.html#fetching to our devs.

Thanks a lot!!!
Reply all
Reply to author
Forward
0 new messages