RabbitMq messages are getting stuck in the queue

3,726 views
Skip to first unread message

Sunita Agrawala

unread,
Aug 30, 2019, 5:15:35 AM8/30/19
to rabbitmq-users
Hei,

We are using RabbitMq version 3.7.15 and Erlang 10.4, we have 3 cluster nodes and 2 are mirrored, we are using Nginx LB infront of the RabbitMq cluster..
when we are testing zip files and stopping the Nginx LB in middle of the processing and starting it again, messages get stuck in the queue and not moving further, then we need to manually acknowledge the messages and processing start again.. could anyone please help me on this, how can we resolve this issue ?

Regards,
Sunita

Karl Nilsson

unread,
Aug 30, 2019, 9:14:56 AM8/30/19
to rabbitm...@googlegroups.com
Is your client library set to automatically recover consumers? You may want to provide a bit more detail as to how you are testing this but it sounds like the connections aren't re-established after you take your load balancer down and bring it back up again.

Cheers
Karl

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/19df4cdc-c8ed-4499-a63c-ecf2cb07e765%40googlegroups.com.


--
Karl Nilsson

Pivotal/RabbitMQ

Sunita Agrawala

unread,
Sep 2, 2019, 4:25:25 AM9/2/19
to rabbitmq-users
Hi, 

Thank you for the response.. how can re-establish the connection after LB is up again ? Can we configure it in the RabbitMQ WEb UI ?

we have not written any client code to recover consumers... we have prebuild  Collector, Executor and Delivery queue libraby which is using rabbitmq engine in config and Nginx LB IP in rabbitmq.config fila, 
we can't modify the queue in the WEB UI, so we have setup a policy to mirror the rabbitMq node and tried to set up the Dead letter Exchange and Routing Key in the same policy to reroute the Unack messages again to the queue, but it seems to be not working.''

Testing : we are putting the files in the folder so that Collector is collectting the files and processing through (using RabbitMq message queue ) the Executor and Delivery and showing the processed files in EDI.
We have set the policy  like this whereas collectorQueue is showing in the web from our application :- 


Pattern \w*
Apply to queues
Definition
dead-letter-exchange: collectorQueue
dead-letter-routing-key: collectorQueue
ha-mode: exactly
ha-params: 2
ha-sync-mode: automatic
queue-mode: lazy

 Is it correct set up for DLX and routing key ? we have not set up any Exchanges, do we need to create an exchange for the DLX to show up or we can directly set it to Collector queue

Thanks in advance.

Regards,
Sunita


fredag 30. august 2019 15.14.56 UTC+2 skrev Karl Nilsson følgende:
Is your client library set to automatically recover consumers? You may want to provide a bit more detail as to how you are testing this but it sounds like the connections aren't re-established after you take your load balancer down and bring it back up again.

Cheers
Karl

On Fri, 30 Aug 2019 at 10:15, Sunita Agrawala <sunita....@gmail.com> wrote:
Hei,

We are using RabbitMq version 3.7.15 and Erlang 10.4, we have 3 cluster nodes and 2 are mirrored, we are using Nginx LB infront of the RabbitMq cluster..
when we are testing zip files and stopping the Nginx LB in middle of the processing and starting it again, messages get stuck in the queue and not moving further, then we need to manually acknowledge the messages and processing start again.. could anyone please help me on this, how can we resolve this issue ?

Regards,
Sunita

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitm...@googlegroups.com.


--
Karl Nilsson

Pivotal/RabbitMQ

Sunita Agrawala

unread,
Sep 5, 2019, 3:22:03 AM9/5/19
to rabbitmq-users
Hi,

Can someone help me with this ?

Regards,
Sunita

Michael Klishin

unread,
Sep 17, 2019, 2:31:57 PM9/17/19
to rabbitmq-users
We don't have enough information to provide an informed advice.

Server and application logs are essential as we cannot possibly guess what is going on in your system.
In any case, guessing is too time consuming and everyone on this list  would benefit if we had to guess as little as possible.

[1][2][3][4] are all relevant.

Reply all
Reply to author
Forward
0 new messages