queue abdicates and leader election infinite loop

[Arnaud Morin]

Hello team,

I had an issue on one of my clusters, in rabbit logs, I was seeing lines
like this:
2023-07-31 09:49:42.245301+00:00 [notice] <0.11421.93> queue
'neutron-vo-Router-1.0_fanout_581296c36b204d0d9af97d4885e5447a' in vhost
'/': leader saw append_entries_reply from
{'%2F_neutron-vo-Router-1.0_fanout_581296c36b204d0d9af97d4885e5447a',rabbit@rabbit4}
for term 3 abdicates term: 2!


Few seconds later, a new leader election seems to start.
Two out of three nodes are granting vote for the same node:
2023-07-31 09:49:45.702382+00:00 [info] <0.12541.93> queue
'neutron-vo-Router-1.0_fanout_581296c36b204d0d9af97d4885e5447a' in vhost
'/': granting vote for
{'%2F_neutron-vo-Router-1.0_fanout_581296c36b204d0d9af97d4885e5447a',rabbit@rabbit4}
with last indexterm {4,2} for term 4 previous term was 3


Note that the last node seems to never receive the vote result (I have
no logs about that queue in the last node).

And it's looping over and over, never beeing able to recover.
Do you know what could cause such lines in logs?

Cheers,

[Luke Bakken]

Please let us know what version of RabbitMQ and Erlang you are using.

[Arnaud]

Sorry my bad. I am running 3.12.0.
For Erlang not sure, will check ASAP.

[Arnaud Morin]

I did check, I am using:
rabbit 3.12.0
erlang 25.2.2

> --
> You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
> To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/5020dbad-7d68-4fef-9bc8-d65fe4c78d71n%40googlegroups.com.

[kjnilsson]

Can you share the full logs for this from all RabbitMq nodes?

What does `rabbitmq-queues quorum_status queue-name` output?