feature flag missing_clustered_nodes

[Bart Remans]

Hi,

I'm trying to upgrade my cluster to 3.12. All brokers are running RabbitMQ 3.11.0 on Erlang 25.0.4

When I try to enable all feature flags I get an error:

ubuntu:~$ sudo rabbitmqctl list_feature_flags
Listing feature flags ...
name    state
classic_mirrored_queue_version  enabled
direct_exchange_routing_v2      disabled
drop_unroutable_metric  enabled
empty_basic_get_metric  enabled
feature_flags_v2        enabled
implicit_default_bindings       enabled
listener_records_in_ets disabled
maintenance_mode_status enabled
quorum_queue    enabled
stream_queue    enabled
stream_single_active_consumer   disabled
tracking_records_in_ets disabled
user_limits     enabled
virtual_host_metadata   enabled

ubuntu:~$ sudo rabbitmqctl enable_feature_flag all
Enabling all feature flags ...
Error:
missing_clustered_nodes

I cannot find anything about this error in the docs. Can somebody assist me?

Regards,

Bart

[Michal Kuratczyk]

Hi,

First of all, upgrading from 3.11.0 directly to 3.12.0 is not supported (https://www.rabbitmq.com/upgrade.html#rabbitmq-version-upgradability):

Upgrade to the latest patch version first.

Regarding your question, feature flags need to be enabled across all nodes in the cluster. You have some nodes that are (or were) members of this cluster but are currently unreachable:

https://github.com/rabbitmq/rabbitmq-server/blob/001cbf97822c6bd23b235c45b6da0a4c14369c2c/deps/rabbit/src/rabbit_ff_controller.erl#L524-L528

Start all the nodes first or use `rabbitmqctl forget_cluster_node` (https://www.rabbitmq.com/rabbitmqctl.8.html#forget_cluster_node) to delete any memory of that node being in the cluster in the past.

Best,

--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/3e4b76d4-e136-4015-bc76-42be7faff71an%40googlegroups.com.

--

Michał

RabbitMQ team

[Bart Remans]

Hi Michael,

Thank you! 

Removing a node with forget_cluster_node did it.

Regards,

Bart

Op donderdag 22 juni 2023 om 16:32:10 UTC+2 schreef Michal Kuratczyk: