Schema Integrity Error BOOT failed. RabbitMQ .3.12 and Erlang 26

[Santanu Suna Nayak]

Seeking an urgnet Help.

I was using 3.7-3 Rabbitmq with erlang/OTP 20 on ubuntu 16.4 . We upgraded to Ubuntu 20.4 with rabbitmq 3.12 and erlanf/OTP to 26 .Chcked the permission and config. file. while starting i am getting below Error.

2023-10-06 08:32:51.266800+00:00 [info] <0.237.0> Starting RabbitMQ 3.12.6 on Erlang 26.1 [jit]

2023-10-06 08:32:51.266800+00:00 [info] <0.237.0> Copyright (c) 2007-2023 VMware, Inc. or its affiliates.

2023-10-06 08:32:51.266800+00:00 [info] <0.237.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0>

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> node : rabbit@DEtstQUEU01

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> home dir : /home/rabbitmq

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> config file(s) : /etc/rabbitmq/rabbitmq.config

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> cookie hash : 0Yg5IFGXPgj6oAYmk5oG/A==

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> log(s) : /logs/rabbitmq/server/rabbit_DEtstQUEU01.log

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> :

2023-10-06 08:32:51.268986+00:00 [info] <0.237.0> data dir : /data01/rabbitmq_db/rabbit@DEtstQUEU01

2023-10-06 08:32:54.792602+00:00 [info] <0.237.0> Running boot step pre_boot defined by app rabbit

2023-10-06 08:32:54.792711+00:00 [info] <0.237.0> Running boot step rabbit_global_counters defined by app rabbit

2023-10-06 08:32:54.793268+00:00 [info] <0.237.0> Running boot step rabbit_osiris_metrics defined by app rabbit

2023-10-06 08:32:54.793429+00:00 [info] <0.237.0> Running boot step rabbit_core_metrics defined by app rabbit

2023-10-06 08:32:54.793896+00:00 [info] <0.237.0> Running boot step rabbit_alarm defined by app rabbit

2023-10-06 08:32:54.798038+00:00 [info] <0.367.0> Memory high watermark set to 1486 MiB (1558988390 bytes) of 3716 MiB (3897470976 bytes) total

2023-10-06 08:32:54.801404+00:00 [info] <0.369.0> Enabling free disk space monitoring (disk free space: 9845239808, total memory: 3897470976)

2023-10-06 08:32:54.801465+00:00 [info] <0.369.0> Disk free limit set to 50MB

2023-10-06 08:32:54.803361+00:00 [info] <0.237.0> Running boot step code_server_cache defined by app rabbit

2023-10-06 08:32:54.803501+00:00 [info] <0.237.0> Running boot step file_handle_cache defined by app rabbit

2023-10-06 08:32:54.803759+00:00 [info] <0.372.0> Limiting to approx 32671 file handles (29401 sockets)

2023-10-06 08:32:54.803944+00:00 [info] <0.373.0> FHC read buffering: OFF

2023-10-06 08:32:54.803986+00:00 [info] <0.373.0> FHC write buffering: ON

2023-10-06 08:32:54.804430+00:00 [info] <0.237.0> Running boot step worker_pool defined by app rabbit

2023-10-06 08:32:54.804507+00:00 [info] <0.350.0> Will use 2 processes for default worker pool

2023-10-06 08:32:54.804550+00:00 [info] <0.350.0> Starting worker pool 'worker_pool' with 2 processes in it

2023-10-06 08:32:54.804924+00:00 [info] <0.237.0> Running boot step database defined by app rabbit

2023-10-06 08:32:54.813139+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0>

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> BOOT FAILED

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> ===========

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> Error during startup: {error,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> {schema_integrity_check_failed,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [{table_attributes_mismatch,rabbit_user,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [username,password_hash,tags,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> hashing_algorithm,limits],

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [username,password_hash,tags,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> hashing_algorithm]},

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> {table_attributes_mismatch,rabbit_vhost,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [virtual_host,limits,metadata],

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [virtual_host,limits]},

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> {table_missing,rabbit_index_route},

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> {table_attributes_mismatch,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> rabbit_durable_queue,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [name,durable,auto_delete,exclusive_owner,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> arguments,pid,slave_pids,sync_slave_pids,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> recoverable_slaves,policy,operator_policy,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> gm_pids,decorators,state,policy_version,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> slave_pids_pending_shutdown,vhost,options,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> type,type_state],

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> [name,durable,auto_delete,exclusive_owner,

2023-10-06 08:32:54.813660+00:00 [error] <0.237.0> arguments,pid,slave_pids,sync_slave_pids,

================== config file details

rabbitmq.conf .

listeners.tcp.default = 9672

management.listener.port = 25672

disk_free_limit.relative = 1.0

heartbeat = 60

cluster_partition_handling = ignore

log.file.level = info

======================= Rabbitmq-env.configThis is a /bin/sh script file - use ordinary envt var syntax

HOST_NAME=uname -n

RABBITMQ_NODE_PORT=9672

RABBITMQ_USE_LONGNAME=false

RABBITMQ_MNESIA_BASE=/data01/rabbitmq_db

RABBITMQ_LOG_BASE=/logs/rabbitmq

RABBITMQ_LOGS=/logs/rabbitmq/server/rabbit_${HOST_NAME}.log

RABBITMQ_UPGRADE_LOG=/logs/rabbitmq/server/rabbit_${HOST_NAME}_upgrade.log

RABBITMQ_SASL_LOGS=/logs/rabbitmq/erlang_sasl/rabbit_${HOST_NAME}-sasl.log

RABBITMQ_PID_FILE=/logs/rabbitmq/PID/rabbit_${HOST_NAME}.pid

Any help will be very helpful

I have tried checking all config and ownership of file. and used advanced config format . cleared mnesia data as well. still same

[Luke Bakken]

Hello,

Upgrading from RabbitMQ 3.7 to 3.12 is not supported - https://www.rabbitmq.com/upgrade.html#rabbitmq-version-upgradability

If you start with a fresh RabbitMQ 3.12 environment on Ubuntu 20.04 I'm assuming you do not see this issue.

Thanks,

Luke

[Santanu Suna Nayak]

it got resolved. i had to use advance config format for the new erlang . den it worked. also i had delete old schema on db . 

Thank you for the help

[Ravi Kumar H R]

Santanu ,
I'm also facing same issue while upgrading to 3.12 from 3.7.14
1. can you elaborate advance config changes which worked for you ?
2. and when you delete old schema on db, does it remove all data as well ?

thanks in advance.