Problem with Mnesia directory disappearing in RabbitMQ
94 views
Skip to first unread message
힘솟는중새우
Sep 6, 2023, 5:35:16 AM9/6/23
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to rabbitmq-users
Hello rabbit mq team!
Problem with Mnesia directory disappearing in RabbitMQ
*rabbitmq ver: 3.11.21/22
*erlang ver: 25.3.2.5
*centOS Linux release 7.4.1708
After the cluster setup is complete, mq dies as shown in the log below.
Also, the mnesia directory is also deleted, although I'm not sure if it's causing the problem.
{"time":"2023-08-31 06:01:06.622089+09:00","level":"error","msg":" supervisor: {local,rabbit_disk_monitor_sup}\n errorContext: child_terminated\n reason: {unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,\n 128,152,47,100,97,116,97,47,100,97,116,97,47,114,97,\n 98,98,105,116,109,113,47,109,110,101,115,105,97,47,\n 114,97,98,98,105,116,64,103,101,121,101,115,45,112,\n 107,45,108,118,48,54,45,109,113,48,50,226,128,153,\n 58,32,78,111,32,115,117,99,104,32,102,105,108,101,\n 32,111,114,32,100,105,114,101,99,116,111,114,121,\n 10]}\n offender: [{pid,<0.300.0>},\n {id,rabbit_disk_monitor},\n {mfargs,{rabbit_disk_monitor,start_link,[50000000]}},\n {restart_type,{transient,1}},\n {shutdown,300000},\n {child_type,worker}]","domain":"otp.sasl","file":"supervisor2.erl","line":838,"mfa":["supervisor2","maybe_report_error",3],"pid":"<0.299.0>"}
{"time":"2023-08-31 06:01:06.625339+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 10 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:03:06.628621+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 9 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:05:06.631737+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 8 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:07:06.634751+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 7 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:09:06.637323+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 6 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:11:06.640389+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 5 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:13:06.643564+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 4 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:15:06.646555+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 3 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:17:06.649617+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 2 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:19:06.652818+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 1 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:21:06.653562+09:00","level":"error","msg":"Free disk space monitor failed to start!","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 10:09:10.380897+09:00","level":"warning","msg":"closing AMQP connection <0.4152.0> (172.23.130.71:33138 -> 172.23.130.71:5672 - connectionFactory#42a48628:0, vhost: '/', user: 'gigasurv'):\nclient unexpectedly closed TCP connection","domain":"rabbitmq.connection","pid":"<0.4152.0>"}
{"time":"2023-08-31 10:15:39.505929+09:00","level":"info","msg":"accepting AMQP connection <0.15218.1> (211.252.145.23:52652 -> 172.23.130.71:5672)","domain":"rabbitmq.connection","pid":"<0.15218.1>"}
{"time":"2023-08-31 10:15:39.542768+09:00","level":"info","msg":"connection <0.15218.1> (211.252.145.23:52652 -> 172.23.130.71:5672) has a client-provided name: connectionFactory#2f7298b:0","domain":"rabbitmq.connection","pid":"<0.15218.1>"}
{"time":"2023-08-31 10:15:39.573857+09:00","level":"info","msg":"connection <0.15218.1> (211.252.145.23:52652 -> 172.23.130.71:5672 - connectionFactory#2f7298b:0): user 'gigasurv' authenticated and granted access to vhost '/'","domain":"rabbitmq.connection","pid":"<0.15218.1>"}
{"time":"2023-08-31 06:01:06.625339+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 10 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:03:06.628621+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 9 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:05:06.631737+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 8 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:07:06.634751+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 7 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:09:06.637323+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 6 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:11:06.640389+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 5 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:13:06.643564+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 4 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:15:06.646555+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 3 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:17:06.649617+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 2 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:19:06.652818+09:00","level":"warning","msg":"Free disk space monitor encountered an error (e.g. failed to parse output from OS tools). Retries left: 1 Error:\n{'EXIT',{unparseable,[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,\n 152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,\n 105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,\n 98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,\n 48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,\n 117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,\n 101,99,116,111,114,121,10]}}","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 06:21:06.653562+09:00","level":"error","msg":"Free disk space monitor failed to start!","domain":"rabbitmq","pid":"<0.32507.0>"}
{"time":"2023-08-31 10:09:10.380897+09:00","level":"warning","msg":"closing AMQP connection <0.4152.0> (172.23.130.71:33138 -> 172.23.130.71:5672 - connectionFactory#42a48628:0, vhost: '/', user: 'gigasurv'):\nclient unexpectedly closed TCP connection","domain":"rabbitmq.connection","pid":"<0.4152.0>"}
{"time":"2023-08-31 10:15:39.505929+09:00","level":"info","msg":"accepting AMQP connection <0.15218.1> (211.252.145.23:52652 -> 172.23.130.71:5672)","domain":"rabbitmq.connection","pid":"<0.15218.1>"}
{"time":"2023-08-31 10:15:39.542768+09:00","level":"info","msg":"connection <0.15218.1> (211.252.145.23:52652 -> 172.23.130.71:5672) has a client-provided name: connectionFactory#2f7298b:0","domain":"rabbitmq.connection","pid":"<0.15218.1>"}
{"time":"2023-08-31 10:15:39.573857+09:00","level":"info","msg":"connection <0.15218.1> (211.252.145.23:52652 -> 172.23.130.71:5672 - connectionFactory#2f7298b:0): user 'gigasurv' authenticated and granted access to vhost '/'","domain":"rabbitmq.connection","pid":"<0.15218.1>"}
Can I get help with this situation?
thanks!
Michal Kuratczyk
Sep 6, 2023, 10:23:17 AM9/6/23
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to rabbitm...@googlegroups.com
Hi,
I copy-pasted and cleaned up all those numbers, which are character codes, and this is what I get:
$ erl
> io:format("~s", [[47,117,115,114,47,98,105,110,47,100,102,58,32,226,128,152,47,100,97,116,97,47,100,97,116,97,47,114,97,98,98,105,116,109,113,47,109,110,101,115,105,97,47,114,97,98,98,105,116,64,103,101,121,101,115,45,112,107,45,108,118,48,54,45,109,113,48,50,226,128,153,58,32,78,111,32,115,117,99,104,32,102,105,108,101,32,111,114,32,100,105,114,101,99,116,111,114,121,10]]).
/usr/bin/df: â: No such file or directory
/usr/bin/df: â: No such file or directory
so it seems like you have no /usr/bin/df, which RabbitMQ uses for disk monitoring. You can check the code of the disk monitor here:
Best,
--
You received this message because you are subscribed to the Google Groups "rabbitmq-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/cc9c8f2f-6488-4f54-bbe3-64c3bd691840n%40googlegroups.com.
Michał
RabbitMQ teamReply all
Reply to author
Forward
0 new messages