Error on AMQP connection <0.805.0> ...PLAIN login refused: user 'guest' - invalid credentials

[Robel Yemane]

I have set up rmq in Kubernetes (https://github.com/bitnami/charts/tree/master/bitnami/rabbitmq/) to auth using username/password guest/guest, and this works fine. However, intermittently in some failed deployments (no change to RMQ) I get the following error message:

```

2020-11-30 15:09:42.997 [info] <0.792.0> started TCP listener on [::]:5672

2020-11-30 15:09:43.197 [info] <0.515.0> Server startup complete; 6 plugins started.

 * rabbitmq_peer_discovery_k8s

 * rabbitmq_peer_discovery_common

 * rabbitmq_auth_backend_ldap

 * rabbitmq_management

 * rabbitmq_web_dispatch

 * rabbitmq_management_agent

 completed with 6 plugins.

2020-11-30 15:09:43.197 [info] <0.515.0> Resetting node maintenance status

2020-11-30 15:09:59.186 [info] <0.805.0> accepting AMQP connection <0.805.0> (10.27.171.226:42340 -> 10.27.177.86:5672)

2020-11-30 15:09:59.187 [error] <0.805.0> Error on AMQP connection <0.805.0> (10.27.171.226:42340 -> 10.27.177.86:5672, state: starting):

PLAIN login refused: user 'guest' - invalid credentials
```
So the error is definitely not a wrong authentication, as some restarts later it works fine. Sometimes it needs deleting the namespace and redeploying.
Can someone please give me some pointers as to where to look?

Thanks,

Robel

[Luke Bakken]

Hello,

I see you're using the LDAP plugin. Can you share your complete RabbitMQ configuration?

[Robel Yemane]

I'm using the out of box config from bitnami, and have enabled auth.username/auth.password=guest here https://github.com/bitnami/charts/blob/ce1bb7346be2c53bd9b2db0f35200bd948e765bb/bitnami/rabbitmq/values.yaml#L51-L60 . 
As for the ldap it has been disabled here: https://github.com/bitnami/charts/blob/master/bitnami/rabbitmq/values.yaml#L266 .

Also, what's intriguing is that this error is intermittent. Deleting the namespace and having a fresh install, seems to fix the issue.

[Luke Bakken]

Hello -

This issue is more than likely due to how bitnami configures RabbitMQ, or your environment. If this were a bug in RabbitMQ we would hear about it frequently.

Please note that, in default RabbitMQ installations (non-bitnami), guest / guest will NOT allow external connections (https://www.rabbitmq.com/access-control.html#loopback-users). I don't know exactly what the bitnami helm chart does to modify this default behavior, nor how it could lead to intermittent failures, but I thought I'd bring it up.

When this issue happens again, please run these commands on the same node where the "invalid credentials message is logged. Save the output to a file and attach it to a follow-up message:

rabbitmqctl authenticate_user guest guest

rabbitmqctl report

It may also help for you to change the RabbitMQ log level to debug as that may show more information.

 

 the ldap it has been disabled here: https://github.com/bitnami/charts/blob/master/bitnami/rabbitmq/values.yaml#L266 .

Are you sure about that? You can see the plugin is enabled in the output you provided:

[Robel Yemane]

Thanks Luke. 
I will switch to debug level logging and then see. Connections to RMQ are from services/apps within the cluster, using guest/guest, but thanks for that info.

Will reply here once I have more information with regards to "invalid credentials" message and post it here.

--
You received this message because you are subscribed to a topic in the Google Groups "rabbitmq-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/rabbitmq-users/VqXOoRQULeo/unsubscribe.
To unsubscribe from this group and all its topics, send an email to rabbitmq-user...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/rabbitmq-users/8afec754-0be3-4124-8db9-6b6f33b3c979n%40googlegroups.com.

--

Robel Yemane

Want to change how you receive these emails? You can update your preferences or unsubscribe from Currencycloud communications by clicking here