"Access denied" for monitoring user
262 views
Skip to first unread message
Himanshu Sharma
Feb 24, 2024, 8:13:07 AM2/24/24
to proxysql
Hi Team,
I have 4 VMs proxySQL cluster and 3 VMs MariaDB cluster in setup.
On each node of the proxycluster, proxySQL is installed and running in container.
Any assistance on understanding why below reported error logs are coming for monitoring user. What impacts it cause and how to fix this.
My error log on each node is filled with below alerts:
$ tail -f podman-mariadb.out
2024-02-24T12:38:40.580738874+00:00 stdout F 2024-02-24 12:38:40 2418189 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:40.716005918+00:00 stdout F 2024-02-24 12:38:40 2418190 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:40.776701322+00:00 stdout F 2024-02-24 12:38:40 2418191 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:41.018589134+00:00 stdout F 2024-02-24 12:38:41 2418192 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:41.655475870+00:00 stdout F 2024-02-24 12:38:41 2418193 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.581581033+00:00 stdout F 2024-02-24 12:38:42 2418194 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.590416480+00:00 stdout F 2024-02-24 12:38:42 2418195 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.716654958+00:00 stdout F 2024-02-24 12:38:42 2418196 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.778264760+00:00 stdout F 2024-02-24 12:38:42 2418197 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
Info on user 'proxysql' on mariadb:
===================================
MariaDB [(none)]> select user,host from mysql.user where user='proxysql';
+----------+------+
| User | Host |
+----------+------+
| proxysql | % |
+----------+------+
1 row in set (0.001 sec)
MariaDB [(none)]> show grants for proxysql;
+--------------------------------------------------------------------------------------------------------------------------+
| Grants for proxysql@% |
+--------------------------------------------------------------------------------------------------------------------------+
| GRANT `AMA_SVC_PROXYSQL` TO `proxysql`@`%` |
| GRANT BINLOG MONITOR ON *.* TO `proxysql`@`%` IDENTIFIED VIA ed25519 USING 'QBvzNJu26QqkOyb/WNotamaPyhuIdygc/nNZyN3k4Kg' |
| SET DEFAULT ROLE `AMA_SVC_PROXYSQL` FOR `proxysql`@`%` |
+--------------------------------------------------------------------------------------------------------------------------+
3 rows in set (0.000 sec)
MariaDB [(none)]>
ProxySQL Setup Info:
====================
$ grep -i monitoring podman-proxysql.out | tail -n 100
2024-02-24T12:41:56.111439749+00:00 stderr F 2024-02-24 12:41:56 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:05.970685302+00:00 stderr F 2024-02-24 12:42:05 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:06.072179627+00:00 stderr F 2024-02-24 12:42:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:06.172243925+00:00 stderr F 2024-02-24 12:42:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:15.970862036+00:00 stderr F 2024-02-24 12:42:15 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
q2024-02-24T12:42:16.076907009+00:00 stderr F 2024-02-24 12:42:16 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:16.182311949+00:00 stderr F 2024-02-24 12:42:16 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:25.971331207+00:00 stderr F 2024-02-24 12:42:25 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:26.071568878+00:00 stderr F 2024-02-24 12:42:26 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:26.171784218+00:00 stderr F 2024-02-24 12:42:26 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:35.972029917+00:00 stderr F 2024-02-24 12:42:35 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:36.046164222+00:00 stderr F 2024-02-24 12:42:36 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:36.120635826+00:00 stderr F 2024-02-24 12:42:36 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:45.972003526+00:00 stderr F 2024-02-24 12:42:45 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:46.080274163+00:00 stderr F 2024-02-24 12:42:46 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:46.188804263+00:00 stderr F 2024-02-24 12:42:46 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:55.972816571+00:00 stderr F 2024-02-24 12:42:55 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:56.063844714+00:00 stderr F 2024-02-24 12:42:56 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:56.154918226+00:00 stderr F 2024-02-24 12:42:56 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:43:05.972301322+00:00 stderr F 2024-02-24 12:43:05 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:43:06.054093861+00:00 stderr F 2024-02-24 12:43:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:43:06.136202556+00:00 stderr F 2024-02-24 12:43:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
...trimming logs further
ProxySQL Admin>select * from global_variables where variable_name IN ('mysql-monitor_username','mysql-monitor_password');
+------------------------+----------------------+
| variable_name | variable_value |
+------------------------+----------------------+
| mysql-monitor_password | <SOME PASSWORD>
| mysql-monitor_username | proxysql | <---------
+------------------------+----------------------+
2 rows in set (0.001 sec)
ProxySQL Admin>
The very first initialisation/bootstrap happens via the confgiration file /etc/proxysql.cnf.
--
datadir="/var/lib/proxysql"
admin_variables=
{
mysql_ifaces="0.0.0.0:6034"
}
proxysql_servers =
(
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
},
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
},
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
},
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
}
)
Let me know if any thing else to mention.
I see similar log entry is mentioned in below page:
https://proxysql.com/documentation/error-log/
2022-06-10 17:11:36 MySQL_Monitor.cpp:968:monitor_connect_thread(): [ERROR] Server 127.0.0.1:3306 is returning "Access denied" for monitoring user
Thanks & Regards,
On each node of the proxycluster, proxySQL is installed and running in container.
Any assistance on understanding why below reported error logs are coming for monitoring user. What impacts it cause and how to fix this.
My error log on each node is filled with below alerts:
$ tail -f podman-mariadb.out
2024-02-24T12:38:40.580738874+00:00 stdout F 2024-02-24 12:38:40 2418189 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:40.716005918+00:00 stdout F 2024-02-24 12:38:40 2418190 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:40.776701322+00:00 stdout F 2024-02-24 12:38:40 2418191 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:41.018589134+00:00 stdout F 2024-02-24 12:38:41 2418192 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:41.655475870+00:00 stdout F 2024-02-24 12:38:41 2418193 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.581581033+00:00 stdout F 2024-02-24 12:38:42 2418194 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.590416480+00:00 stdout F 2024-02-24 12:38:42 2418195 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.716654958+00:00 stdout F 2024-02-24 12:38:42 2418196 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
2024-02-24T12:38:42.778264760+00:00 stdout F 2024-02-24 12:38:42 2418197 [Warning] Access denied for user 'proxysql'@'<IP>' (using password: YES)
Info on user 'proxysql' on mariadb:
===================================
MariaDB [(none)]> select user,host from mysql.user where user='proxysql';
+----------+------+
| User | Host |
+----------+------+
| proxysql | % |
+----------+------+
1 row in set (0.001 sec)
MariaDB [(none)]> show grants for proxysql;
+--------------------------------------------------------------------------------------------------------------------------+
| Grants for proxysql@% |
+--------------------------------------------------------------------------------------------------------------------------+
| GRANT `AMA_SVC_PROXYSQL` TO `proxysql`@`%` |
| GRANT BINLOG MONITOR ON *.* TO `proxysql`@`%` IDENTIFIED VIA ed25519 USING 'QBvzNJu26QqkOyb/WNotamaPyhuIdygc/nNZyN3k4Kg' |
| SET DEFAULT ROLE `AMA_SVC_PROXYSQL` FOR `proxysql`@`%` |
+--------------------------------------------------------------------------------------------------------------------------+
3 rows in set (0.000 sec)
MariaDB [(none)]>
ProxySQL Setup Info:
====================
$ grep -i monitoring podman-proxysql.out | tail -n 100
2024-02-24T12:41:56.111439749+00:00 stderr F 2024-02-24 12:41:56 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:05.970685302+00:00 stderr F 2024-02-24 12:42:05 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:06.072179627+00:00 stderr F 2024-02-24 12:42:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:06.172243925+00:00 stderr F 2024-02-24 12:42:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:15.970862036+00:00 stderr F 2024-02-24 12:42:15 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
q2024-02-24T12:42:16.076907009+00:00 stderr F 2024-02-24 12:42:16 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:16.182311949+00:00 stderr F 2024-02-24 12:42:16 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:25.971331207+00:00 stderr F 2024-02-24 12:42:25 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:26.071568878+00:00 stderr F 2024-02-24 12:42:26 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:26.171784218+00:00 stderr F 2024-02-24 12:42:26 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:35.972029917+00:00 stderr F 2024-02-24 12:42:35 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:36.046164222+00:00 stderr F 2024-02-24 12:42:36 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:36.120635826+00:00 stderr F 2024-02-24 12:42:36 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:45.972003526+00:00 stderr F 2024-02-24 12:42:45 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:46.080274163+00:00 stderr F 2024-02-24 12:42:46 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:46.188804263+00:00 stderr F 2024-02-24 12:42:46 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:55.972816571+00:00 stderr F 2024-02-24 12:42:55 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:56.063844714+00:00 stderr F 2024-02-24 12:42:56 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:42:56.154918226+00:00 stderr F 2024-02-24 12:42:56 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:43:05.972301322+00:00 stderr F 2024-02-24 12:43:05 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:43:06.054093861+00:00 stderr F 2024-02-24 12:43:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
2024-02-24T12:43:06.136202556+00:00 stderr F 2024-02-24 12:43:06 MySQL_Monitor.cpp:1298:monitor_connect_thread(): [ERROR] Server <SOME IP>:<SOME PORT#> is returning "Access denied" for monitoring user
...trimming logs further
ProxySQL Admin>select * from global_variables where variable_name IN ('mysql-monitor_username','mysql-monitor_password');
+------------------------+----------------------+
| variable_name | variable_value |
+------------------------+----------------------+
| mysql-monitor_password | <SOME PASSWORD>
| mysql-monitor_username | proxysql | <---------
+------------------------+----------------------+
2 rows in set (0.001 sec)
ProxySQL Admin>
The very first initialisation/bootstrap happens via the confgiration file /etc/proxysql.cnf.
--
datadir="/var/lib/proxysql"
admin_variables=
{
mysql_ifaces="0.0.0.0:6034"
}
proxysql_servers =
(
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
},
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
},
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
},
{
hostname="<SOME IP>"
port=6034
weight=0
comment=""
}
)
Let me know if any thing else to mention.
I see similar log entry is mentioned in below page:
https://proxysql.com/documentation/error-log/
2022-06-10 17:11:36 MySQL_Monitor.cpp:968:monitor_connect_thread(): [ERROR] Server 127.0.0.1:3306 is returning "Access denied" for monitoring user
Thanks & Regards,
Himanshu Sharma
Feb 24, 2024, 9:10:27 AM2/24/24
to proxysql
I forgot to mention:
admin_credentials "were also part of proxysql.cnf" which after 1st startup of proxySQL, I remove.
admin_credentials "were also part of proxysql.cnf" which after 1st startup of proxySQL, I remove.
Himanshu Sharma
Feb 25, 2024, 3:17:16 AM2/25/24
to proxysql
I found the problem, Issue was in setting complex passwords including special characters.
mysql-monitor_password | *******ozW_U**
When I reset the password to an easier one, it solved the problem.
mysql-monitor_password | monitor
Thanks & Regards,
Himanshu
-
--
You received this message because you are subscribed to a topic in the Google Groups "proxysql" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/proxysql/UlxJrxaj3aA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to proxysql+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/proxysql/949297b5-03f8-40b6-9ed2-b919dd7394a1n%40googlegroups.com.
Thanks and Regards
Himanshu Sharma
Reply all
Reply to author
Forward
0 new messages