Maxscale Error

[Vasu deva rao]

Hello Team,

We have environment like , 2 Mariadb server [ With GTID Replication ] + 2 Maxscale Servers [ Active and Passive ] and Application will connect to VIP .

We are seeing JMS issue past weeks and it starts around  00:00 UTC  every Monday   . when we check  jms log for swifrmq we see backend disconnect error.

Can someone please check is anything you see in DB logs. We trying to find cause of JMS  issue here.

Frequently we are seeing from one application errors like below ,

We are seeing JMS [ Application ] issue past weeks and it starts around  00:00 UTC  every Monday   . when we check  jms log for swifrmq we see backend disconnect error.

 tailf /usr/local/swiftmq/log/instance1/error.log
2021-11-17 06:49:01.69/sys$routing/ERROR/Router 'router4' is already connected. Connection REJECTED!
2021-11-17 13:40:16.599/sys$routing/ERROR/Router 'router4' is already connected. Connection REJECTED!
2021-11-22 01:59:32.57/sys$routing/ERROR/Router 'router4' is already connected. Connection REJECTED!
2021-11-28 01:01:34.861/sys$routing/ERROR/Router 'router4' is already connected. Connection REJECTED!
2021-11-29 00:06:22.749/sys$routing/ERROR/[RoutingConnection router4|10.163.24.50:60486]/v942XADeliveryStage, recoveryBranchQ=swiftmq/src=router1/dest=router4/visited, request=[CommitRequest [Request, dispatchId=0 requestNumber=0 correlationId=0 timeout=-1 replyRequired=false reply=null], xid=[XidImpl, branchQualifier=swiftmq/src=router1/dest=router4, formatId=586776, globalTransactionId=1638061414986-586776, routing=true]] exception=com.swiftmq.swiftlet.queue.QueueException: com.swiftmq.swiftlet.store.StoreException: java.sql.SQLException: (conn=45950583) Lost connection to backend server., disconnecting

 
From Maxscale log file :-

I saw below messages in maxscale.log around the time of errors. Still need to figure out why we get these errors. From the graphs, we see the connections, reads, writes all dropped very low around that time.

2021-11-29 00:06:20 error : (48290697) Invalid authentication message from backend 'server2'. Error code: 1040, Msg : Too many connections
2021-11-29 00:06:20 error : (48290697) Unable to write to backend 'server2' due to authentication failure. Server in state RUNNING MASTER.
2021-11-29 00:06:20 error : (48290697) Routing the query failed. Session will be closed.
2021-11-29 00:06:20 error : (48290724) Invalid authentication message from backend 'server2'. Error code: 1040, Msg : Too many connections
2021-11-29 00:06:20 error : (48290725) Invalid authentication message from backend 'server2'. Error code: 1040, Msg : Too many connections
2021-11-29 00:06:20 error : (48290724) Unable to write to backend 'server2' due to authentication failure. Server in state RUNNING MASTER.
2021-11-29 00:06:20 error : (48290724) Routing the query failed. Session will be closed.

Can any one guide / help us on this .

Maxscale Version = 2.5.14 and 2.3..3 

Thanks,

Vasudeva Rao

07899917070

[Markus Mäkelä]

Hi,

The error shows that the value of max_connections is too small on the backend servers. Increasing it should fix the problem.

Markus

--
You received this message because you are subscribed to the Google Groups "MaxScale" group.
To unsubscribe from this group and stop receiving emails from it, send an email to maxscale+u...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/maxscale/CAMZCHEZC4krYQFkTb13n13io1UJ8UASxy2UCoop%2BNAwQwBCPbQ%40mail.gmail.com.

--

Markus Mäkelä, Senior Software Engineer
MariaDB Corporation