For some reason I can't reply on Google Groups directly, so I apologize if this email messes up the thread.
I have two dedicated memcached servers I'm using for testing: memcache1.dev.example.ec2 and memcache2.dev.example.ec2. Tomcat is setup to use both, with memcache1 listed first. I logged into my website and established a session. Then I terminated memcached on memcache1 and refreshed the page. At that point, I start seeing the following in the logs a handful of times:
---snip---
2011-08-06 16:35:19.037 INFO net.spy.memcached.MemcachedConnection: Reconnecting {QA sa=memcache1.dev.example.ec2/
10.36.35.2:11211, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}
2011-08-06 16:35:19.038 INFO net.spy.memcached.MemcachedConnection: Connection state changed for sun.nio.ch.SelectionKeyImpl@43649854
2011-08-06 16:35:19.039 INFO net.spy.memcached.MemcachedConnection: Reconnecting due to failure to connect to {QA sa=memcache1.dev.example.ec2/
10.36.35.2:11211, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at net.spy.memcached.MemcachedConnection.handleIO(MemcachedConnection.java:322)
at net.spy.memcached.MemcachedConnection.handleIO(MemcachedConnection.java:219)
at net.spy.memcached.MemcachedClient.run(MemcachedClient.java:1591)
2011-08-06 16:35:19.039 WARN net.spy.memcached.MemcachedConnection: Closing, and reopening {QA sa=memcache1.dev.example.ec2/
10.36.35.2:11211, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0}, attempt 2.
After that, I start seeing the following at least every couple seconds, if not more frequently, until I restart the first memcached server:
---snip---
Aug 6, 2011 4:35:39 PM de.javakaffee.web.msm.LockingStrategy$OnBackupWithoutLoadedSessionTask pingSessionBackup
WARNING: An exception occurred when trying to ping session 155A08552A63C7ED9A0676D774F57DE9-memcache2
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Cancelled
at net.spy.memcached.internal.OperationFuture.get(OperationFuture.java:75)
at de.javakaffee.web.msm.LockingStrategy$OnBackupWithoutLoadedSessionTask.pingSessionBackup(LockingStrategy.java:618)
at de.javakaffee.web.msm.LockingStrategy$OnBackupWithoutLoadedSessionTask.call(LockingStrategy.java:595)
at de.javakaffee.web.msm.LockingStrategy$OnBackupWithoutLoadedSessionTask.call(LockingStrategy.java:563)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: Cancelled
... 9 more
-Sean