memcache connection manager locking up

4 views
Skip to first unread message

PiperPilot

unread,
Aug 17, 2010, 8:45:39 AM8/17/10
to AmFast
Hey guys,

Is anyone using the memcache connection manager with Apache and a busy
application? In preparation for a big event in a couple weeks, I
switched over to using memcache thinking it would be better
performance and lower impact on my server than the
django_connection_manager/subscription_manager that I have written.
In doing some testing last night, I ran into some major issues. When
I do multiple simultaneous messaging operations with threading, it
seems to lock up my python application.

So a couple of questions:

1. What version of memcache was the implementation based on? I am
using 1.4.5. I notice there is a stable version 1.2.8 but not sure of
the differences.

2. Are there any issues with the memcache implementation and
threading?

3. Anything else I need to be looking at.

I'm gonna spend a few hours looking at the memcache_subscription and
connection code today, but wanted to throw this out there in case
anyone else had run into this before.

Thanks,
Curtis

limscoder

unread,
Aug 17, 2010, 12:19:14 PM8/17/10
to AmFast
When I coded the memcache implementation, it was tested against Google
App Engine's implementation. I have yet to use it in any production
settings. A couple of issues could exist. It relies on storing lock
information in memcache to control multiple threads accessing the same
data, so there could be a race condition somewhere. It also stores
very small pieces of data for each memcache key, which may cause some
performance issues (just guessing here, I haven't done any profiling.)

-Dave

Curtis C. Pope

unread,
Aug 17, 2010, 12:23:29 PM8/17/10
to amf...@googlegroups.com
Thanks Dave...if I have time, I'll dig into it.

In the meantime, my django_subscription_manager and
django_connection_manager code seems to be very stable and working well.
What is the best way for me to submit that to the project?

-Dave

--
You received this message because you are subscribed to the Google Groups
"AmFast" group.
To post to this group, send email to amf...@googlegroups.com.
To unsubscribe from this group, send email to
amfast+un...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/amfast?hl=en.


limscoder

unread,
Aug 17, 2010, 12:35:20 PM8/17/10
to AmFast
Create a ticket on the AmFast site, and attach a diff from the current
trunk version. I will review the code and integrate it.

thanks
-Dave

ChrisG

unread,
Sep 13, 2010, 7:11:58 PM9/13/10
to AmFast
amfast/remoting/memcache_connection_manager.py has an unindent that is
incorrect.
Reply all
Reply to author
Forward
0 new messages