Increase memcache quota

366 views
Skip to first unread message

gks

unread,
May 24, 2012, 3:47:18 AM5/24/12
to google-a...@googlegroups.com
My application heavily use memcache to store data that is not often changed. However, I notice the total memcache memory that can be used is capped at around 64MB, and usually an object is evicted after 5 mins. From the quota detail, I found my app sends 45GB data to memcache daily and can only retrieve 2GB back. All these metrics tell me one thing: my application needs more memcache memory quota in order to run more efficiently.

Is there a way to increase memory quota for my application? Or is there a paid memcache service that I can use?

Marcel Manz

unread,
May 24, 2012, 9:19:15 AM5/24/12
to google-a...@googlegroups.com

Barry Hunter

unread,
May 24, 2012, 10:25:24 AM5/24/12
to google-a...@googlegroups.com
> Or is there a
> paid memcache service that I can use?

Well you can setup a "memcache like" service running on a backend
instance. In theory you could utilise the whole of the instance memory
to hold data.

So could get 1G of 'memcache' for $0.64 an hour.

---

Or a slightly more quirky idea is to use cloud-SQL :)

https://developers.google.com/cloud-sql/docs/billing

Should be cheaper than a backend instance for the equivilent amount of
memory. The mysql query cache, should give you memcache like
performance. Plus also can use the disk to make storage go further.



(in theory, cloud-sql for plain key lookups should be faster than the
datastore - which is the main reason to use memcache - memcache is
faster than the datastore)

gks

unread,
May 24, 2012, 12:48:44 PM5/24/12
to google-a...@googlegroups.com
Thanks for the suggestion! Actually I have already started to look into using Backend instance to build a memcache service. Do you know the service behavior of backend instance on multiple parallel requests? Will these requests be queued and served one by one, or will multiple requests be process in parallel? I could not find any document on its behavior. When traffic grows, since backend memcache instance can become a bottleneck to the system, it's important for me to understand capacity of each instance and plan ahead.

And I really like your idea of cloud-sql! It seems support parallel requests by default. If data is mostly stored in memory, its performance should be good. I will also look into it. If anyone on the forum has some performance data on cloud-sql instance, please share with me.

Thanks!

Brandon Wirtz

unread,
May 24, 2012, 12:55:44 PM5/24/12
to google-a...@googlegroups.com

These are my current numbers from my primary app as reported by memcache viewer

 

Hit count:            620755

Miss count:         2302621

Hit ratio:               21%

Item count:        511030 item(s)

Total cache size:               1381176411 byte(s)

Oldest item age:               3 hour(s) 4 min(s) 38 second(s)

 

 

 

From: google-a...@googlegroups.com [mailto:google-a...@googlegroups.com] On Behalf Of Marcel Manz
Sent: Thursday, May 24, 2012 6:19 AM
To: google-a...@googlegroups.com
Subject: [google-appengine] Re: Increase memcache quota

 

Star this: http://code.google.com/p/googleappengine/issues/detail?id=6078

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/AaU6MSD_a9wJ.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

Reply all
Reply to author
Forward
0 new messages