maximum size of memcached instance

658 views
Skip to first unread message

md

unread,
May 5, 2011, 12:04:01 PM5/5/11
to memcached, manish...@tcs.com
HI
Can i define memcached instance of 32 GB /64 GB or 96 GB. Typical rac
server has 16 core 96 GB. can i utilize this 96 GB with memcached
cache. I have large objects to cache. value of a key is 1 MB -3MB.
This object is xml data having binary data in it.

Reason for doing this is that this data is accessed multiple times
during processing. This data is discarded from cache once processing
is over for this data.

Is this right usage of memcached and will memcached scale to meet this
requirement?

Application that access cache is java based. So which is the right
protocol for java client to communicated with memcached server.

Regards,
Manish

dormando

unread,
May 5, 2011, 6:03:19 PM5/5/11
to memcached, manish...@tcs.com

You can use the -I option to increase the max object size (it defaults to
1mb), but that will reduce the overall memory efficiency. So you still
shouldn't set it too high.

If your server has 96G of ram, you still need to leave some left over for
the OS, memcached's hash table, connection management, buffers, and TCP
sockets. So I'd put that closer to 92G or 90G for memcached.

It shouldn't be hard to prototype and see if it'd help? It's not clear if
you have multiple servers accessed this shared data, or if it's just one
process accessing the same information multiple times, etc.

-Dormando

md

unread,
May 6, 2011, 7:58:16 AM5/6/11
to memcached
There are going to be multiple processes that would access this cache.
It's event driven architecture and cache is referred at various stages
of processing.

so as i understand from your reply, having a 72 GB cache size is not
an issue. Hope there are such installations out there. would like to
operational/performance issues if any.

However keeping objects of more than 1 MB can cause problems.

Any suggestions about client protocol?
Regards
Manish

Adam Lee

unread,
May 7, 2011, 4:05:28 PM5/7/11
to memc...@googlegroups.com

memcached can handle that no problem- there are much larger and busier instances in production out there.

my one question, though, would be why are you caching the xml instead of parsing it and caching the resulting data?  it seems silly to parse the same thing multiple times.

awl

Reply all
Reply to author
Forward
0 new messages