High replication data - Space freed after cache expiration?

46 views
Skip to first unread message

Transaction Commerce

unread,
Jun 10, 2011, 6:23:27 AM6/10/11
to Google App Engine
Hi all,
I'm new user of the Google App Engine, I have a CDN in High
Replication Data mode... and It's great ;)

I have an simple question: Do my High Replication Data quota drop down
when the cache expiration of my datas are reached?
Or It continusly goes up?

Thanc's In advance (Sorry for my bad english!)

Luca

Robert Kluin

unread,
Jun 11, 2011, 4:37:44 PM6/11/11
to google-a...@googlegroups.com
Hi Luca,
What does "High Replication Data quota drop down when the cache
expiration of my datas are reached" mean? You're talking about the
datastore, but mentioning "cache expiration of my datas" which makes
me wonder if you're talking about memcache or perhaps request cache
headers?

Perhaps you can rephrase and clarify the question.


Robert

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
>
>

Darktux

unread,
Jun 11, 2011, 6:52:26 PM6/11/11
to google-a...@googlegroups.com
Hi, you're rigth,

I talk about the amount of data of the High replication data quota.
So, I want to know if the High replication data quantity drops down when my data expiration date is reached?
For the moment the HRD amount only goes up, even if I've deleted some great quantity of files.

Thanks a lot ;)


2011/6/11 Robert Kluin <robert...@gmail.com>

Anders

unread,
Jun 12, 2011, 5:38:13 AM6/12/11
to google-a...@googlegroups.com
In one of my apps I started deleting high replication data (entities stored in the datastore) and the quota started to decrease, so yes deleting entities will free up quota. The cache (memcache) is a separate function not affecting the datastore quota. Data in the datastore is stored permanently unless deleted and the quota is the total data stored for all times.

Robert Kluin

unread,
Jun 12, 2011, 11:35:05 PM6/12/11
to google-a...@googlegroups.com
Stored data is a cumulative quota; in other words, your total stored
data gets counted not the daily increase. Deleting datastore
entities, or blobs from the blobstore, will decrease stored data.
However, there is a lag between when you delete the data and the quota
updates.

I'm not sure what you mean by data expiration date. You'll have to
write something to delete entities.

I'm also not sure what you mean by files. Are you talking about
application files, blobs, datastore entities, something else?


Robert

Darktux

unread,
Jun 13, 2011, 5:08:56 AM6/13/11
to google-a...@googlegroups.com
Hi all, and a big thank's for all your help,

Ok, your explication about the stored data is exactly what I mean Robert!

My application is a CDN, my blob files expiration date is about 1 month. So, I taught my files are deleted by a cron job when this date is reached!

If not, do I remoove files manualy?

Thank's a lot again ;)

Luca

2011/6/13 Robert Kluin <robert...@gmail.com>

Robert Kluin

unread,
Jun 13, 2011, 10:51:20 AM6/13/11
to google-a...@googlegroups.com
I'm not aware of an expiration date for blobs.

If you write the cron, then you can use the blobstore delete function:
http://code.google.com/appengine/docs/python/blobstore/functions.html#delete

Or, if you're actually storing a BlobProperty in the datastore:
http://code.google.com/appengine/docs/python/datastore/functions.html#delete

Robert

Reply all
Reply to author
Forward
0 new messages