Has google raised the 1000 results limit?

22 views
Skip to first unread message

Kuber

unread,
Aug 7, 2008, 5:28:34 AM8/7/08
to Google App Engine
Today I wanted to test against the 1000 limitation. I run the
following code on local machine and got more than 1000 results:
def load():
stories = Story.all().fetch(5000)
count = 0
for story in stories:
count += 1
if story.LinkCount > 0:
storyList.append(story)
logging.info(str(count))
memcache.add('storyList', storyList)
return storyList

the logging output 1893. Has google raised the limit in the latest
SDK? I have not got chance to test on production yet.

BTW, got an error indicating that memcache no more than 1000000
bytes, which I cannot find in any documentation. Anybody got any idea?

Aral

unread,
Aug 7, 2008, 1:37:23 PM8/7/08
to Google App Engine
> BTW, got an error indicating that memcache no more than 1000000
> bytes, which I cannot find in any documentation. Anybody got any idea?

Unless someone from Google has examples to the contrary, I've run up
against the 1MB limit in nearly everything on Google App Engine. It
appears currently to be a hard limit on all data structures.

See http://aralbalkan.com/1434 for other examples.

Aral

Aral

unread,
Aug 7, 2008, 1:38:48 PM8/7/08
to Google App Engine
> the logging output 1893. Has google raised the limit in the latest
> SDK? I have not got chance to test on production yet.

Remember that limits/quotas etc. are not faithfully reproduced in the
SDK.

"Hardened"/crippled Python functionality, on the other hand, appears
to be pretty faithful to the deployment environment in my limited
experience.

Aral

Ozgur Cem S.

unread,
Aug 7, 2008, 4:30:22 PM8/7/08
to Google App Engine
Hi (or merhaba) Aral,

I was just about to ask; what possibly could you be returning in one
response over 1 MB, or store something of that size in one row (rdbms
terms)... Later I realized, going over 1 MB in a mediocre quality
image is very possible.

By the way, your name appears somewhere in my app's code. I should've
come across this line of code somewhere in your blog or in one of your
posts. I was going bonkers trying to figure out, how the ..... I'd
modify the path. Hence, thanks for that. :)
-----------------
#Thanks to Aral Balkan for this tip
sys.path = sys.path + [os.path.dirname(__file__)+'/pickleloader']
-----------------

Cem

Kuber

unread,
Aug 7, 2008, 10:52:50 PM8/7/08
to Google App Engine
Thank you, Aral for the answer.
Your blog is nice. I have subscribed your blog.

Aral Balkan

unread,
Aug 9, 2008, 2:04:45 PM8/9/08
to Google App Engine
Hey/merhaba cem,

> I was just about to ask; what possibly could you be returning in one
> response over 1 MB, or store something of that size in one row (rdbms
> terms)... Later I realized, going over 1 MB in a mediocre quality
> image is very possible.

Actually, it's for backups, but yes, images/media etc. can easily
bring you over the limit.

> By the way, your name appears somewhere in my app's code. I should've
> come across this line of code somewhere in your blog or in one of your
> posts. I was going bonkers trying to figure out, how the .....  I'd
> modify the path. Hence, thanks for that. :)

You're welcome :) Glad I was able to help! :)

Aral

Aral Balkan

unread,
Aug 9, 2008, 2:05:10 PM8/9/08
to Google App Engine
You're welcome and thanks for the kind words :)

Aral

On Aug 8, 3:52 am, Kuber <polo...@gmail.com> wrote:
> Thank you, Aral for the answer.
> Your blog is nice. I have subscribed your blog.
<snip>
Reply all
Reply to author
Forward
0 new messages