Complete list of limits and quotas?

[T.J. Crowder]

Hi all,

Thrilled about the AppEngine Java support and reading up on the
platform, etc. Very exciting stuff.

Information about the various limits imposed by the system seems to be
a bit spread all over, is there anywhere one can go for a quick
rundown of *all* the various limits?

Naturally there's the quotas page[1], but then there are further
significant limits for the datastore[2], and neither of those pages
mentions that there is apparently a limit on the number of datastore
indices[3] -- a very important piece of information. It also appears
that each static file in your app can be no more than 10MB[4].
There's some disagreement amongst pages as well; the overview page[5]
says the free accounts get 500MB of storage, but the quotas page
(presumably the more canonical of the two) says 1GB. Apparently
requests must be satisfied within 30 seconds[4][5]. A user seemed to
say[6] in the group that there is a 1,000 file limit, but I haven't
found that one (yet!) from Google. And it's not clear to me whether
it's 1GB of storage, total, or 1GB of datastore storage *plus* the
storage of your application files.

For clarity, this is not criticism disguised as a question. I'm
really asking the question. :-) Is this all pulled together somewhere
I've missed so far? Apologies if I've overlooked the obvious, which
wouldn't surprise me.

[1] http://code.google.com/appengine/docs/quotas.html
[2] http://code.google.com/appengine/docs/java/datastore/overview.html#Quotas_and_Limits
[3] http://groups.google.com/group/google-appengine/browse_thread/thread/4f98d2c04fac0fb9
[4] http://googleappengine.blogspot.com/2009/02/skys-almost-limit-high-cpu-is-no-more.html
[5] http://code.google.com/appengine/docs/whatisgoogleappengine.html
[6] http://groups.google.com/group/google-appengine/browse_thread/thread/2c8275f82a11ca12/e38a73671724c264?#e38a73671724c264

Thanks in advance,
--
T.J. Crowder
tj / crowder software / com
Independent Software Engineer, consulting services available

[哇哈哈]

Yes.

2009/4/11 T.J. Crowder <t...@crowdersoftware.com>

[T.J. Crowder]

Hi all,

Only-slightly-abashedly bumping this, having foolishly posted it
during the holiday weekend. Apparently (continuing the list) there's
a "Workflow Backend Index Task Count"[1] as well.

Anyone (at Google or otherwise) have a link to an official
comprehensive list, and if so, would you post it? If not, perhaps we
should try to bring together links for the disparate parts.

[1] http://groups.google.com/group/google-appengine/browse_thread/thread/733e8830bdb4b843

Thanks in advance,
--
T.J. Crowder
tj / crowder software / com
Independent Software Engineer, consulting services available

> [2]http://code.google.com/appengine/docs/java/datastore/overview.html#Qu...
> [3]http://groups.google.com/group/google-appengine/browse_thread/thread/...
> [4]http://googleappengine.blogspot.com/2009/02/skys-almost-limit-high-cp...
> [5]http://code.google.com/appengine/docs/whatisgoogleappengine.html
> [6]http://groups.google.com/group/google-appengine/browse_thread/thread/...

[Jeff S (Google)]

Hi T.J.,

I'm glad you've raised this issue. The documentation on quotas has most of this information:

http://code.google.com/appengine/docs/quotas.html

For additional limitations, most overview sections on the APIs and services have specific details for that service. For example, see:

http://code.google.com/appengine/docs/java/datastore/overview.html#Quotas_and_Limits
http://code.google.com/appengine/docs/python/images/overview.html#Quotas_and_Limits
http://code.google.com/appengine/docs/java/mail/overview.html#Quotas_and_Limits

The limit on 100 custom composite indicies per app is not currently documented to my knowledge, part of the reason is that I think it would be best to design your app without that constraint in mind. So far, very few apps have hit this limit and if you need more than 100 indicies, I'd be happy to talk it over and see what we can work out. Recent reports of hitting this limit have been the result of an issue which caused the number of indicies to be overreported for a small subset of apps.

Thank you,

Jeff

[T.J. Crowder]

Hi Jeff,

Thanks for that. And thanks for all the help you provide to folks in
this group, I see you answering questions all over.

> The limit on 100 custom composite indicies per app is not currently
> documented to my knowledge, part of the reason is that I think it would be
> best to design your app without that constraint in mind.

IMHO, it's really, really important to document *all* of the limits
and quotas, and in one canonical place -- an index, if you will, of
quotas and limitations, with links to detail in the various pages you
and I have linked earlier. In relatively little reading in this
group, I've run into the list I provided earlier and apparently
there's something called the "App Config Service Config App Call
Count" quota[1]; what else is there, lurking, waiting to trip up the
unwary developer?

[1] http://groups.google.com/group/google-appengine/browse_thread/thread/891ce78da54b3659

It's hard for me to envision seriously considering using AppEngine for
anything but a toy project when significant limitations (100 indexes
is significant) are not clearly documented. If you can work with
people on some of them, indicate that on the list; it's not a reason
not to document the limitation. I see in other threads, and greatly
appreciate, that Google is happy to work with people when they run
into quotas and have a good reason for needing more than the quota
currently allows, but that's not at all the same thing.

There is, clearly, a full list somewhere -- the admin console isn't
just making these quotas up. :-) Can I strongly suggest providing
this index of quotas, if only to demonstrate to people that concerns
like mine are unwarranted?

Thanks again,

--
T.J. Crowder
tj / crowder software / com
Independent Software Engineer, consulting services available

On Apr 15, 7:22 pm, "Jeff S (Google)" <j...@google.com> wrote:
> Hi T.J.,
>
> I'm glad you've raised this issue. The documentation on quotas has most of
> this information:
>
> http://code.google.com/appengine/docs/quotas.html
>
> For additional limitations, most overview sections on the APIs and services
> have specific details for that service. For example, see:
>

> http://code.google.com/appengine/docs/java/datastore/overview.html#Qu...http://code.google.com/appengine/docs/python/images/overview.html#Quo...http://code.google.com/appengine/docs/java/mail/overview.html#Quotas_...

>
> The limit on 100 custom composite indicies per app is not currently
> documented to my knowledge, part of the reason is that I think it would be
> best to design your app without that constraint in mind. So far, very few
> apps have hit this limit and if you need more than 100 indicies, I'd be
> happy to talk it over and see what we can work out. Recent reports of
> hitting this limit have been the result of an issue which caused the number
> of indicies to be overreported for a small subset of apps.
>
> Thank you,
>
> Jeff
>
> On Tue, Apr 14, 2009 at 1:51 PM, T.J. Crowder <t...@crowdersoftware.com>wrote:
>
>
>
> > Hi all,
>
> > Only-slightly-abashedly bumping this, having foolishly posted it
> > during the holiday weekend.  Apparently (continuing the list) there's
> > a "Workflow Backend Index Task Count"[1] as well.
>
> > Anyone (at Google or otherwise) have a link to an official
> > comprehensive list, and if so, would you post it?  If not, perhaps we
> > should try to bring together links for the disparate parts.
>
> > [1]

[T.J. Crowder]

Hi all,

FYI, I've opened Issue 1474 for this:
http://code.google.com/p/googleappengine/issues/detail?id=1474

--
T.J. Crowder
tj / crowder software / com
Independent Software Engineer, consulting services available

On Apr 24, 10:48 am, "T.J. Crowder" <t...@crowdersoftware.com> wrote:
> Hi Jeff,
>
> Thanks for that.  And thanks for all the help you provide to folks in
> this group, I see you answering questions all over.
>
> > The limit on 100 custom composite indicies per app is not currently
> > documented to my knowledge, part of the reason is that I think it would be
> > best to design your app without that constraint in mind.
>
> IMHO, it's really, really important to document *all* of the limits
> and quotas, and in one canonical place -- an index, if you will, of
> quotas and limitations, with links to detail in the various pages you
> and I have linked earlier.  In relatively little reading in this
> group, I've run into the list I provided earlier and apparently
> there's something called the "App Config Service Config App Call
> Count" quota[1]; what else is there, lurking, waiting to trip up the
> unwary developer?
>

> [1]http://groups.google.com/group/google-appengine/browse_thread/thread/...

>
> It's hard for me to envision seriously considering using AppEngine for
> anything but a toy project when significant limitations (100 indexes
> is significant) are not clearly documented.  If you can work with
> people on some of them, indicate that on the list; it's not a reason
> not to document the limitation.  I see in other threads, and greatly
> appreciate, that Google is happy to work with people when they run
> into quotas and have a good reason for needing more than the quota
> currently allows, but that's not at all the same thing.
>
> There is, clearly, a full list somewhere -- the admin console isn't
> just making these quotas up. :-)  Can I strongly suggest providing
> this index of quotas, if only to demonstrate to people that concerns
> like mine are unwarranted?
>
> Thanks again,
> --
> T.J. Crowder
> tj / crowder software / com
> Independent Software Engineer, consulting services available
>
> On Apr 15, 7:22 pm, "Jeff S (Google)" <j...@google.com> wrote:
>
> > Hi T.J.,
>
> > I'm glad you've raised this issue. The documentation on quotas has most of
> > this information:
>
> >http://code.google.com/appengine/docs/quotas.html
>
> > For additional limitations, most overview sections on the APIs and services
> > have specific details for that service. For example, see:
>

> >http://code.google.com/appengine/docs/java/datastore/overview.html#Qu......