URLFetch Quota Is Stupid

[Drake]

Ok, so I get that you don’t want me to build a DDoS platform with GAE.

 

But why the frak is there a limit on how many times a Backend can hit its own front end? (and Vice Versa)

 

Yes I hit these limits. Yes it makes me sad. Yes it limits my App.

 

We also tried and failed to make ProtoRPC replace URLFetch thinking this might mitigate the issue. That Failed.

We considered Google EndPoints. Doesn’t solve the issues that URLFetch is a limitation in the App.

We considered Channels, thinking we could move data via Messages, that doesn’t work servers can’t talk to each other.

 

This may be a deal breaker for us.

 

 

 

 

 

 

 

[Drake]

And why do backends talking to front ends consume Incoming Bandwidth?

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

[Peter McKenzie]

Hi Brandon,

I agree it may make sense to special case intra-App URLFetches.  Please file a bug on the issue tracker.

thanks,

Peter

[Drake]

Will do.

 

Can you take the quota off of me in the mean time J

 

--

You received this message because you are subscribed to the Google Groups "Google App Engine" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/EsrWRzLOWDQJ.

[Takashi Matsuo]

Hi Brandon,

Can we discuss this off-list? Please tell me your desired QPS, a purpose of your application, and your usage pattern of the service, etc.

-- Takashi

[Drake]

Sure.  But I have filed a billing support request via the Quota increase form every other day for 10 days, and gotten no response.

 

I really like the platform, but it often feels the only way to get support is to call people stupid in the public forum and hope that someone is looking who cares.

 

Off list message to follow.

 

 

--

You received this message because you are subscribed to the Google Groups "Google App Engine" group.

[Takashi Matsuo]

On Fri, Aug 31, 2012 at 4:13 PM, Drake <dra...@digerat.com> wrote:

Sure.  But I have filed a billing support request via the Quota increase form every other day for 10 days, and gotten no response.

Sorry it didn't work for you. I'm going to improve this process.

 

 

I really like the platform, but it often feels the only way to get support is to call people stupid in the public forum and hope that someone is looking who cares.

Well, so, I'd appreciate it if you could stop calling someone stupid. We'll respond to you not because you say stupid, but just because you're in trouble :)

-- Takashi

 

 

Off list message to follow.

 

 

From: google-a...@googlegroups.com [mailto:google-a...@googlegroups.com] On Behalf Of Takashi Matsuo
Sent: Thursday, August 30, 2012 9:58 PM
To: google-a...@googlegroups.com
Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid

 

 

Hi Brandon,

 

Can we discuss this off-list? Please tell me your desired QPS, a purpose of your application, and your usage pattern of the service, etc.

 

-- Takashi

--

You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

--
Takashi Matsuo | Developers Advocate | tma...@google.com

[Drake]

> Well, so, I'd appreciate it if you could stop calling someone stupid. We'll respond to you not because you say stupid, but just because you're in trouble :)

 

But it doesn’t work.

 

Check this list for when I posted about this the first time, on 8/24 which was after I had made the Request via the form, because I don’t like giving out the AppID in public.

 

I love AppEngine, but the support stinks.  I even tried to pay for better support.

 

That combined with constantly running in to things where Quotas bite me unexpectedly, Or change from what they were the week before.  Nothing sucks worse than waking up and finding your app is broken because something that you can’t see in the dashboard, and can’t find a documented number for.

[Richard Watson]

I think that a couple of the newer Google people on this list have helped greatly, though. Takashi does make an effort to respond and to send issues to the dev team, whereas at one point it was almost like they were intentionally ignoring us. So yeah, support does leave me feeling a little wary and there's a lot of "hope" when running on GAE, but I think it's definitely improved.

I wish I could pay e.g. $100 for a support query, though.  $6000 per year insurance just seems a bit high, unless you're already pretty profitable.

[Drake]

> I wish I could pay e.g. $100 for a support query, though.  $6000 per year insurance just seems a bit high, unless you're already pretty profitable.

$6k is worth it if you got Architecture support.  But it is really more billing support.

 

The biggest reason to pay the $500 is to be able to unify your billing and get invoiced monthly.

 

I have $2M burning a hole in my pocket. I don’t worry about the $6k, I worry about having the app over quota error message show up where my site once was.

 

 

 

[Jason Collins]

[It seems this thread has gone sideways - again.]

I would really, really love to see no urlfetch quota limitations between apps. Perhaps though you would need to enable this to prevent App Engine apps from maliciously hammering each other? If so, this technique seems fine to me:

remoteapi_CUSTOM_ENVIRONMENT_AUTHENTICATION = ('HTTP_X_APPENGINE_INBOUND_APPID',
['source appid here'])

It doesn't look like anyone has create a feature request for this, so I created one. Please star it.

  http://code.google.com/p/googleappengine/issues/detail?id=8051

j

[Drake]

Thanks for creating the feature request. We had a meet up yesterday, and So I haven’t had time to do so.

 

I might even be ok with Between App limits, but Between Front End and Backend is really stupid.  I can’t imagine a scenario where limiting the calls Intra-app makes sense.

 

From: google-a...@googlegroups.com [mailto:google-a...@googlegroups.com] On Behalf Of Jason Collins
Sent: Friday, August 31, 2012 9:41 AM
To: google-a...@googlegroups.com
Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid

 

[It seems this thread has gone sideways - again.]

--

You received this message because you are subscribed to the Google Groups "Google App Engine" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/O8ZtfkdA7ksJ.

[Drake]

http://code.google.com/p/googleappengine/issues/detail?id=8052

Is specific to Intra-App Limitations