How to whitelist an app engine twitter app.

[Luke]

Hi All,

We are building a photo microblog with twitter support and deploying
on Google app engine. An issue we have run into is that making api
calls with urlfetch the call is made by one of any number of Google
worker servers with different IP addresses. So its quite likely that
the request will get denied for being over quota for that particular
IP address. I guess this is because there are too many developers
using Google to talk to Twitter.

Is it possible to white list an app without giving the IP address.
Perhaps by passing some token or header with the request? If this is
not possible I guess the best option is to proxy all our requests via
another server which has a fixed IP address.

Thanks in advance.
Luke

[Cameron Kaiser]

I don't recall if GAE is already whitelisted, but why not simply whitelist
by user credential?

--
------------------------------------ personal: http://www.cameronkaiser.com/ --
Cameron Kaiser * Floodgap Systems * www.floodgap.com * cka...@floodgap.com
-- Traditionally, most of Australia's imports come from overseas. -K. Enderbery

[Alex Payne]

Indeed, whitelisting by authenticated user credentials (and soon,
OAuth) is our preferred way to handle "clouds" and hosting farms.

--
Alex Payne - API Lead, Twitter, Inc.
http://twitter.com/al3x

[Luke]

Thanks for the replies..

So the preferred way to do it is to make calls using our application's
twitter user and request that that user is whitelisted. Sounds
perfect. I must have missed this in the docs.

- Luke

On Mar 26, 12:43 am, Alex Payne <a...@twitter.com> wrote:
> Indeed, whitelisting by authenticated user credentials (and soon,
> OAuth) is our preferred way to handle "clouds" and hosting farms.
>
>
>
> On Wed, Mar 25, 2009 at 05:32, Cameron Kaiser <spec...@floodgap.com> wrote:
>
> >> We are building a photo microblog with twitter support and deploying
> >> on Google app engine. An issue we have run into is that making api
> >> calls with urlfetch the call is made by one of any number of Google
> >> worker servers with different IP addresses. So its quite likely that
> >> the request will get denied for being over quota for that particular
> >> IP address. I guess this is because there are too many developers
> >> using Google to talk to Twitter.
>
> >> Is it possible to white list an app without giving the IP address.
> >> Perhaps by passing some token or header with the request? If this is
> >> not possible I guess the best option is to proxy all our requests via
> >> another server which has a fixed IP address.
>
> > I don't recall if GAE is already whitelisted, but why not simply whitelist
> > by user credential?
>
> > --
> > ------------------------------------ personal:http://www.cameronkaiser.com/--

> >  Cameron Kaiser * Floodgap Systems *www.floodgap.com* ckai...@floodgap.com

[Guillermo Esteves]

What if my Google App Engine app uses the Search API instead? If I'm
not mistaken, I can't make an authenticated call to the Search API.
What should I do if I hit any limits in that case?

—Guillermo (http://twitter.com/gesteves)

On Mar 26, 12:43 pm, Alex Payne <a...@twitter.com> wrote:
> Indeed, whitelisting by authenticated user credentials (and soon,
> OAuth) is our preferred way to handle "clouds" and hosting farms.
>

[Doug Williams]

From the docs [1]:

"There is no general idea of a whitelist for the Search API as with the REST API. However, under extraordinary circumstances we work with developers to raise rate limiting for Search requests. If you feel that your application is doing everything it can to limit and combine queries where appropriate, please contact Twitter to discuss your needs. The Search API is only able to whitelist IP addresses, not user accounts. This works in most situations but for cloud platforms like Google App Engine, applications without a static IP addresses cannot receive Search whitelisting."

1. http://apiwiki.twitter.com/Rate-limiting

Doug Williams
Twitter API Support
http://twitter.com/dougw