Problem with catching data from Twitter by Twitter Search API

[Jimmy]

I used to catch data from Twitter by the Twitter Search API. But it's
seems like be prohibited since 1st Apr.
Twitter official document says that "An application must have a static
IP to be eligible for whitelisting. This means the majority of cloud
platforms, including Google App Engine, cannot be whitelisted."
I want to know is there any way to solve this problem.

Thank you very much.

-Jimmy Lin

[Barry Hunter]

Get yourself a static IP address.

Easiest way it probably to use a cheap VM somewhere to act as a proxy.

> --
> You received this message because you are subscribed to the Google Groups "Google App Engine" group.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
>
>

[Jimmy]

Hi, if I don't have the static IP address, is there any method to
solve this problem ?

thank you

On 4月18日, 下午10時27分, Barry Hunter <barrybhun...@gmail.com> wrote:
> Get yourself a static IP address.
>
> Easiest way it probably to use a cheap VM somewhere to act as a proxy.
>

[Brandon Wirtz]

No. Proxy is your only solution.

[Tim]

Twitter are moving away from whitelisting (I think they're no longer accepting any new whitelisting requests)  - they want you to use OAuth to authenticate your calls (in which case you're allowed 350 API calls per hour per user id from a single IP), and if you need more than that then there's the streaming API, so you probably want to look at one of the OAuth on GAE solutions such as

    https://github.com/mikeknapp/AppEngine-OAuth-Library/raw/master/oauth.py

Twitter API docs have more details about the end of whitelisting etc

[Jimmy]

I don't know if I could get the search twitter result from OAuth ? The
only thing I need is the search result.
I used to use the method which is https://dev.twitter.com/doc/get/search
to get the result.

OR is there any other way to get the search result from Twitter ?

[Jimmy]

Can I build a proxy between GAE and Twitter ?

[Barry Hunter]

It's certainly possible. Whether YOU are able is not really for us to say.

[Jimmy]

Thanks for your reply.

On 4月19日, 下午11時25分, Barry Hunter <barrybhun...@gmail.com> wrote:
> It's certainly possible. Whether YOU are able is not really for us to say.
>

[Tim]

Sorry, I missed the bit where you (clearly) said the Search API rather than the REST API.

You probably do need a proxy, and then you can probably get away without a whitelist (quote

   The Search Rate Limit isn't made public to discourage unnecessary search usage

   and abuse, but it is higher than the REST Rate Limit. We feel the Search Rate

   Limit is both liberal and sufficient for most applications and know that many

   application vendors have found it suitable for their needs.

) but you may also want to consider the Streaming API (quote

  The Search API is best suited for user-initiated ad-hoc queries. If your application

   requires repeated Search API polling, you might want to consider the Streaming API instead.

) as whitelisting for the search API is taken to be an exception rather than a norm....

[Jimmy]

It's so funny that my application work now. 

I don't know if Google change the framework or something. But that's a good news to me.

Thank you for your replies.