What is current search time range limit?

83 views
Skip to first unread message

Jeffrey Greenberg

unread,
Apr 27, 2009, 3:36:32 PM4/27/09
to Twitter Development Talk
Is there an absolute time limit past which searches will fail? What is
that limit exactly

I thought I had read 4 months but don't see this info in the new
documentation. Furthermore, with the API I am seeing something like 25
days ... example: search "dominoes pizza". I searched this on 4/17
and had responses from march, but now, one week later (today is
4/27/2009 ) I see no responses before April 2, and yet I know there
were matching tweets in march...

Appreciate your clarification of the documentation...

explicious

unread,
Apr 27, 2009, 3:47:53 PM4/27/09
to Twitter Development Talk
is that really supposed to be "dominoes" (sic) ?

Doug Williams

unread,
Apr 27, 2009, 4:33:33 PM4/27/09
to twitter-deve...@googlegroups.com
From #6 on Things Every Developer Should Know [1].

Search API Limit

Clients may request up to 1,500 statuses via the page and count parameters for the search method. The response to a request exceeding this limit will be a status code of 200 and an empty result in the format requested. This artificial limit is in place to ensure the performance of the search system. We also restrict the size of the search index by placing a date limit on the updates we allow you to search. This limit is currently around a month but is dynamic and subject to shrink as the number of tweets per day continues to grow.

1. http://apiwiki.twitter.com/Things-Every-Developer-Should-Know#6Therearepaginationlimits

Doug Williams
Twitter API Support
http://twitter.com/dougw

Joe Fernandez

unread,
Jun 5, 2009, 12:07:51 PM6/5/09
to Twitter Development Talk
Hey Doug,

We are seeing search limited all the way down to about 7 days right
now. Is this true?

This is causing a lot of problems with our app.

Thanks,
Joe




On Apr 27, 1:33 pm, Doug Williams <d...@twitter.com> wrote:
> From #6 on Things Every Developer Should Know [1].
> Search API Limit
>
> Clients may request up to 1,500 statuses via the page and count parameters
> for the search <http://apiwiki.twitter.com/search> method. The response to a
> request exceeding this limit will be a status code of 200 and an empty
> result in the format requested. This artificial limit is in place to ensure
> the performance of the search system. We also restrict the size of the
> search index by placing a date limit on the updates we allow you to search.
> This limit is currently around a month but is dynamic and subject to shrink
> as the number of tweets per day continues to grow.
> 1.http://apiwiki.twitter.com/Things-Every-Developer-Should-Know#6Therea...
>
> Doug Williams
> Twitter API Supporthttp://twitter.com/dougw

Doug Williams

unread,
Jun 5, 2009, 1:05:26 PM6/5/09
to twitter-deve...@googlegroups.com
The index has been shortened considerably to help reduce the replication lag that is causing some search machines to fall behind.

Thanks,
Doug

Joe Fernandez

unread,
Jun 5, 2009, 2:51:38 PM6/5/09
to Twitter Development Talk
Is this something that is going to be fixed or get better in the near
term or is this the new reality?

On Jun 5, 10:05 am, Doug Williams <d...@twitter.com> wrote:
> The index has been shortened considerably to help reduce the replication lag
> that is causing some search machines to fall behind.
> Thanks,
> Doug
>

Doug Williams

unread,
Jun 5, 2009, 6:59:41 PM6/5/09
to twitter-deve...@googlegroups.com
As far as I know it is the new reality, at least for the foreseeable future. 

Thanks,
Doug

davi...@yahoo.com

unread,
Jun 6, 2009, 11:24:20 AM6/6/09
to Twitter Development Talk
What do you mean by "replication lag"? Is this related to repeated
tweets in the search results?

Doug Williams

unread,
Jun 6, 2009, 2:41:38 PM6/6/09
to twitter-deve...@googlegroups.com
See [1] for information on replication. Sometimes there is a lag in the replication of the database across multiple machines.

1. http://en.wikipedia.org/wiki/Replication_(computer_science)

Thanks,
Doug

David Fisher

unread,
Jun 7, 2009, 3:58:25 PM6/7/09
to Twitter Development Talk
Can't you get more than 1500 by using Max_id and ID together and
creatively?

-David
@tibbon

On Jun 6, 2:41 pm, Doug Williams <d...@twitter.com> wrote:
> See [1] for information on replication. Sometimes there is a lag in the
> replication of the database across multiple machines.
>
> 1.http://en.wikipedia.org/wiki/Replication_(computer_science)
>
> Thanks,
> Doug
Reply all
Reply to author
Forward
0 new messages