since_id and lang issues on search api

[twitter-development]

Hi,

I've been noticing issues that when I add a language to my search api
request I don't always get back the proper data. When I hit the api
without lang=en I get the expected results. When I hit the api with
lang=en I get nothing back even though the tweets are marked as "en"
in the call that works properly. (I'm wondering if it's just co-
incidence and it's a bizarre caching issues because I see similar
behavior when adding/omitting different params from the request, the
fail safe seems to be to remove since_id all together) Below are a
couple wget's that show what I mean:

first request is "from:emantwitt17" since_id=5371461978 and lang=en
(get nothing back).
second request is "from:emantwitt17" since_id=5371461978 (get tweet
back at least one tweet that is marked as "en").

************ BEGIN FIRST CALL ******************
[root@hostname www]# wget -S -O - "http://search.twitter.com/
search.atom?callback=none&q=from
%3Aemantwitt17&since_id=5371461978&lang=en"
--18:43:46-- http://search.twitter.com/search.atom?callback=none&q=from%3Aemantwitt17&since_id=5371461978&lang=en
Resolving search.twitter.com... 168.143.162.43
Connecting to search.twitter.com|168.143.162.43|:80... connected.
HTTP request sent, awaiting response...
HTTP/1.1 200 OK
Date: Mon, 02 Nov 2009 23:42:14 GMT
Server: hi
Status: 200 OK
X-Served-From: sjc1c133
Content-Type: application/atom+xml; charset=utf-8
X-Served-By: sjc1h004.twitter.com
X-Timeline-Cache-Hit: Hit
Cache-Control: max-age=15, must-revalidate, max-age=1800
Expires: Tue, 03 Nov 2009 00:12:14 GMT
Content-Length: 970
Vary: Accept-Encoding
X-Varnish: 251678383
Age: 0
Via: 1.1 varnish
X-Cache-Svr: sjc1h004.twitter.com
X-Cache: MISS
Connection: close
Length: 970 [application/atom+xml]
Saving to: `STDOUT'

0% [ ] 0 --.-K/
s <?xml version="1.0" encoding="UTF-8"?>
<feed xmlns:google="http://base.google.com/ns/1.0" xml:lang="en-US"
xmlns:openSearch="http://a9.com/-/spec/opensearch/1.1/" xmlns="http://
www.w3.org/2005/Atom" xmlns:twitter="http://api.twitter.com/">
<id>tag:search.twitter.com,2005:search/from:emantwitt17</id>
<link type="text/html" href="http://search.twitter.com/search?q=from
%3Aemantwitt17" rel="alternate"/>
<link type="application/atom+xml" href="http://search.twitter.com/
search.atom?callback=none&amp;q=from
%3Aemantwitt17&amp;since_id=5371461978&amp;lang=en" rel="self"/>
<title>from:emantwitt17 - Twitter Search</title>
<link type="application/opensearchdescription+xml" href="http://
search.twitter.com/opensearch.xml" rel="search"/>
<link type="application/atom+xml" href="http://search.twitter.com/
search.atom?callback=none&amp;lang=en&amp;q=from
%3Aemantwitt17&amp;since_id=5374137131" rel="refresh"/>
<updated>2009-11-02T23:42:14+00:00</updated>
</feed>
100%[=======================================>] 970 --.-K/s
in 0s

18:43:46 (474 KB/s) - `-' saved [970/970]
************ END FIRST CALL ******************

************ BEGIN SECOND CALL ******************
[root@hostname www]# wget -S -O - "http://search.twitter.com/
search.atom?callback=none&q=from%3Aemantwitt17&since_id=5371461978"
--18:43:51-- http://search.twitter.com/search.atom?callback=none&q=from%3Aemantwitt17&since_id=5371461978
Resolving search.twitter.com... 168.143.162.43
Connecting to search.twitter.com|168.143.162.43|:80... connected.
HTTP request sent, awaiting response...
HTTP/1.1 200 OK
Date: Mon, 02 Nov 2009 23:42:18 GMT
Server: hi
Status: 200 OK
X-Served-From: sjc1c136
Content-Type: application/atom+xml; charset=utf-8
X-Served-By: sjc1h007.twitter.com
X-Timeline-Cache-Hit: Hit
Cache-Control: max-age=15, must-revalidate, max-age=1800
Expires: Tue, 03 Nov 2009 00:12:18 GMT
Content-Length: 3316
Vary: Accept-Encoding
X-Varnish: 1742128020
Age: 0
Via: 1.1 varnish
X-Cache-Svr: sjc1h007.twitter.com
X-Cache: MISS
Connection: close
Length: 3316 (3.2K) [application/atom+xml]
Saving to: `STDOUT'

0% [ ] 0 --.-K/
s <?xml version="1.0" encoding="UTF-8"?>
<feed xmlns:google="http://base.google.com/ns/1.0" xml:lang="en-US"
xmlns:openSearch="http://a9.com/-/spec/opensearch/1.1/" xmlns="http://
www.w3.org/2005/Atom" xmlns:twitter="http://api.twitter.com/">
<id>tag:search.twitter.com,2005:search/from:emantwitt17</id>
<link type="text/html" href="http://search.twitter.com/search?q=from
%3Aemantwitt17" rel="alternate"/>
<link type="application/atom+xml" href="http://search.twitter.com/
search.atom?callback=none&amp;q=from
%3Aemantwitt17&amp;since_id=5371461978" rel="self"/>
<title>from:emantwitt17 - Twitter Search</title>
<link type="application/opensearchdescription+xml" href="http://
search.twitter.com/opensearch.xml" rel="search"/>
<link type="application/atom+xml" href="http://search.twitter.com/
search.atom?callback=none&amp;q=from
%3Aemantwitt17&amp;since_id=5376548009" rel="refresh"/>
<updated>2009-11-02T23:39:47Z</updated>
<openSearch:itemsPerPage>15</openSearch:itemsPerPage>
<entry>
<id>tag:search.twitter.com,2005:5376548009</id>
<published>2009-11-02T23:39:47Z</published>
<link type="text/html" href="http://twitter.com/emantwitt17/
statuses/5376548009" rel="alternate"/>
<title>one more test of the api</title>
<content type="html">one more test of the api</content>
<updated>2009-11-02T23:39:47Z</updated>
<link type="image/png" href="http://s.twimg.com/a/1256928834/
images/default_profile_6_normal.png" rel="image"/>
<twitter:geo>
</twitter:geo>
<twitter:source>&lt;a href=&quot;http://twitter.com/
&quot;&gt;web&lt;/a&gt;</twitter:source>
<twitter:lang>en</twitter:lang>
<author>
<name>emantwitt17 (Emmanuel Job)</name>
<uri>http://twitter.com/emantwitt17</uri>
</author>
</entry>
<entry>
<id>tag:search.twitter.com,2005:5376507702</id>
<published>2009-11-02T23:38:07Z</published>
<link type="text/html" href="http://twitter.com/emantwitt17/
statuses/5376507702" rel="alternate"/>
<title>retesting the api</title>
<content type="html">retesting the api</content>
<updated>2009-11-02T23:38:07Z</updated>
<link type="image/png" href="http://s.twimg.com/a/1256928834/
images/default_profile_6_normal.png" rel="image"/>
<twitter:geo>
</twitter:geo>
<twitter:source>&lt;a href=&quot;http://twitter.com/
&quot;&gt;web&lt;/a&gt;</twitter:source>
<twitter:lang>no</twitter:lang>
<author>
<name>emantwitt17 (Emmanuel Job)</name>
<uri>http://twitter.com/emantwitt17</uri>
</author>
</entry>
<entry>
<id>tag:search.twitter.com,2005:5371552748</id>
<published>2009-11-02T20:07:10Z</published>
<link type="text/html" href="http://twitter.com/emantwitt17/
statuses/5371552748" rel="alternate"/>
<title>hows about these lists</title>
<content type="html">hows about these lists</content>
<updated>2009-11-02T20:07:10Z</updated>
<link type="image/png" href="http://s.twimg.com/a/1256928834/
images/default_profile_6_normal.png" rel="image"/>
<twitter:geo>
</twitter:geo>
<twitter:source>&lt;a href=&quot;http://twitter.com/
&quot;&gt;web&lt;/a&gt;</twitter:source>
<twitter:lang>en</twitter:lang>
<author>
<name>emantwitt17 (Emmanuel Job)</name>
<uri>http://twitter.com/emantwitt17</uri>
</author>
</entry>
</feed>
100%[=======================================>] 3,316 --.-K/s
in 0s

18:43:51 (1.58 MB/s) - `-' saved [3316/3316]

************ END SECOND CALL ******************