No users found and API 502
Kalle Paulsson
I have some issues which are probably related.
* The top bar update timer is always negative: "kallepa (Twitter)
updated -31574 secs ago | Update now"
* All the friends/followers views says "No users found. Update your
data now."
* When updating the data manually, the log seems to indicate that the
API is throwing a 502/Fail whale in HTML? Dumping the beginning below.
2010-10-04 01:51:41 | 3.26 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:API request:
https://api.twitter.com/1/account/rate_limit_status.xml
2010-10-04 01:51:41 | 3.26 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:Parsing XML data from
https://api.twitter.com/1/account/rate_limit_status.xml
2010-10-04 01:51:41 | 3.26 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:19993 of 20000 API calls left this
hour; 19911 for crawler until 02:32:15
2010-10-04 01:51:42 | 3.26 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:API request: https://api.twitter.com/1/users/show/kallepa.xml
2010-10-04 01:51:42 | 3.26 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:19992 of 20000 API calls left this
hour; 19910 for crawler until 02:32:15
2010-10-04 01:51:42 | 3.31 MB | kallepa | UserMySQLDAO:User kallepa
updated in system.
2010-10-04 01:51:42 | 3.35 MB | kallepa | TwitterCrawler:Owner info
set.
2010-10-04 01:51:43 | 3.35 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:API request:
https://api.twitter.com/1/statuses/user_timeline/kallepa.xml?count=200&include_rts=true&since_id=26300448149
2010-10-04 01:51:43 | 3.35 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:19991 of 20000 API calls left this
hour; 19909 for crawler until 02:32:15
2010-10-04 01:51:43 | 3.83 MB | kallepa | TwitterCrawler:0 tweet(s)
found and 0 saved
2010-10-04 01:51:43 | 3.83 MB | kallepa | TwitterCrawler:1098 in
system; 2645 by owner
2010-10-04 01:51:49 | 3.84 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:Total API errors so far: 1 | Total
errors to tolerate 3
2010-10-04 01:51:49 | 3.84 MB | kallepa |
CrawlerTwitterAPIAccessorOAuth:Could not retrieve
https://api.twitter.com/1/statuses/user_timeline/kallepa.xml?count=200&include_rts=true&page=6&
| API ERROR: 502
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://
www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=utf-8" />
<meta http-equiv="Content-Language" content="en-us" />
<title>Twitter / Over capacity</title>
<link href="http://s.twimg.com/images/favicon.ico" rel="shortcut
icon" type="image/x-icon" />
<style type="text/css">
...
Gina Trapani
On Mon, Oct 4, 2010 at 2:00 AM, Kalle Paulsson <kalle.p...@gmail.com> wrote:
> * The top bar update timer is always negative: "kallepa (Twitter)
> updated -31574 secs ago | Update now"
This is a known bug, related to the timezone setting, which is set to
America/Los_Angeles by default. If you edit your config.inc.php and
set the timezone to the correct place for you, it should be resolved.
> * All the friends/followers views says "No users found. Update your
> data now."
That means the Twitter crawler hasn't yet pulled your social graph. It
does tweets first, replies next, retweets and orphan replies, and
friends/followers last. What's likely happening is that it's not
getting to friends/followers yet without errors.
> * When updating the data manually, the log seems to indicate that the
> API is throwing a 502/Fail whale in HTML? Dumping the beginning below.
Yes, the crawler dumps the HTML of the Fail Whale response into the
log to display the error.
If you run the crawler for a few more days, it will likely get to all
your data. We're working on some fixes for handling the fail whale
more gracefully, and retrying failed responses, b/c often on the
second try it does return data.