How to force urllib2 to fetch newly files.

26 views
Skip to first unread message

Toomore

unread,
Dec 8, 2010, 2:25:47 PM12/8/10
to google-a...@googlegroups.com
I have a problem about useing urllib2 to fetch files.
If I use urllib2 to fetch a file more times in one day, when the files is update, useing urllib2 is still fetch old files.

So how do I force urllib2 to fetch newly files.
Now I have added random no. at the end of URL, but it still fetch old files.

Thanks.

Ikai Lan (Google)

unread,
Dec 9, 2010, 5:47:57 PM12/9/10
to google-a...@googlegroups.com
Which URL are you fetching? Could it be possible they are caching this on their side?

--
Ikai Lan 
Developer Programs Engineer, Google App Engine



--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.

Toomore

unread,
Dec 12, 2010, 10:37:26 AM12/12/10
to google-a...@googlegroups.com
someone like this:
which is about Taiwan stock data.(stock no is 8261)

If I fetch more times in one day, it can't to fetch the newly data, even if the stock is close.
I also add random no. at the end of URL, but can not work.

Thanks.
Reply all
Reply to author
Forward
0 new messages