IP address of scraper

71 views
Skip to first unread message

Richard Pope

unread,
May 8, 2012, 5:35:33 PM5/8/12
to scrap...@googlegroups.com
To signup for the TfL Oystercard APi you need to give them the IP address of the server making the call:

http://www.tfl.gov.uk/businessandpartners/syndication/16492.aspx

Is it possible to know what the IP address is for a given scraper run?

Richard

/*
07976730458
ric...@memespring.co.uk

*/


Páll Hilmarsson

unread,
May 8, 2012, 5:51:17 PM5/8/12
to scrap...@googlegroups.com
Here is a snippet to print out the ip address of the server (python):

print scraperwiki.scrape('http://httpbin.org/ip')


pallih

ps. there are other great endpoints at http://httpbin.org/ for http responses
--
pal...@kaninka.net
http://gogn.in
http://twitter.com/pallih
http://is.linkedin.com/in/pallih

My email load: http://courteous.ly/KbEbzo

Richard Pope

unread,
May 8, 2012, 6:13:58 PM5/8/12
to scrap...@googlegroups.com
Thanks!


Richard

/*
07976730458
ric...@memespring.co.uk

*/


On Tuesday, 8 May 2012 at 22:51, Páll Hilmarsson wrote:

> Here is a snippet to print out the ip address of the server (python):
>
> print scraperwiki.scrape('http://httpbin.org/ip')
>
>
> pallih
>
> ps. there are other great endpoints at http://httpbin.org/ for http responses
>
> On Tue, May 8, 2012 at 9:35 PM, Richard Pope <ric...@memespring.co.uk (mailto:ric...@memespring.co.uk)> wrote:
> > To signup for the TfL Oystercard APi you need to give them the IP address of the server making the call:
> >
> > http://www.tfl.gov.uk/businessandpartners/syndication/16492.aspx
> >
> > Is it possible to know what the IP address is for a given scraper run?
> >
> > Richard
> >
> > /*
> > 07976730458
> > ric...@memespring.co.uk (mailto:ric...@memespring.co.uk)
> >
> > */
>
>
>
> --
> pal...@kaninka.net (mailto:pal...@kaninka.net)

David Jones

unread,
May 9, 2012, 3:53:41 AM5/9/12
to scrap...@googlegroups.com
On Tue, May 8, 2012 at 10:51 PM, Páll Hilmarsson <pal...@kaninka.net> wrote:
> Here is a snippet to print out the ip address of the server (python):
>
> print scraperwiki.scrape('http://httpbin.org/ip')

Cool.

In practice at the moment this won't change. But obviously going
forward we would not like to guarantee a fixed IP address.

David Jones
First Engineer
ScraperWiki Limited
Reply all
Reply to author
Forward
0 new messages