SOCKS Proxy

[silent254]

Hi,

Can someone give me pointers on how to use SCRAPY with a SOCKS proxy
(like Tor)?

What settings / where to change ...

Or is it not possible to make it work with Tor?

Thanks,

SS

[Luis Carlos Colunga]

Take a look at this:
http://blog.scrapy.org/spoofing-your-scrapy-bot-ip-using-tsocks but
rather than using SSH tunneling you would redirect it to the Tor Socks
service.

Regards,

Luis

> --
> You received this message because you are subscribed to the Google Groups "scrapy-users" group.
> To post to this group, send email to scrapy...@googlegroups.com.
> To unsubscribe from this group, send email to scrapy-users...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/scrapy-users?hl=en.
>
>

[silent254]

Hi Luis,

Thanks for the quick response, and pardon my ignorance. How do I
"redirect it to Tor socks"? Do I just 'ssh -D tor_port'?

SS

[Rolando Espinoza La Fuente]

Did you tried privoxy?

I've used tor through privoxy just setting http_proxy environment variable
to make it work with scrapy.

Regards,

~Rolando

[silent254]

Here's what's happening.

I have Tor working (FF when set to this socks works, and I can verify
that I am getting a different IP address when I go to
whatismyipaddress.com), and tsocks installed.

From the command prompt:

1. ping www.google.com - works
2. tsocks ping www.google.com - works
3. tsocks scrapy shell ... at the prompt fetch('http://
www.google.com') times out.

Does this make sense?

SS

On Aug 31, 7:37 am, Rolando Espinoza La Fuente <dark...@gmail.com>
wrote: