changing the way proxies work

[Arik Galansky]

Currently HttpProxyMiddleware uses the standard linux http_proxy environment variable. 

The problem with that is that it means I have to set a proxy on the entire server to set a proxy on scrapy. 

This is a major inconvenience as scraping is obviously a task that requires more proxies than most other activities.

I want to change HttpProxyMiddleware to use an HTTP_PROXY setting instead of  (or in adition to) the env var.

What do you think about it? is it a positive change you would accept and want to see added?

[Paul Tremberth]

I like that idea

> --
> You received this message because you are subscribed to the Google Groups
> "scrapy-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to scrapy-users...@googlegroups.com.
> To post to this group, send email to scrapy...@googlegroups.com.
> Visit this group at http://groups.google.com/group/scrapy-users.
> For more options, visit https://groups.google.com/d/optout.

[Mikhail Korobov]

This is a good idea. See also: https://github.com/scrapy/scrapy/issues/615

вторник, 1 апреля 2014 г., 18:37:35 UTC+6 пользователь Paul Tremberth написал:

[Pablo Hoffman]

+1. Send a pull request!

--