403

27 views
Skip to first unread message

Dierk Pfeiffer

unread,
May 2, 2015, 3:54:33 AM5/2/15
to portia-...@googlegroups.com
Hi it seams that some pages are blocking scrapy and you are getting a 403, is there a way to change browser identification?
Thanks

Dierk Pfeiffer

unread,
May 2, 2015, 4:50:54 AM5/2/15
to portia-...@googlegroups.com
Meaning, where is it possible to change the user agent.

Thanks

madhusai ravada

unread,
Mar 1, 2017, 12:24:12 PM3/1/17
to portia-scraper, dpala...@gmail.com


On Saturday, May 2, 2015 at 1:24:33 PM UTC+5:30, Dierk Pfeiffer wrote:
Hi it seams that some pages are blocking scrapy and you are getting a 403, is there a way to change browser identification?
Thanks

use different IP for each request by this method it would be difficult to detect for the server you can use tor for automatic IP rotation. 
Reply all
Reply to author
Forward
0 new messages