Any way to change a spider's name in the same spider.py

60 views
Skip to first unread message

Wang Haomao

unread,
May 27, 2017, 5:31:06 PM5/27/17
to scrapy-users
Dear everyone

       I did a crawler using scrapy , and it's cool. However there is a problem, how can I change the spider's name? My crawler can crawl a list of similar website , so I want to run it in a distributed environment and feed them in some different times. Because of that , I want to distinguish them use the spider's name , but it is in the same spider.py .  I ask a question in the stackoverflow and there is the url : https://stackoverflow.com/questions/44202110/is-there-any-way-to-change-scrapy-spiders-name-by-script .

       Thanks in advance.

   Wang Haomao
Reply all
Reply to author
Forward
0 new messages