Any way to change a spider's name in the same spider.py
63 views
Skip to first unread message
Wang Haomao
unread,
May 27, 2017, 5:31:06 PM5/27/17
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to scrapy-users
Dear everyone
I did a crawler using scrapy , and it's cool. However there is a problem, how can I change the spider's name? My crawler can crawl a list of similar website , so I want to run it in a distributed environment and feed them in some different times. Because of that , I want to distinguish them use the spider's name , but it is in the same spider.py . I ask a question in the stackoverflow and there is the url : https://stackoverflow.com/questions/44202110/is-there-any-way-to-change-scrapy-spiders-name-by-script .