how to crawl multiple domain in scrapy

[Siddharth Jain]

Hi guys I am trying to crawl multiple domain using scrapy but not
getting any idea .


I want to read data multiple site using scrapy how can i achieve using
one crawler



Regards
Siddharth

[Bill Ebeling]

If it's a specific group of sites, you just include them in the allowed_domains list and travel to the sites using requests.

If that's not your goal, this may be:  https://scrapy.readthedocs.org/en/latest/topics/broad-crawls.html#broad-crawls

I know little about broad crawls.