Hi
Having completed and toyed with the tutorial I have something I don't understand. What happens when my base url features links and content that change daily?
I don't want all the data only specific documents when they update to the page.
From the base url to get the link across to the page I want to scrape is body/div/div/div/div/table/tbody/tr/td/p/a.
So i want to navigate down that path if State and location details when they update. So will Scrapy allow me to do that or do I need to employ something like Mechanize
https://pypi.python.org/pypi/mechanize/?
Sayth