Specific site structure
44 views
Skip to first unread message
k bez
Jun 24, 2017, 11:41:37 AM6/24/17
to django-dynamic-scraper
I want to scrape a site with this structure: main page -> categories page (6 categories) -> some product pages for each category.
For (RPT main page), I assign base+temp url(DETAIL_PAGE_URL) so i get 6 new urls for categories(in temp url field).
For (RPT detail_page_1), I assign as Scraped obj attr, the temp url from main page but DDS didnt do 6 new GETS to proceed further.
Is it possible to scrape this structure with DDS?
For (RPT main page), I assign base+temp url(DETAIL_PAGE_URL) so i get 6 new urls for categories(in temp url field).
For (RPT detail_page_1), I assign as Scraped obj attr, the temp url from main page but DDS didnt do 6 new GETS to proceed further.
Is it possible to scrape this structure with DDS?
Reply all
Reply to author
Forward
0 new messages