Can I scrape multiple urls without specific range?

98 views
Skip to first unread message

Jingyuan Chen

unread,
Nov 30, 2017, 5:43:30 AM11/30/17
to Web Scraper
For specific range, in the tutorial it says I can use http://example.com/page/[1-100:10] 

However, if I want to scrape urls like  http://example.com/page/1http://example.com/page/47http://example.com/page/48http://example.com/page/801 and so on, what can I do?

Thank you very much.

Denis Bakhtenkov

unread,
Nov 30, 2017, 9:22:26 AM11/30/17
to Web Scraper
Just add all URLs in sitemap metadata

четверг, 30 ноября 2017 г., 13:43:30 UTC+3 пользователь Jingyuan Chen написал:
Reply all
Reply to author
Forward
0 new messages