How to copy an existing sitemap?

Eric Lee

unread,

Aug 21, 2015, 11:48:27 PM8/21/15

to Web Scraper

Hello, is there a way to copy a sitemap? I need to create 150 sitemaps with the same selectors and was hoping to use the 1st sitemap as the template and just change the URL.

Thanks!

Eric

Mārtiņš Balodis

unread,

Aug 24, 2015, 2:43:51 PM8/24/15

to Eric Lee, Web Scraper

Hi,

You can export the sitemap and import it 150 times. You can also just add 150 start urls to one sitemap.

--
You received this message because you are subscribed to the Google Groups "Web Scraper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to web-scraper...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Easy Fundraising Ideas

unread,

Nov 5, 2015, 12:37:49 PM11/5/15

to Web Scraper, ericf...@gmail.com

Can you please explain how to add multiple Start URLs please?

Easy Fundraising Ideas

unread,

Nov 5, 2015, 12:49:14 PM11/5/15

to Web Scraper, ericf...@gmail.com

For example - my scraper is scraping bing - it stars like this...

{"startUrl":"http://www.bing.com/search?q=why+does+my+computer+keep+freezing",selectors":[{....

can I just add a comma and another URL before the selectors?

Will try that and await your reply. - thanks!

Mārtiņš Balodis

unread,

Nov 6, 2015, 12:33:47 PM11/6/15

to Easy Fundraising Ideas, Web Scraper, Eric Lee

Hi,

Go to "edit metadata" and there will be a + button to add more start urls.

The generated sitemap will look like this:

{"startUrl":["http://www.bing.com/search?q=why+does+my+computer+keep+freezing", "url2", "url3"],selectors":[{....

Steve

unread,

Aug 1, 2016, 10:37:51 AM8/1/16

to Web Scraper, ted....@gmail.com, ericf...@gmail.com

Will this create different csv files for each added link?

Mārtiņš Balodis

unread,

Aug 3, 2016, 7:31:59 AM8/3/16

to Steve, Web Scraper, Teo Nyman, Eric Lee

This will store data from all start urls into a single CSV file.

Reply all

Reply to author

Forward