oai-pmh and sitemaps

[Ed Summers]

Hi Unpaywallers,

I was wondering if Unpaywall supports crawling using Sitemaps in addition to OAI-PMH? Or is OAI-PMH the only way to get web content crawled?

Thanks, for any information you can provide.

//Ed

[Casey M]

Hi Ed,

Thanks for the question! No, we're not able to crawl sitemaps at this time. We need to have a OAI-PMH endpoint.

Thanks,
Casey

[Ed Summers]

Ok, thanks! I was thinking it would be great to be able to add some metadata to existing web pages and tell Unpaywall to crawl it with a sitemap. But easier said than done I suppose :-)

//Ed