Can I bulk download all abstracts?

[Paras Chopra]

Hello,

I found a bulk download link for metadata of all papers, but they don't contain abstracts.

Is it possible to bulk download abstracts of all 40 million papers in the database? If not, how should I go about it?

Thanks!

[Mohamed Selim]

Hi Paras,

As you already noticed we don't have this available as bulk download. The only available abstract set is preprint abstracts https://europepmc.org/ftp/preprint_abstracts/

to search for articles with abstract you can use query:

https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=has_abstract:y&resultType=core&pageSize=1000

you can look for field abstractText

and use  the next url field to go to next page

<nextPageUrl>https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=has_abstract:y&cursorMark=AoIIPb1oCig0NTg4MzUxNQ==&resultType=core&pageSize=1000&format=xml</nextPageUrl>

also consider that we apply some throttling of 10 requests per second and 500 requests per minute to adjust the call frequency accordingly.

I know it is not an easy way to digest this content, we have plans of adding new sets to our bulk downloads and will add this to our list of discussion.

Please let me know if you have other questions.

Kind regards,

Mohamed