Bulk data for specific date range

[Shubham Agarwal]

Hi! 

Thank you for providing the APIs and for the bulk access. 

I would like to download papers in bulk (PDFs and latex) for a specific range (say August 2023). Is there an easy way to do this?

This might be helpful for incremental updates of a local source dump

Thanks! 

Best,

Shubham

[Jake Weiskoff]

Hi Shubham,

Downloading source isn't really the purpose of the API (which is limited to the metadata), but you can read about how we recommend people collect custom data sets here: 

https://info.arxiv.org/help/bulk_data.html#custom-programmatic-harvesting

Best,

-Jake

--
You received this message because you are subscribed to the Google Groups "arXiv API" group.
To unsubscribe from this group and stop receiving emails from it, send an email to arxiv-api+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/442c54c1-7eb3-41f9-bc65-a251e1a6b75dn%40googlegroups.com.

[Shubham Agarwal]

Thanks!

If I have done S3 bulk access once, how do I update this local dump
now with new papers (PDFs and latex)?

Thanks!

Best,
Shubham Agarwal
Profile: https://shubhamagarwal92.github.io/
LinkedIn: https://www.linkedin.com/in/shubham-agarwal-4b215146/

> You received this message because you are subscribed to a topic in the Google Groups "arXiv API" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/topic/arxiv-api/oIY2EZNQU5Q/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to arxiv-api+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/CAAx3fqTEXbt2UJAF3zCz1%3D0nV9419awrxQWPXnCwhE_1vEKv5Q%40mail.gmail.com.

[Jake Weiskoff]

You'd have to download any updated data from the last time you pulled from the buckets. There's no programmatic method that we recommend above others, as this may be dependent upon the software you're using locally. 

-Jake

To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/CAFdbHO6M8SggEb4PE9cdW8_ZoHGrsTTxc3UDbdfMRWJ6CTxOxw%40mail.gmail.com.