I am running a small script to download metadata of some items, usually 2 or 3 a day, to create a bibtex entry + download the PDF in one go. This morning, when I ran the script, my HTTP request to
https://export.arxiv.org/api/query?id_list=2312.13750&max_results=100 was met with a "429 Unknown Error" and the body of the response was "Rate exceeded." The full request is:
$ curl -is 'https://export.arxiv.org/api/query?id_list=2312.13750&max_results=100'
HTTP/1.1 429 Unknown Error
Connection: keep-alive
Content-Length: 14
accept-ranges: bytes
server: Google Frontend
x-cloud-trace-context: 1e928bf5dcf45294886145f2a2919f6c
content-type: text/html
via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Date: Mon, 17 Nov 2025 08:03:22 GMT
X-Served-By: cache-lga21967-LGA, cache-lga21967-LGA, cache-lcy-egml8630027-LCY
X-Cache: MISS, MISS, MISS
X-Cache-Hits: 0, 0, 0
X-Timer: S1763366602.330933,VS0,VE157
Strict-Transport-Security: max-age=300
Rate exceeded.
Is this a bug, or is my usage really excessive (one or two requests a day for a limited number of items)?