Rate exceeded?

28 views
Skip to first unread message

Najib Idrissi

unread,
Nov 17, 2025, 3:07:20 AMNov 17
to arXiv API Discussion
I am running a small script to download metadata of some items, usually 2 or 3 a day, to create a bibtex entry + download the PDF in one go. This morning, when I ran the script, my HTTP request to https://export.arxiv.org/api/query?id_list=2312.13750&max_results=100 was met with a "429 Unknown Error" and the body of the response was "Rate exceeded." The full request is:

$ curl -is 'https://export.arxiv.org/api/query?id_list=2312.13750&max_results=100'
HTTP/1.1 429 Unknown Error
Connection: keep-alive
Content-Length: 14
accept-ranges: bytes
server: Google Frontend
x-cloud-trace-context: 1e928bf5dcf45294886145f2a2919f6c
content-type: text/html
via: 1.1 varnish, 1.1 varnish, 1.1 varnish
Date: Mon, 17 Nov 2025 08:03:22 GMT
X-Served-By: cache-lga21967-LGA, cache-lga21967-LGA, cache-lcy-egml8630027-LCY
X-Cache: MISS, MISS, MISS
X-Cache-Hits: 0, 0, 0
X-Timer: S1763366602.330933,VS0,VE157
Strict-Transport-Security: max-age=300

Rate exceeded.

Is this a bug, or is my usage really excessive (one or two requests a day for a limited number of items)?

arXiv API Discussion

unread,
Nov 17, 2025, 10:00:35 AMNov 17
to arXiv API Discussion, Najib Idrissi
Hi Najib,

You're usage is fine- you'd see a 503 for excessive use.
"Rate exceeded" is a message related to our server capacity, and the total number of users.
We will work on improving this.
From your perspective, the only fix is try again later.

Thanks,
Brian
Reply all
Reply to author
Forward
0 new messages