403 Error Randomly

[Flavius Biras]

I am facing a strange issue. I am trying to download just one paper at a time from arxiv and parse the text. I am doing it inside a cloud function hosted on firebase, thus using node js and axios.get to get the paper. The issue is that I am getting inconsistent results from the server, meaning that sometimes the request is successful and sometimes I get 403 Forbidden. I was not able to identify any pattern or cause. I did try many different User-agents, tried both 'arxiv.org' and 'export.arxiv.org', and tested with same code and paper at different times, getting different results. I also submitted a ticket with the issue noted as AH-84637, and posted a stackoverflow question with more details and code here: https://stackoverflow.com/questions/77742464/axios-request-to-arxiv-randomly-fails