I keep getting a ConnectionResetError

193 views
Skip to first unread message

Christopher Mullarkey

unread,
May 1, 2020, 4:20:14 PM5/1/20
to arXiv API

Hello All,

I am working on a little NLP side-project for fun and wanted to use arxiv meta-data on a small subset of ~10,000 papers, just the titles and abstracts. However as I was setting up my API requests I started getting the following error:

"ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host"

I have been careful to structure my requests so that they do not violate the arxiv code of conduct or the rate limits by a large safety margin, waiting half minute or so before I perform another request. Has anyone run into this problem before? I e-mailed help@arxiv but was hoping to get my data quickly and not have to wait for the weekend to finish. 

All the best,
Chris

Thorsten S

unread,
May 1, 2020, 4:21:09 PM5/1/20
to arXiv api

--
You received this message because you are subscribed to the Google Groups "arXiv API" group.
To unsubscribe from this group and stop receiving emails from it, send an email to arxiv-api+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/6b0d3850-a52d-42c1-98bc-0b85f41c1d5f%40googlegroups.com.

Christopher Mullarkey

unread,
May 1, 2020, 4:25:12 PM5/1/20
to arXiv API
Thanks Thorsten.

I hope this planned maintenance is the reason and I did not get flagged in the system.

Best,
Chris


On Friday, May 1, 2020 at 11:21:09 PM UTC+3, Thorsten wrote:
On Fri, May 1, 2020 at 2:20 PM Christopher Mullarkey <c.a.m...@gmail.com> wrote:

Hello All,

I am working on a little NLP side-project for fun and wanted to use arxiv meta-data on a small subset of ~10,000 papers, just the titles and abstracts. However as I was setting up my API requests I started getting the following error:

"ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host"

I have been careful to structure my requests so that they do not violate the arxiv code of conduct or the rate limits by a large safety margin, waiting half minute or so before I perform another request. Has anyone run into this problem before? I e-mailed help@arxiv but was hoping to get my data quickly and not have to wait for the weekend to finish. 

All the best,
Chris

--
You received this message because you are subscribed to the Google Groups "arXiv API" group.
To unsubscribe from this group and stop receiving emails from it, send an email to arxi...@googlegroups.com.

Udayshankar Menon

unread,
May 3, 2020, 11:45:13 PM5/3/20
to arxi...@googlegroups.com
Hi Christopher, 

I have used the API before to make a NLP based recommender system. I've copied the GitHub repo where you'll find some scripts I used to secure metadata, I'm not sure if it's useful but feel free to take a look. 


Hope it helps, good luck! 

Best, 
Uday



To unsubscribe from this group and stop receiving emails from it, send an email to arxiv-api+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/0bae0738-9283-41ee-b5b2-68dd2237b345%40googlegroups.com.

Christopher Mullarkey

unread,
May 4, 2020, 10:30:55 AM5/4/20
to arXiv API
Hi Uday,

We had pretty similar ideas and seeing another person's solution is definitely helpful.

Thanks,
Chris

Udayshankar Menon

unread,
May 4, 2020, 7:02:16 PM5/4/20
to arxi...@googlegroups.com
Christopher, 

That sounds great, let me know if you have any specific questions or wish to collaborate at any point in the future. My email is uk...@cornell.edu, have a good one. 

Best, 
Uday

To unsubscribe from this group and stop receiving emails from it, send an email to arxiv-api+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/1e32739e-9d12-4886-8f53-26fdd15b48eb%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages