different results between web ui and api

129 views
Skip to first unread message

Daniel Schroter

unread,
May 20, 2024, 9:23:16 AM5/20/24
to arXiv API
Hello everyone, 

Thank you very much for this incredible project! I am currently starting with the api and I would like to retrieve the same results as the web ui search. I am very happy with the web-ui search and would love to reproduce the search results. 

The docs state that the retrieved items are the same on api and web ui just displayed differently (html vs. xml)

When I use the example (http://export.arxiv.org/api/query?search_query=all:electron) I frequently receive no results. 

When I sometimes do get results they are very different from the ones i get on web-ui. 
I tried filtering for newest papers on api and web ui to compare the results. 

 (http://export.arxiv.org/api/query?search_query=all:electron&start=0&max_results=10&sortBy=submittedDate&sortOrder=descending)

I feel like i am doing something wrong. Are these mistakes on my side, did I understood something wrong? Or might this be related to other issues?

Thank you very much and with best regards 

Daniel


Brian Maltzan

unread,
May 20, 2024, 2:56:29 PM5/20/24
to arXiv API
Hi Daniel,
That's the right url.
There was an issue with one vm yesterday/today, so you may have been bouncing between the servers online and the one down.
It should be fine now.
Thanks,
Brian

Daniel Schroter

unread,
May 20, 2024, 4:48:13 PM5/20/24
to arXiv API
Thank you very much for your response! 

If i search for "text-to-sql" on the web ui i get amazing results! When i use the same term for the api the results are often empty. 
Is this expected? I feel like I am doing something wrong... 

API Query: export.arxiv.org/api/query?search_query=all:text-to-sql&start=0&max_results=10&sortBy=submittedDate&sortOrder=descending

Web UI: (Screenshot attached)

Help would be very much appreciated!

Best 

DanielScreenshot 2024-05-20 at 22.36.01.png

Message has been deleted

Tom Morris

unread,
May 20, 2024, 5:33:50 PM5/20/24
to arxi...@googlegroups.com
On Mon, May 20, 2024 at 4:48 PM Daniel Schroter <danielsc...@gmail.com> wrote:
If i search for "text-to-sql" on the web ui i get amazing results! When i use the same term for the api the results are often empty. 
Is this expected? I feel like I am doing something wrong... 

API Query: export.arxiv.org/api/query?search_query=all:text-to-sql&start=0&max_results=10&sortBy=submittedDate&sortOrder=descending


This looks much more similar:

You may be able to play with the escaping/quoting of the query to further align the results.

Tom

Daniel Schroter

unread,
May 21, 2024, 9:08:04 AM5/21/24
to arXiv API
Thank you, that helped a lot! 
Reply all
Reply to author
Forward
0 new messages