Quick question on the new papers

[Pietro Dona]

I would like to figure out the correct query to get all the gr-qc "new papers" of the day. I am building my own script where I pull the data and filter them after based on some other requirements.

I am trying to figure out the correct API call.  For example the paper out today (Oct 11th) were submitted anytime between (Fri 7th and Mon 10th?). I get them with

https://export.arxiv.org/api/query?search_query=submittedDate:[202210070000+TO+202210112359]+AND+cat:gr-qc

Is there a way to do it without having to do the math to understand the correct date interval?

P

[Jake Weiskoff]

Hi Pietro,

There isn't a convenient way to query the "new" mailings using the
search API without knowing very specific details about that day's
queue, and there's no mechanism to have the API calculate the mailing
days automatically. This may be an instance where using a different
one of our available bulk mechanisms may serve your use better:

https://arxiv.org/help/bulk_data

Basically it sounds like you're trying to create a "search term
RSS-like" feed, and the search API probably isn't the best tool for
that at this stage. It's probably the case that some future version of
it would include an announcement date function to pull a category and
date in various formats (atom, json, etc.), but that would likely
require development effort that has not been scheduled yet.

Regards,
-Jake Weiskoff
Senior Content and Support Specialist

> --
> You received this message because you are subscribed to the Google Groups "arXiv API" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to arxiv-api+...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/389297d1-b86a-40cf-bfdd-f447eed116f9n%40googlegroups.com.

[Ankit]

Hi Jake,

Has there been an update regarding this?

I looked into using RSS feed but the RSS feed seems to be missing some articles. 

For examples, there are 19 articles announced on the cs.DS list for 29th August but the RSS feed at http://export.arxiv.org/rss/cs.DS shows only 12 articles.

(The date in the screenshot is August 28th probably because they are announced the night before.)

Thanks,

Ankit

[Jake Weiskoff]

Hi Ankit,

We're aware that occasionally the RSS feeds are missing items, but have not as yet tracked down the root cause. The developers are actively looking into this issue, but I can't provide a timeline or updates for a resolution. 

Regards,

-Jake 

To view this discussion on the web visit https://groups.google.com/d/msgid/arxiv-api/0bfe8a24-59c2-426f-bf16-2ac2b06d98efn%40googlegroups.com.