OAI not getting updates?

25 views
Skip to first unread message

Brad

unread,
May 21, 2008, 10:34:43 AM5/21/08
to arXiv api
My usual scripts for arxiv.mobi have only been pulling in updated
papers the past two days. Has anything changed?
Thanks

julius.lucks

unread,
May 21, 2008, 10:45:08 AM5/21/08
to Brad, Simeon Warner, arxi...@googlegroups.com
Hey Brad,

What do you mean only updated papers the past two days? You have not
received any previous updates?

Thanks,

Julius

---------------------------------------------------------------------------------------
http://www.openwetware.org/wiki/User:Julius_B._Lucks
----------------------------------------------------------------------------------------

Brad Chase

unread,
May 21, 2008, 10:55:53 AM5/21/08
to julius.lucks, Simeon Warner, arxi...@googlegroups.com
Yeah, I wasn't so clear there. So, my daily scripts request the past
two days worth of OAI records. For each record, I look at the dc:date
elements to figure out if this is a new paper, or an update of an old
paper. For May 19-20, I only get back papers which have more than one
dc:date, which I take to mean papers that have been updated (replaced)
by their authors. Looking at the arXiv itself, there have been new
papers posted. Its possible that the issue is with my code, but I
think it had been fine until this week.
Brad

Brad

unread,
May 21, 2008, 12:01:32 PM5/21/08
to arXiv api
Thanks, things are ok now. It turns out that 0805.2605 does not
return metadata and my update scripts were crashing.

http://export.arxiv.org/oai2?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:arXiv.org:0805.2605

returns

<?xml version="1.0" encoding="UTF-8"?>
<OAI-PMH xmlns="http://www.openarchives.org/OAI/2.0/"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/
http://www.openarchives.org/OAI/2.0/OAI-PMH.xsd">
<responseDate>2008-05-21T15:50:52Z</responseDate>
<request verb="GetRecord" identifier="oai:arXiv.org:0805.2605"
metadataPrefix="oai_dc">http://export.arxiv.org/oai2</request>
<GetRecord>
<record>
<header>
<identifier>oai:arXiv.org:0805.2605</identifier>
<datestamp>2008-05-19</datestamp>
<setSpec>math</setSpec>
</header>

</record>
</GetRecord>
</OAI-PMH>

It appears password protected from the normal arXiv site, but does
work from http://aps.arxiv.org/abs/0805.2605.

On May 21, 8:55 am, "Brad Chase" <bach...@gmail.com> wrote:
> Yeah, I wasn't so clear there.   So, my daily scripts request the past
> two days worth of OAI records.  For each record, I look at the dc:date
> elements to figure out if this is a new paper, or an update of an old
> paper.  For May 19-20, I only get back papers which have more than one
> dc:date, which I take to mean papers that have been updated (replaced)
> by their authors.  Looking at the arXiv itself, there have been new
> papers posted.  Its possible that the issue is with my code, but I
> think it had been fine until this week.
> Brad
>

Thorsten S

unread,
May 21, 2008, 12:49:14 PM5/21/08
to arxi...@googlegroups.com
permissions on 0805.2605 were inadvertently wrong due to
administrative error and had already been flagged

apologies for the inconvenience and thanks for reporting
T.

Reply all
Reply to author
Forward
0 new messages