[Dspace-tech] using oai harvesting in 16

[Blanco, Jose]

I want to try out setting up a collection so that it can harvest its contents using oai in the jspui webapp. When I go to the edit-collection page I see the options to do this, and I filled it out with the provider and set I'm interested in and format and have requested just to get the dc values, but how do I get Dspace to actually do the harvest. I see that there is documentation for doing this for the xmlui webapp, but none for the jspui webapp. Is there a way to request dspace ( either via the UI or by command line ) to start the harvest in jspui? I'm thinking that maybe a locally changed jsp file is inhibiting me from seeing this, but I have tried to use some of the official jsp pages and I can't see it.

Many thanks!
Jose

[Kim Shepherd]

Hi Jose,

If you are using JSPUI, you will need to use the command-line 'harvest' application to start harvests, whether you want to start a looping harvest or a single run.

You can run this with "[dspace]/bin/dspace harvest".

Example:

# /usr/local/dspace/bin/dspace harvest -h
usage: Harvest

-a,--address address of the OAI-PMH server
-P,--purge purge all harvestable collections
-R,--reset reset harvest status on all collections
-S,--start start the harvest loop
-c,--collection harvesting collection (handle or id)
-e,--eperson eperson
-g,--ping test the OAI server and set
-h,--help help
-i,--oai_set_id id of the PMH set representing the harvested
collection
-m,--metadata_format the name of the desired metadata format for
harvesting, resolved to namespace and crosswalk in dspace.cfg
-o,--once run the harvest procedure with specified
parameters
-p,--purge delete all items in the collection
-r,--run run the standrad harvest procedure
-s,--setup Set the collection up for harvesting
-t,--type type of harvesting (0 for none)

PING OAI server: Harvest -g -s oai_source -i oai_set_id
RUNONCE harvest with arbitrary options: Harvest -o -e eperson -c collection -t harvest_type -a oai_source -i oai_set_id -m metadata_format
SETUP a collection for harvesting: Harvest -s -c collection -t harvest_type -a oai_source -i oai_set_id -m metadata_format
RUN harvest once: Harvest -r -e eperson -c collection
START harvest scheduler: Harvest -S
RESET all harvest status: Harvest -R
PURGE a collection of items and settings: Harvest -p -e eperson -c collection
PURGE all harvestable collections: Harvest -P -e eperson

Cheers,

Kim

> -----Original Message-----
> From: Blanco, Jose [mailto:bla...@umich.edu]
> Sent: Wednesday, 26 May 2010 5:34 a.m.
> To: dspac...@lists.sourceforge.net
> Subject: Re: [Dspace-tech] using oai harvesting in 16
>
> Does anyone have any idea about this?:
>
> Thank you!
> Jose

> -----------------------------------------------------------------------
> -------
>
> _______________________________________________
> DSpace-tech mailing list
> DSpac...@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>
> -----------------------------------------------------------------------
> -------
>
> _______________________________________________
> DSpace-tech mailing list
> DSpac...@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Blanco, Jose]

Does anyone have any idea about this?:

Thank you!
Jose
-----Original Message-----
From: Blanco, Jose [mailto:bla...@umich.edu]
Sent: Friday, May 21, 2010 3:18 PM
To: dspac...@lists.sourceforge.net
Subject: [Dspace-tech] using oai harvesting in 16

------------------------------------------------------------------------------

[Blanco, Jose]

Kim, Thank you for this information. I have a few more questions about oai-ore. Perhaps you can help me.

1. Do you know of a repository that has implemented oai-ore. I would like to take a look at what I would get back when I do a ListRecords against them.

2. When I do ListMetadataFormats on my Dspace instance I don't see any indication that Dspace has implemented oai-ore. I see the usual formats, but nothing about any metadata formats containing resource maps. Am I missing something here?

3. Is there any more documentation on how to setup the command-line harvester. I ran it once and it died after a few records were harvested giving me this error:

Collection 596 failed on harvest:

Date: 5/26/10 1:30 PM
Status Flag: -1

Authorization denied for action WRITE on COLLECTION:596 by user 0

Exception:
org.dspace.authorize.AuthorizeException: Authorization denied for action WRITE on COLLECTION:596 by user 0
at org.dspace.authorize.AuthorizeManager.authorizeAction(AuthorizeManager.java:267)
at org.dspace.content.Collection.canEdit(Collection.java:1051)
at org.dspace.content.Collection.update(Collection.java:984)


Then I ran it again and it completed the harvest, but when I ran it again after that I got this error again. More documentation of this would be really helpful.

Thank you for getting me going on this!!!!

Jose

[Nguyen Hung Thanh]

Hi all,
Me too. I'm using xmlui. Does anyone have any idea about this?

-------------------------------------------------

Collection 2 failed on harvest:

Date:       4/6/11 10:24 AM
Status Flag: -1

Authorization denied for action WRITE on COLLECTION:2 by user 0

Exception:
org.dspace.authorize.AuthorizeException: Authorization denied for action WRITE on COLLECTION:2 by user 0
at org.dspace.authorize.AuthorizeManager.authorizeAction(AuthorizeManager.java:187)
at org.dspace.content.Collection.canEdit(Collection.java:1041)
at org.dspace.content.Collection.update(Collection.java:978)
at org.dspace.harvest.OAIHarvester.runHarvest(OAIHarvester.java:375)
at org.dspace.harvest.OAIHarvester$HarvestThread.runHarvest(OAIHarvester.java:1352)
at org.dspace.harvest.OAIHarvester$HarvestThread.run(OAIHarvester.java:1343)
at java.lang.Thread.run(Thread.java:662)

------------------------------------------------------------------------------