Dspace 7 Collection content harvesting from external source

[Mathieu Pelletier]

Greetings all,

I seem to be having difficulty getting Dspace to harvest from my Koha OAI server. I have setup our sets and the OAI server seems to be working well:

http://library.sats.ac.za/cgi-bin/koha/oai.pl?verb=Identify

Set data: http://library.sats.ac.za/cgi-bin/koha/oai.pl?verb=ListRecords&metadataPrefix=oai_dc&set=phd

However, if I attempt to setup my collection to harvest from the source, I get the 422 error with the UI message: "The provided settings have been tested and didn't work."

I am not entirely where to go from here. I may have missed something in my configuration, but I am not sure what.  Any ideas?

[Tim Donohue]

Hi Mathieu,

OAI-PMH Collection harvesting is not yet fully implemented in the DSpace 7 UI.  So, the error you are seeing may relate to the fact that the feature doesn't yet exist.  That said, we are working on building this feature right now, so it's likely going to be in 7.1.  Here's the ticket for it. https://github.com/DSpace/dspace-angular/issues/761

Tim

---

From: dspac...@googlegroups.com <dspac...@googlegroups.com> on behalf of Mathieu Pelletier <mkpel...@gmail.com>
Sent: Tuesday, September 28, 2021 5:18 AM
To: DSpace Technical Support <dspac...@googlegroups.com>
Subject: [dspace-tech] Dspace 7 Collection content harvesting from external source

 

--
All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
---
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/fd1131ce-597f-4259-a8f4-c9b6a05702e2n%40googlegroups.com.

[Mathieu Pelletier]

Thanks, Tim.  For once, this one is not on me! :-D

I look forward to the released product.  It will save my librarians a lot of time not having to learn a new system.

All the best,

Mathieu

[Gavin Spomer]

OAI is not implemented yet? 

[Tim Donohue]

Hi Gavin,

No. To clarify, there's two types of OAI-PMH support in DSpace 6.x, and v7.0 only supports one.

• DSpace provides its own OAI-PMH interface so that external applications can harvest from​ DSpace. This is supported in 6.x and in 7.0.
• DSpace also provides an OAI-PMH harvester, that allows DSpace to harvest from​ external applications. This is supported in 6.x (XMLUI only). but is NOT in 7.0.  It's most likely coming in 7.1 as the feature is under review right now and nearly complete.

Tim

---

From: dspac...@googlegroups.com <dspac...@googlegroups.com> on behalf of Gavin Spomer <Gavin....@cwu.edu>
Sent: Thursday, September 30, 2021 11:25 AM

To: DSpace Technical Support <dspac...@googlegroups.com>

Subject: Re: [dspace-tech] Dspace 7 Collection content harvesting from external source

 

To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/ed36a842-d437-4a44-a31a-c3ae74d39ca2n%40googlegroups.com.

[M P]

Hi Tim,

Do you know if this is working fully yet?  I can get OAI harvesting to work, and it works very well.  However, if I try to use the ORE client so I can capture the bitstreams I get a 422 error.  Is this part of the implementation complete or is it a configuration issue on my end?

Many thanks for the help!

[Tim Donohue]

Hi,

I *believe* DSpace 7 should now fully support OAI Harvesting. However, the ORE client will ONLY WORK if the site you are harvesting *from* supports OAI-ORE.  In the past, this ORE harvesting was designed to support DSpace to DSpace transfers...e.g. the old XMLUI supported ORE, which allowed you to harvest one DSpace from another. 

If you are having continued issues and you are *certain* that the site/server you are harvesting from supports ORE, then please share the details of the 422 exception you are seeing on this list.  It's possible there's a bug somewhere, but it'd be impossible to diagnose without the full exception. See our troubleshooting guide to find the exception. https://wiki.lyrasis.org/display/DSPACE/Troubleshoot+an+error#Troubleshootanerror-DSpace7.x(orabove)

Tim

[M P]

Thanks, Tim.  After doing some digging, seems like Koha doesn't support ORE nor can I find a plugin for it.  Looks like I'll have to either write a tool to import the bitstreams or do it one at a time.

I'll be back with an update...