OAI import: when to run a full vs incremental import

46 views
Skip to first unread message

apbw

unread,
May 18, 2023, 10:51:25 PM5/18/23
to DSpace Community
When is it recommended to clear the Solr indexes and run a full oai import (dspace oai import -c`), versus the default incremental import (`dspace oai import`) ? 

(Context: we're upgrading our repository from DSpace6 to DSpace7 on a new server. But  I would also like to know more generally when a full import is recommended, because I don't want to duplicate records in Primo inadvertently). 

Thanks for any advice! 

~Amy



Yvonne

unread,
May 19, 2023, 8:45:36 AM5/19/23
to apbw, DSpace Community
Hi Amy,

Our institution uses Primo VE, not Primo, but most likely you have set up a digital import profile in Alma. Check to make sure that the "Match Profile" tab's Match Actions settings say "Do Not Import" upon match. This should avoid duplicating records in discovery.

The only time I've run a full import over again is when I've messed up the import in the first place. :-) Which I've done a couple of times (we support many campuses at SUNY).

However, our DSpace is hosted, and I will admit that I do not know what you are referring to when you talk about clearing the solr indexes and the -c import versus regular.

I hope this is helpful.

Best wishes,
Yvonne
SUNY Library Services

--
All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
---
You received this message because you are subscribed to the Google Groups "DSpace Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-community/2a10e911-5ff0-44d9-bb00-7798eff50d25n%40googlegroups.com.

Mark H. Wood

unread,
May 19, 2023, 9:42:42 AM5/19/23
to dspace-c...@googlegroups.com
This may be better asked of the Solr community. But generally, you
need to re-index when upgrading Solr or when the schema has changed.

Going from DSpace 6 to 7 is a *big* jump in the Solr version. You
will need to rebuild the cores, as the release notes explain. For
some time now, Solr major version N will refuse to load a core that's
ever been touched by Solr major version N-2 or earlier.

If you worry that a core is corrupted, rebuilding it is the way to fix
it.

I can't comment on the Primo angle, because I have no idea what Primo is.

--
Mark H. Wood
Lead Technology Analyst

University Library
Indiana University - Purdue University Indianapolis
755 W. Michigan Street
Indianapolis, IN 46202
317-274-0749
www.ulib.iupui.edu
signature.asc

apbw

unread,
May 19, 2023, 9:43:11 PM5/19/23
to DSpace Community
Thanks Mark & Yvonne, this info is very helpful. 
Reply all
Reply to author
Forward
0 new messages