Data cleanup pre-upgrade/migration

25 views
Skip to first unread message

Fitchett, Deborah

unread,
Jan 25, 2023, 6:32:07 PM1/25/23
to DSpace Technical Support

Kia ora koutou,

 

Before upgrading to DSpace 7 I thought I’d take the opportunity to see if there was any old data we could clean up a bit (we’re currently in DSpace 5.8 – it seems easiest to do it while I’m still familiar with the database structure and also avoid migrating stuff only to delete it later).

 

On a fairly manual scale this includes looking at our low-use collections and metadata fields to check if there’d be other more appropriate ones.

 

I’m also looking at our epersons, especially as we have open signup so it’s likely to be full of clutter. I want to be a lot more cautious before I casually delete a whole group of epersons from the database though! So far I’m looking at a query for epersons with a last_active date of null OR before [some date] who aren’t in any of the tables:

  • item as submitter_id
  • subscription
  • resourcepolicy
  • tasklistitem
  • versionitem
  • resourcepolicy
  • workflowitem as owner
  • epersongroup2eperson

Have I missed any other database links in the DSpace 5 structure? Are there any other notes of caution I should heed before going ahead, or any safer ways of purging users than a DELETE * WHERE statement in the database? (We would do a full database backup beforehand but it’s still rather daunting.)

 

Has anyone else done a clean-up like this, and have there been other areas of the system you’ve looked at?

 

(I’m also looking at permissions groups – this opens up several cans of worms all at once so we’ll deal with that with especial care, but would be particularly interested if anyone’s done something like that before too.)

 

Deborah

––––––––––––––––––––––––––––––––––

Deborah Fitchett (she/her) MLIS, RLIANZA

Associate University Librarian, Digital Scholarship

 

––––––––––––––––––––––––––––––––––

Learning, Teaching and Library – Te Whare Pūrākau

PO Box 85064, Lincoln University

Lincoln 7647, Christchurch, New Zealand

+64 3 423 0358

deborah....@lincoln.ac.nz

ltl.lincoln.ac.nz

 

––––––––––––––––––––––––––––––––––

Lincoln University

Te Whare Wānaka o Aoraki

––––––––––––––––––––––––––––––––––

 




"The contents of this e-mail (including any attachments) may be confidential and/or subject to copyright. Any unauthorised use, distribution, or copying of the contents is expressly prohibited. If you have received this e-mail in error, please advise the sender by return e-mail or telephone and then delete this e-mail together with all attachments from your system."
Reply all
Reply to author
Forward
0 new messages