Re: [ReDBox] Metadata harvesting into ReDBox

[Andrew Brazzatti]

Hi Christopher & Matthias,

That's correct. At the moment (ReDBox 1.6) there is a method to bring CSVs into ReDBox via the alerts functionality. It's fairly limited however as:

• It only allows creation of dataset records put into the "Inbox" workflow state
• It only supports processing files from a file system directory

For ReDBox 1.8, the existing methods will still function however to allow for better integration with external systems we've implemented a standalone web application called the ReDBox Harvester.

It will allow you to upload "harvest configurations" which will allow you to receive or extract data from the external system, perform any transformations or validations that may be needed via scripting and push the record through to ReDBox to be either created, updated or deleted.

We have some documentation here that is currently in draft form. We've only created two configuration packages at the moment, one for harvesting csv data from the file system for Mint (essentially replacing the existing functionality) and one to grab data from a JDBC database (the package includes the HyperSQL driver but it can easily be changed to support any other database platform that has a JDBC driver) and create records Dataset records for ReDBox.

There's some developer information on how to create your own configuration packages from scratch.However we are actually scheduled to develop some very similar packages to allow integration between the RDSI ARMS (Allocation Request Management System) used by QCIF and ReDBox so it should be trivial to make a CSV file source one too. I will let everyone know here when that's available.

Happy to have a chat with anyone that's interested in having these sorts of integrations with other systems (e.g. Data Capture systems) as there may be better solutions than using CSVs in some cases.

Thanks,

Andrew

On Tue, Apr 28, 2015 at 10:38 AM, Matthias Liffers <matthias...@curtin.edu.au> wrote:

Hi Chris,

 

We’ve been working on a large metadata creation project ourselves, and have managed to get this metadata harvesting to work using the Alerts system.

 

We have Lab Information Management System called Bika that has been customised to provide a CSV to ReDBox. ReDBox ingests that CSV and creates draft records that a human pushes through workflow (we prefer human intervention to mint a DOI). It may be possible to make the records immediately available as Published, but we haven’t looked into that.

 

Happy to have a chat, if you like.

 

Regards,

 

Matthias Liffers
BCompSc W.Aust. MInfoStud CSturt AALIA (CP)
Coordinator, Research Services | University Library

Curtin University
Tel | +61 8 9266 2439
Fax | +61 8 9266 4185

Email | matthias...@curtin.edu.au
Web | http://library.curtin.edu.au

 

 

 

From: redbo...@googlegroups.com [mailto:redbo...@googlegroups.com] On Behalf Of Christopher McAvaney
Sent: Tuesday, 28 April 2015 9:03
To: redbo...@googlegroups.com
Subject: [ReDBox] Metadata harvesting into ReDBox

 

G'day,

Did I hear correctly in the User Group meeting today, that it is possible to harvest metadata records from an external source such as a CSV file?
I have a project currently underway in our Library that have a large number of metadata records to create, if there was a method to use a CSV, rather than manual keying it would be fantastic.

Is there any documentation on this for ReDBox - I see that there is for Mint, but nothing for ReDBox.

Regards,
Christopher

--
-- Website: http://www.redboxresearchdata.com.au
 
You received this message because you are subscribed to the Google Groups ReDBox group. To post to this group, send email to redbo...@googlegroups.com. To unsubscribe from this group, send email to redbox-repo...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/redbox-repo?hl=en
---
You received this message because you are subscribed to the Google Groups "ReDBox" group.
To unsubscribe from this group and stop receiving emails from it, send an email to redbox-repo...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
-- Website: http://www.redboxresearchdata.com.au
 
You received this message because you are subscribed to the Google Groups ReDBox group. To post to this group, send email to redbo...@googlegroups.com. To unsubscribe from this group, send email to redbox-repo...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/redbox-repo?hl=en
---
You received this message because you are subscribed to the Google Groups "ReDBox" group.
To unsubscribe from this group and stop receiving emails from it, send an email to redbox-repo...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Christopher McAvaney]

Thanks Andrew,
This information is very useful.
Will investigate the existing "Alerts" functionality and see how we go.

Regards,
Christopher