Example of microservice that would parse metadata from a plain text file (CSV, YAML, etc)?

[Simon Twigger]

I'm looking to upload a structured text file into a collection and then have a microservice parse that file for metadata and apply it to the surrounding data objects. Not being a C++ expert I was wondering if anyone has any examples of a microservice that does something along those lines that I could have a look at, or perhaps there is a way to use a different approach to achieve the same result?

The primary goal is to reduce (ideally to remove) extra metadata entry by collecting key metadata outside of iRODS (e.g. via a web form that exports a CSV, JSON, YAML or similar) and then be able to put that text file into the Collection along with the pertinent files and have the microservice read the file, pull out the metadata and apply the metadata to the surrounding objects (and likely to objects in sub-collections as well).

Thanks in advance for any suggestions!

Simon.

[Terrell Russell]

Hi Simon,

There are some examples in the irods/contrib repository that may help you answer your questions.

This rule shows how to apply metadata to a data object.

https://github.com/irods/contrib/blob/master/microservices/landing_zone_microservices/landing_zone.r

Terrell

--
--
"iRODS: the Integrated Rule-Oriented Data-management System; A community driven, open source, data grid software solution" https://www.irods.org
 
iROD-Chat: http://groups.google.com/group/iROD-Chat

---
You received this message because you are subscribed to the Google Groups "iRODS-Chat" group.
To unsubscribe from this group and stop receiving emails from it, send an email to irod-chat+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Reagan Moore]

The micro-service msiLoadMetadataFromDataObj(*Path,*Status)

loads pipe-delimited metadata onto specified files.

See github,com

DICE-UNC/microservices/microservices/msiLoadMetadataFrmDataObj

There is a second example for loading metadata from XML.

Reagan Moore

[Simon Twigger]

Thanks Reagan, this is another useful example I can build off.

Cheers,

    Simon.

[Simon Twigger]

Terrell, many thanks for the suggestion, I have worked through the basic image magick micro-service but the landing zone example has some extra pieces which are helpful to see how the rules side of things fits in.

Simon.