Question about Trusted Remote Storage
Roberta Merlo
Hi everyone,
I am writing to ask a question on Trusted Remote Storage configuration.
We recently bought an IBM Spectrum Scale storage and we would like to configure our Dataverse instance to use it as a Trusted Remote Storage.
Based on TRS design documents and related documentation (see Releases · IQSS/dataverse (github.com) and Design for support for public and secured HTTP file stores in Dataverse - Documenti Google), it looks like only HTTP/HTTPS URLs are supported. Is that correct?
We were wondering if FTP / NFS / CIFS protocols are also supported given that our storage cannot expose files with HTTPS protocol.
Thank you very much for the help.
Best regards,
Roberta Merlo
IIT Dataverse (https://dataverse.iit.it/)
James Myers
Roberta,
Yes, Dataverse is currently restricted to using HTTP/HTTPS URLs for the RemoteOverlayStore at present. It might not be too hard for a developer to remove that restriction (the first issue I saw in code is that we try to do an HTTP HEAD call on the data URL to pick up the file’s size. There are probably more places where we assume HTTP.)
If your storage supports S3, have you thought about using an S3 store (potentially as one of several stores that you could assign just for more sensitive data)? That would still put Dataverse in charge of access decisions (versus using a remote store where the remote service would control access).
Alternately, S3 is an HTTPS protocol, so with S3, you could potentially still use a remote store, use the S3 URLs, and use non-Dataverse means of S3 access control. I’m not aware of anyone trying that yet though.
-- Jim
--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
dataverse-commu...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/dataverse-community/63e7b731-9561-4a8d-ae18-ca7912a607b2n%40googlegroups.com.
Roberta Merlo
Thank you for your answer.
Our storage should support S3 protocol, so we will try to configure it. I’ll let you know in case of issues or doubts.
Best regards,
Roberta