Configuration of Trusted Remote Storage

[Lincoln Sherpa]

Hi I have been tryin with Trusted remote storage for a while and kind of in a situation what i could do further
a) Testing with this file : https://svn.vsp.tu-berlin.de/repos/public-svn/matsim/scenarios/countries/de/berlin/berlin-v6.4/output/berlin-v6.4-10pct/berlin-v6.4.scorestats.png
b) my config on domain.xml is
```
<jvm-options>-Ddataverse.files.dl.type=remote</jvm-options>
       <jvm-options>-Ddataverse.files.dl.label=datalake</jvm-options>
       <jvm-options>-Ddataverse.files.dl.base-url=https://svn.vsp.tu-berlin.de/repos/public-svn</jvm-options>
       <jvm-options>-Ddataverse.files.dl.base-store=s3</jvm-options>
       <jvm-options>-Ddataverse.files.dl.download-redirect=true</jvm-options>
       <jvm-options>-Ddataverse.files.dl.public=true</jvm-options>
```

c) and when i use the command i get this error
```
curl -H "X-Dataverse-key: xxxxxxxxxx"      -X POST      "http://xxxxxxx:xxx/api/datasets/:persistentId
/add?persistentId=doi:10.5072/FK2/ZQBLX7"      -F 'jsonData={"description":"Berlin v6.4 10% score statistics plot","storageIdentifier":"dl://matsim/scenarios/countri
es/de/berlin/berlin-v6.4/output/berlin-v6.4-10pct/berlin-v6.4.scorestats.png","md5Hash":"4f8299b5f5bb324b4e4a9f7a07c3d0b8","label":"berlin-v6.4.scorestats.png","file
Name":"berlin-v6.4.scorestats.png","mimeType":"image/png", "checksumType":"MD5"}'
```
{"status":"ERROR","message":"Dataset store configuration does not allow provided storageIdentifier."}

d) from payara serverlog there is nothing
```
jsonData: {"description":"Berlin v6.4 10% score statistics plot","storageIdentifier":"https://svn.vsp.tu-berlin.de/repos/public-svn/matsim/scenarios/countries/de/
berlin/berlin-v6.4/output/berlin-v6.4-10pct/berlin-v6.4.scorestats.png","md5Hash":"4f8299b5f5bb324b4e4a9f7a07c3d0b8","label":"berlin-v6.4.scorestats.png","fileName"
:"berlin-v6.4.scorestats.png","mimeType":"image/png"}]]
```
5)I’ve selected the “datalake” option as the trusted storage label in Dataverse (used 6.7.1)
.

Would really appreciate any insights or suggestions from others who’ve worked with remote storage setups like this.

[James Myers]

I think you also need

-Ddataverse.files.dl.upload-out-of-band=true

 

Depending on your Dataverse version, you may also need

-Ddataverse.files.dl.reference-endpoints-with-basepaths=https://svn.vsp.tu-berlin.de/repos/public-svn

The base-url is supposed to be all that’s needed (and worked for me in 6.7.1+, but on an older Dataverse, I had to add this as well – not yet sure why)

 

FWIW: I’ve been looking at this for the Texas Digital Library recently and realized we changed from using upload-redirect-true for remote stores without updating the guides. I’ll be making an update soon – feel free to also add an issue.

 

-- Jim

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dataverse-community/df67ce85-8c0c-4f53-b427-65a5a44d4af6n%40googlegroups.com.

[Lincoln Sherpa]

Thank you  so much Jim.

IT WORKED :) !!!!

Best Regards
Lincoln Sherpa