Uploading ZIP files without automatic extraction or double zip

[Tutasi]

Hello everybody,

I would like to know if there is any supported way to upload a ZIP file without it being automatically extracted upon upload and without using double ZIP. 

Is it possible, either via the standard API, S3 direct upload, or any configuration setting, to ensure that a ZIP file is stored as a single file object and not unpacked by Dataverse during ingest?  

[Range, Jan]

Hi Tutasi,

to my knowledge, Dataverse only unzips the first level of a ZIP file and not subsequent archives. Therefore, you can archive your ZIP file, and the inner ZIP file will be displayed without being unzipped. At least that’s how I’ve done it so far.

All the best,

Jan

———————————

Jan Range
Research Data Software Engineer

University of Stuttgart
Stuttgart Center for Simulation Science (SC SimTech)
Cluster of Excellence EXC 2075 „Data-Integrated Simulation Science“ (SimTech)

Pfaffenwaldring 5a | Room 01.013 | 70569 Stuttgart Germany

Phone: 0049 711 685 60095
E-Mail: jan....@simtech.uni-stuttgart.de

——— Meet me ———

https://calendly.com/jan-range/meeting

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dataverse-community/49641436-92bd-4b8f-b49b-5e4357902eb0n%40googlegroups.com.

[Sebastian Karcher]

It also only unzips if folder upload isn't enabled. With folders enabled, zip files just upload as zip file, no more double-zipping, no more extraction (and less load on the server).

I would think that zips uploaded via direct S3 upload aren't unzipped in general, but (as you've probably noted) zip expansion isn't covered in the API guide at all so this isn't documented and I've not tested it.
Sebastian

To view this discussion visit https://groups.google.com/d/msgid/dataverse-community/17AF2842-A923-41B9-93BC-90E16E1C82E0%40simtech.uni-stuttgart.de.

--

Sebastian Karcher, PhD
www.sebastiankarcher.com

[Philip Durbin]

That's correct. When zip files are uploaded via S3 direct upload, they are not unzipped. Please see https://guides.dataverse.org/en/6.9/developers/big-data-support.html#features-that-are-disabled-if-s3-direct-upload-is-enabled

Also, here's the issue to upvote or comment on if you think Dataverse should offer an option in the UI (a checkbox or whatever) to not unzip files: https://github.com/IQSS/dataverse/issues/8029

To view this discussion visit https://groups.google.com/d/msgid/dataverse-community/CAOSYSD525o2-297dbTTK6ZQDN-8cEiwWGZPP50xOGE5%3Da%3DCW0w%40mail.gmail.com.

--

Philip Durbin
Software Developer for http://dataverse.org
http://www.iq.harvard.edu/people/philip-durbin