STATA file processing and direct upload

[Bethany Seeger]

Hello, 

I'm attempting to figure out why some STATA files I have aren't becoming tab files once uploaded.  The only thing I can figure out is that I'm using direct upload, and that STATA -> tab processing doesn't happen when direct upload is being used?    (note, in one our of env that has indirect enabled, the tab files are created correctly.)

Could someone confirm if that is true? 

I'm not seeing it in the list of things that don't work when using direct file upload, so I wasn't sure, but it seems logical: 

• Unzipping of zip files. (See Compressed Files.)

• Extraction of metadata from FITS files. (See Astronomy (FITS).)

• Creation of NcML auxiliary files (See NetCDF and HDF5.)

• Extraction of a geospatial bounding box from NetCDF and HDF5 files (see NetCDF and HDF5) unless dataverse.netcdf.geo-extract-s3-direct-upload is set to true.

Thanks!

Bethany

[Bethany Seeger]

The other thing I thought of is that it _should_ work, but fails to validate the file, possibly failing because of byte order? 

https://github.com/IQSS/dataverse/blob/bbf29cc42bf6b897ffc7903a1f5bc87052d4071f/src/main/java/edu/harvard/iq/dataverse/ingest/tabulardata/impl/plugins/dta/DTAFileReader.java#L537

[Sherry Lake]

Hi  Bethany,

Check out the discussion in this google groups thread

https://groups.google.com/g/dataverse-community/c/EYPH_yPpDkI/m/WPjHSDLYBQAJ

 Not sure if things have been fixed in newer versions of the dataverse software. 

—

Sherry Lake

UVa Dataverse http://dataverse.lib.virginia.edu

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dataverse-community/3d2e3f3a-21ab-4854-85c5-f69ab2f238ban%40googlegroups.com.

[Philip Durbin]

Not that I know of.

I just created a pull request to update the documentation to mention this wrinkle about file detection and S3 direct upload. Please check it out: https://github.com/IQSS/dataverse/pull/11035

To view this discussion visit https://groups.google.com/d/msgid/dataverse-community/CADL9p-XEtD1zQw_1Cwu-ycX_MNpWMd5e1FgfL2yDjZgKbYkm-A%40mail.gmail.com.

--

Philip Durbin
Software Developer for http://dataverse.org
http://www.iq.harvard.edu/people/philip-durbin