Tabular Data Ingest fails on Dataverse 4.11

[scha.sch...@gmail.com]

Hi all,

We are running dataverse 4.11 on a CentOs 7.6 server and are having problems with the ingest routine. (We recently upgraded from dataverse 4.9.2 but since we did not test every functionality before upgrading to 4.11 I do not know if the problem is version related or not...)

Anyway, no matter what type of data file we upload we get the warning "Upload Completed with Errors. Tabular data ingest failed. Ingest failed. No further information is available". (The example file 15by1000.dta in scripts/search/data/tabular/ fails as well). The glassfish log always goes like this:

- edu.harvard.iq.dataverse.ingest.IngestServiceBean
Ingest of 1 tabular data file(s) is in progress.

- org.primefaces.component.outputpanel.OutputPanelRenderer
autoUpdate attribute is deprecated and will be removed in a future
version, use p:autoUpdate component instead.

- edu.harvard.iq.dataverse.ingest.IngestServiceBean
Tabular data successfully ingested; DataTable with 11 variables
produced.

- edu.harvard.iq.dataverse.ingest.IngestServiceBean
Tab-delimited file produced: /tmp/data-3477489717510726656.tab

- org.dataverse.unf.RoundRoutines
RoundRoutines:decimal separator no in right place

- javax.enterprise.ejb.container
A system exception occurred during an invocation on EJB
IngestServiceBean, method: public boolean
edu.harvard.iq.dataverse.ingest.IngestServiceBean.ingestAsTabular(java.lang.Long)

4.1|javax.enterprise.ejb.container|_ThreadID=62;_ThreadName=p:
thread-pool-1; w: 4;_TimeMillis=1552594047968;_LevelValue=900;|
  javax.ejb.EJBException
	at
com.sun.ejb.containers.EJBContainerTransactionManager.processSystemException(EJBContainerTransactionManager.java:748)
	at
com.sun.ejb.containers.EJBContainerTransactionManager.completeNewTx(EJBContainerTransactionManager.java:698)
	at
com.sun.ejb.containers.EJBContainerTransactionManager.postInvokeTx(EJBContainerTransactionManager.java:503)
	at...
...
[Java Stack Trace...]
...

- edu.harvard.iq.dataverse.ingest.IngestMessageBean
Unknown exception occurred  during ingest (supressed stack trace);
re-setting ingest status.

- edu.harvard.iq.dataverse.ingest.IngestMessageBean
trying to save datafile and the failed ingest report, id=62


Do you have any ideas on this?

Thanks,
Sabine

[Philip Durbin]

Hi Sabine,

It sounds like you are suffering from https://github.com/IQSS/dataverse/issues/2620

Can you please try starting Glassfish using an English locale? When this bug was originally reported, we added the following to the installation guide:

"Please note that you must run Glassfish in an English locale. If you are using something like LANG=de_DE.UTF-8, ingest of tabular data will fail with the message “RoundRoutines:decimal separator no in right place”.

http://guides.dataverse.org/en/4.11/installation/prerequisites.html#launching-glassfish-on-system-boot

I'm curious which locale you're using now. I hope this helps!

Phil

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/c5148638-d686-494c-a5a1-80ccd03650ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Philip Durbin
Software Developer for http://dataverse.org
http://www.iq.harvard.edu/people/philip-durbin

[Leonid Andreev]

Hello,

Could you please tell us what locale you are using exactly? (de_DE? de_DE.UTF-8? or ...? - I believe we asked this question earlier, in the support ticket).

We understand that running the application in the English/US locale may not be ideal for you. But in order to fix this, we would need your exact locale setting in order to simulate your environment.

best,

--

Leonid

On Friday, April 5, 2019 at 6:13:47 AM UTC-4, Philip Durbin wrote:

Hi Sabine,

It sounds like you are suffering from https://github.com/IQSS/dataverse/issues/2620

Can you please try starting Glassfish using an English locale? When this bug was originally reported, we added the following to the installation guide:

"Please note that you must run Glassfish in an English locale. If you are using something like LANG=de_DE.UTF-8, ingest of tabular data will fail with the message “RoundRoutines:decimal separator no in right place”.

http://guides.dataverse.org/en/4.11/installation/prerequisites.html#launching-glassfish-on-system-boot

I'm curious which locale you're using now. I hope this helps!

Phil

To unsubscribe from this group and stop receiving emails from it, send an email to dataverse...@googlegroups.com.

To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/c5148638-d686-494c-a5a1-80ccd03650ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[scha.sch...@gmail.com]

Hi Phil, hi Leonid,

Thank you, it works now (though we are indeed not too happy having to run the server with a special locale)...

Leonid, we were on de_DE.uft8 before, thanks for investigating this. Re the ticket system I am sorry, but the link in the auto reply of the ticket system got redirected to the login page. Without credits I could not login, and I did not find any option to create an account...(furthermore the ticket system did not sent your answer by email).

Best,

Sabine