Tabular Data Ingest fails on Dataverse 4.11

83 views
Skip to first unread message

scha.sch...@gmail.com

unread,
Apr 5, 2019, 5:10:31 AM4/5/19
to Dataverse Users Community
Hi all,

We are running dataverse 4.11 on a CentOs 7.6 server and are having problems with the ingest routine. (We recently upgraded from dataverse 4.9.2 but since we did not test every functionality before upgrading to 4.11 I do not know if the problem is version related or not...)

Anyway, no matter what type of data file we upload we get the warning "Upload Completed with Errors. Tabular data ingest failed. Ingest failed. No further information is available". (The example file 15by1000.dta in scripts/search/data/tabular/ fails as well). The glassfish log always goes like this:

- edu.harvard.iq.dataverse.ingest.IngestServiceBean Ingest of 1 tabular data file(s) is in progress. - org.primefaces.component.outputpanel.OutputPanelRenderer autoUpdate attribute is deprecated and will be removed in a future version, use p:autoUpdate component instead. - edu.harvard.iq.dataverse.ingest.IngestServiceBean Tabular data successfully ingested; DataTable with 11 variables produced. - edu.harvard.iq.dataverse.ingest.IngestServiceBean Tab-delimited file produced: /tmp/data-3477489717510726656.tab - org.dataverse.unf.RoundRoutines RoundRoutines:decimal separator no in right place - javax.enterprise.ejb.container A system exception occurred during an invocation on EJB IngestServiceBean, method: public boolean edu.harvard.iq.dataverse.ingest.IngestServiceBean.ingestAsTabular(java.lang.Long) 4.1|javax.enterprise.ejb.container|_ThreadID=62;_ThreadName=p: thread-pool-1; w: 4;_TimeMillis=1552594047968;_LevelValue=900;| javax.ejb.EJBException at com.sun.ejb.containers.EJBContainerTransactionManager.processSystemException(EJBContainerTransactionManager.java:748) at com.sun.ejb.containers.EJBContainerTransactionManager.completeNewTx(EJBContainerTransactionManager.java:698) at com.sun.ejb.containers.EJBContainerTransactionManager.postInvokeTx(EJBContainerTransactionManager.java:503) at... ... [Java Stack Trace...] ... - edu.harvard.iq.dataverse.ingest.IngestMessageBean Unknown exception occurred during ingest (supressed stack trace); re-setting ingest status. - edu.harvard.iq.dataverse.ingest.IngestMessageBean trying to save datafile and the failed ingest report, id=62 Do you have any ideas on this? Thanks, Sabine

Philip Durbin

unread,
Apr 5, 2019, 6:13:47 AM4/5/19
to dataverse...@googlegroups.com
Hi Sabine,

It sounds like you are suffering from https://github.com/IQSS/dataverse/issues/2620

Can you please try starting Glassfish using an English locale? When this bug was originally reported, we added the following to the installation guide:

"Please note that you must run Glassfish in an English locale. If you are using something like LANG=de_DE.UTF-8, ingest of tabular data will fail with the message “RoundRoutines:decimal separator no in right place”.


I'm curious which locale you're using now. I hope this helps!

Phil

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/c5148638-d686-494c-a5a1-80ccd03650ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


--

Leonid Andreev

unread,
Apr 5, 2019, 5:02:35 PM4/5/19
to Dataverse Users Community
Hello,
Could you please tell us what locale you are using exactly? (de_DE? de_DE.UTF-8? or ...? - I believe we asked this question earlier, in the support ticket).
We understand that running the application in the English/US locale may not be ideal for you. But in order to fix this, we would need your exact locale setting in order to simulate your environment.

best,
--
Leonid

On Friday, April 5, 2019 at 6:13:47 AM UTC-4, Philip Durbin wrote:
Hi Sabine,

It sounds like you are suffering from https://github.com/IQSS/dataverse/issues/2620

Can you please try starting Glassfish using an English locale? When this bug was originally reported, we added the following to the installation guide:

"Please note that you must run Glassfish in an English locale. If you are using something like LANG=de_DE.UTF-8, ingest of tabular data will fail with the message “RoundRoutines:decimal separator no in right place”.


I'm curious which locale you're using now. I hope this helps!

Phil

To unsubscribe from this group and stop receiving emails from it, send an email to dataverse...@googlegroups.com.

scha.sch...@gmail.com

unread,
Apr 9, 2019, 5:00:10 AM4/9/19
to Dataverse Users Community
Hi Phil, hi Leonid,

Thank you, it works now (though we are indeed not too happy having to run the server with a special locale)...

Leonid, we were on de_DE.uft8 before, thanks for investigating this. Re the ticket system I am sorry, but the link in the auto reply of the ticket system got redirected to the login page. Without credits I could not login, and I did not find any option to create an account...(furthermore the ticket system did not sent your answer by email).

Best,
Sabine
Reply all
Reply to author
Forward
0 new messages