Fail to publish; Cannot delete

48 views
Skip to first unread message

Ken Mankoff

unread,
Aug 13, 2022, 11:04:54 AM8/13/22
to Dataverse Users Community
Hello,

Our DV admin recently updated something. They can create and publish new datasets, but our existing datasets cannot be updated. I'm seeing this error:

 Failed to Publish Dataset – The dataset could not be published because one or more of the datafiles in the dataset could not be validated (physical file missing, checksum mismatch, etc.) Please contact support for further assistance.


I cannot delete the Draft, or publish it. If the admin deletes the draft, and my script attempts to update the files, this occurs again. This error message doesn't show up on Google. I'm not sure what to do.

Thanks,

   -k.

Ken Mankoff

unread,
Aug 13, 2022, 11:05:33 AM8/13/22
to Dataverse Users Community
Screenshot_2022-08-13_080141.png

Durand, Gustavo

unread,
Aug 15, 2022, 1:20:49 PM8/15/22
to dataverse...@googlegroups.com
Hi Ken,

Would you mind creating an RT ticket for this? You can do this by emailing:


Thanks,
Gustavo

On Sat, Aug 13, 2022 at 11:05 AM Ken Mankoff <man...@gmail.com> wrote:
Screenshot_2022-08-13_080141.png

On Saturday, August 13, 2022 at 8:04:54 AM UTC-7 Ken Mankoff wrote:

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/946a07eb-3aea-4ccb-99f2-3bb8e1750aben%40googlegroups.com.

Ken Mankoff

unread,
Aug 15, 2022, 2:00:28 PM8/15/22
to Dataverse Users Community
On Monday, August 15, 2022 at 1:20:49 PM UTC-4 Gustavo Durand wrote:
Would you mind creating an RT ticket for this? You can do this by emailing:


Done.

Thanks,
 
  -k.

Ken Mankoff

unread,
Aug 15, 2022, 2:08:10 PM8/15/22
to dataverse...@googlegroups.com, Durand, Gustavo

On 2022-08-15 at 13:20 -04, "Durand, Gustavo" <gdu...@iq.harvard.edu> wrote:
> Would you mind creating an RT ticket for this?

For this project, what's the difference between RT tickets and GitHub Issues?

-k.

Durand, Gustavo

unread,
Aug 15, 2022, 3:43:53 PM8/15/22
to Ken Mankoff, dataverse...@googlegroups.com
In some ways, it's investigation vs needing a code change. So in this case, as we'll help you investigate the issue, we'll start as an RT ticket. If / when we find a bug that needs a code change (as opposed to corrupt data*) then we can open up a github issue.

* there's a chance this may be due to a bug in 5.11, which if so, is already fixed code wise and we'll need to help you fix the corrupt data.

Gustavo

On Mon, Aug 15, 2022 at 2:08 PM Ken Mankoff <man...@gmail.com> wrote:

On 2022-08-15 at 13:20 -04, "Durand, Gustavo" <gdu...@iq.harvard.edu> wrote:
> Would you mind creating an RT ticket for this?

Rondineli Gama Saad

unread,
Nov 17, 2022, 9:03:44 AM11/17/22
to Dataverse Users Community
Hello everybody,
I am struggling with the same problem. The files are uploaded to AWS S3. Is there any solution for this problem?
Dataverse version: 5.12.1
S3 cmd version: s3cmd-2.3.0-1.el7.noarch
Log error during the publish process:
[2022-11-16T22:17:11.830-0300] [Payara 5.2021.6] [INFO] [] [edu.harvard.iq.dataverse.util.FileUtil] [tid: _ThreadID=308 _ThreadName=__ejb-thread-pool1] [timeMillis: 1668647831830] [levelValue: 800] [[
  Failed to open datafile id 4247 for reading]]

[2022-11-16T22:17:11.873-0300] [Payara 5.2021.6] [WARNING] [] [edu.harvard.iq.dataverse.DatasetServiceBean] [tid: _ThreadID=308 _ThreadName=__ejb-thread-pool1] [timeMillis: 1668647831873] [levelValue: 900] [[
  CommandException caught when executing the asynchronous portion of the Dataset Publication Command.]]

[2022-11-16T22:17:33.674-0300] [Payara 5.2021.6] [WARNING] [] [edu.harvard.iq.dataverse.dataaccess.ImageThumbConverter] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647853674] [levelValue: 900] [[
  could not read image with ImageIO.read()]]

[2022-11-16T22:17:33.675-0300] [Payara 5.2021.6] [WARNING] [] [com.amazonaws.services.s3.internal.S3AbortableInputStream] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647853675] [levelValue: 900] [[
  Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.]]

[2022-11-16T22:17:34.859-0300] [Payara 5.2021.6] [WARNING] [] [edu.harvard.iq.dataverse.dataaccess.ImageThumbConverter] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647854859] [levelValue: 900] [[
  could not read image with ImageIO.read()]]

[2022-11-16T22:17:34.859-0300] [Payara 5.2021.6] [WARNING] [] [com.amazonaws.services.s3.internal.S3AbortableInputStream] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647854859] [levelValue: 900] [[
  Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.]]

I appreciate any help or suggestion.
Best Regards,

Philip Durbin

unread,
Nov 28, 2022, 3:55:12 PM11/28/22
to dataverse...@googlegroups.com
Hi Rondineli,

Are you still having this problem? If so, please feel free to start a fresh thread about it.

Thanks!

Phil

Esta mensagem pode conter informação confidencial, sendo seu sigilo protegido por lei. Se você não for o destinatário ou a pessoa autorizada a receber esta mensagem, não pode usar, copiar ou divulgar as informações nela contidas ou tomar qualquer ação baseada nessas informações. Se você recebeu esta mensagem por engano, por favor, avise imediatamente ao remetente, respondendo o e-mail e em seguida apague-a. Agradecemos sua cooperação.


This message may contain confidential information and its confidentiality is protected by law. If you are not the addressed or authorized person to receive this message, you must not use, copy, disclose or take any action based on it or any information herein. If you have received this message by mistake, please advise the sender immediately by replying the e-mail and then deleting it. Thank you for your cooperation.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.


--

Rondineli Gama Saad

unread,
Nov 28, 2022, 3:58:53 PM11/28/22
to dataverse...@googlegroups.com
Hi Philip,
Thanks for answering me! Yes, We continue with this problem. I will open a new thread.
Best Regards

Rondineli Saad
Coordenador de TI / Preservação Digital / Segurança da Informação
SciELO - Scientific Electronic Library Online
FAPESP - CAPES - CNPq - BVS-BIREME/OPAS/OMS - FapUNIFESP
______________________________

Rua Dr. Diogo de Faria, 1087
04037-003 - São Paulo - SP - Brasil
www.scielo.org | 
www.scielo.br

Facebook - Twitter
Inscreva-se na nossa Newsletter


You received this message because you are subscribed to a topic in the Google Groups "Dataverse Users Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/dataverse-community/Ru8xvLGjlWw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to dataverse-commu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/CABbxx8E4T%2BLB2NaaMYjrSmqK4Au6ZYgRqG5jfSRxSgd%2Bi1jy5A%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages