Fail to publish; Cannot delete

[Ken Mankoff]

Hello,

Our DV admin recently updated something. They can create and publish new datasets, but our existing datasets cannot be updated. I'm seeing this error:

 Failed to Publish Dataset – The dataset could not be published because one or more of the datafiles in the dataset could not be validated (physical file missing, checksum mismatch, etc.) Please contact support for further assistance.

I cannot delete the Draft, or publish it. If the admin deletes the draft, and my script attempts to update the files, this occurs again. This error message doesn't show up on Google. I'm not sure what to do.

Thanks,

   -k.

[Ken Mankoff]

[Durand, Gustavo]

Hi Ken,

Would you mind creating an RT ticket for this? You can do this by emailing:

datavers...@help.hmdc.harvard.edu

Thanks,

Gustavo

On Sat, Aug 13, 2022 at 11:05 AM Ken Mankoff <man...@gmail.com> wrote:

On Saturday, August 13, 2022 at 8:04:54 AM UTC-7 Ken Mankoff wrote:

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/946a07eb-3aea-4ccb-99f2-3bb8e1750aben%40googlegroups.com.

[Ken Mankoff]

On Monday, August 15, 2022 at 1:20:49 PM UTC-4 Gustavo Durand wrote:

Would you mind creating an RT ticket for this? You can do this by emailing:

datavers...@help.hmdc.harvard.edu

Done.

Thanks,

 

  -k.

[Ken Mankoff]

On 2022-08-15 at 13:20 -04, "Durand, Gustavo" <gdu...@iq.harvard.edu> wrote:
> Would you mind creating an RT ticket for this?

For this project, what's the difference between RT tickets and GitHub Issues?

-k.

[Durand, Gustavo]

In some ways, it's investigation vs needing a code change. So in this case, as we'll help you investigate the issue, we'll start as an RT ticket. If / when we find a bug that needs a code change (as opposed to corrupt data*) then we can open up a github issue.

* there's a chance this may be due to a bug in 5.11, which if so, is already fixed code wise and we'll need to help you fix the corrupt data.

Gustavo

On Mon, Aug 15, 2022 at 2:08 PM Ken Mankoff <man...@gmail.com> wrote:

On 2022-08-15 at 13:20 -04, "Durand, Gustavo" <gdu...@iq.harvard.edu> wrote:

> Would you mind creating an RT ticket for this?

[Rondineli Gama Saad]

Hello everybody,

I am struggling with the same problem. The files are uploaded to AWS S3. Is there any solution for this problem?

Dataverse version: 5.12.1

S3 cmd version: s3cmd-2.3.0-1.el7.noarch

Log error during the publish process:

[2022-11-16T22:17:11.830-0300] [Payara 5.2021.6] [INFO] [] [edu.harvard.iq.dataverse.util.FileUtil] [tid: _ThreadID=308 _ThreadName=__ejb-thread-pool1] [timeMillis: 1668647831830] [levelValue: 800] [[
  Failed to open datafile id 4247 for reading]]

[2022-11-16T22:17:11.873-0300] [Payara 5.2021.6] [WARNING] [] [edu.harvard.iq.dataverse.DatasetServiceBean] [tid: _ThreadID=308 _ThreadName=__ejb-thread-pool1] [timeMillis: 1668647831873] [levelValue: 900] [[
  CommandException caught when executing the asynchronous portion of the Dataset Publication Command.]]

[2022-11-16T22:17:33.674-0300] [Payara 5.2021.6] [WARNING] [] [edu.harvard.iq.dataverse.dataaccess.ImageThumbConverter] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647853674] [levelValue: 900] [[
  could not read image with ImageIO.read()]]

[2022-11-16T22:17:33.675-0300] [Payara 5.2021.6] [WARNING] [] [com.amazonaws.services.s3.internal.S3AbortableInputStream] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647853675] [levelValue: 900] [[
  Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.]]

[2022-11-16T22:17:34.859-0300] [Payara 5.2021.6] [WARNING] [] [edu.harvard.iq.dataverse.dataaccess.ImageThumbConverter] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647854859] [levelValue: 900] [[
  could not read image with ImageIO.read()]]

[2022-11-16T22:17:34.859-0300] [Payara 5.2021.6] [WARNING] [] [com.amazonaws.services.s3.internal.S3AbortableInputStream] [tid: _ThreadID=88 _ThreadName=http-thread-pool::http-listener-1(6)] [timeMillis: 1668647854859] [levelValue: 900] [[
  Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.]]

I appreciate any help or suggestion.

Best Regards,

[Philip Durbin]

Hi Rondineli,

Are you still having this problem? If so, please feel free to start a fresh thread about it.

Thanks!

Phil

Esta mensagem pode conter informação confidencial, sendo seu sigilo protegido por lei. Se você não for o destinatário ou a pessoa autorizada a receber esta mensagem, não pode usar, copiar ou divulgar as informações nela contidas ou tomar qualquer ação baseada nessas informações. Se você recebeu esta mensagem por engano, por favor, avise imediatamente ao remetente, respondendo o e-mail e em seguida apague-a. Agradecemos sua cooperação.


This message may contain confidential information and its confidentiality is protected by law. If you are not the addressed or authorized person to receive this message, you must not use, copy, disclose or take any action based on it or any information herein. If you have received this message by mistake, please advise the sender immediately by replying the e-mail and then deleting it. Thank you for your cooperation.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/288b69e8-6de9-4d8a-8c17-232ad096b9fen%40googlegroups.com.

--

Philip Durbin
Software Developer for http://dataverse.org
http://www.iq.harvard.edu/people/philip-durbin

[Rondineli Gama Saad]

Hi Philip,

Thanks for answering me! Yes, We continue with this problem. I will open a new thread.

Best Regards

Rondineli Saad
Coordenador de TI / Preservação Digital / Segurança da Informação

SciELO - Scientific Electronic Library Online
FAPESP - CAPES - CNPq - BVS-BIREME/OPAS/OMS - FapUNIFESP

______________________________

Rua Dr. Diogo de Faria, 1087
04037-003 - São Paulo - SP - Brasil
www.scielo.org | www.scielo.br

Facebook - Twitter

Inscreva-se na nossa Newsletter

You received this message because you are subscribed to a topic in the Google Groups "Dataverse Users Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/dataverse-community/Ru8xvLGjlWw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to dataverse-commu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/CABbxx8E4T%2BLB2NaaMYjrSmqK4Au6ZYgRqG5jfSRxSgd%2Bi1jy5A%40mail.gmail.com.