Lidar files in Dataverse seem stuck at validation

Jamie Jamison

unread,

Dec 10, 2020, 1:53:33 PM12/10/20

to Dataverse Users Community

For the UCLA Dataverse I'm trying to add Lidar geospatial files. The direct upload worked great. There are 6 files that seem stuck at file validation - for a bit over a day and a half now.

"× Publish in Progress – The dataset is locked while the persistent identifiers are being registered or updated, and/or the physical files are being validated.

Thank you,

Jamie Jamison

UCLA Dataverse

danny...@g.harvard.edu

unread,

Dec 10, 2020, 2:04:53 PM12/10/20

to Dataverse Users Community

Hi Jaime, the logs may reveal some details about the specific issue, but I believe we've seen this happen with a 403 from the PID provider -- we have this case in the Harvard Dataverse Repository from time to time as well. When we run into the issue where it stays locked for an unreasonable amount of time, we unlock and try the publish again, and it will usually go through. There's another class of failure here related to metadata validation (https://github.com/IQSS/dataverse/issues/6586), but that failure is less common and usually doesn't reach the stage where the dataset stays locked.

Are you using EZID? If so, is it possible that the publishing time intersected with some maintenance?

It's possible that more technical people will have some better suggestions. We've done work in this area over the last few releases, but we still have work to do.

Jamie Jamison

unread,

Dec 10, 2020, 2:08:35 PM12/10/20

to Dataverse Users Community

Danny,

I'll go back to the logs but I have no idea how to unlock. I guess that's in the documentation.

Last, yes we use EZID for publishing.

Thank you,

Jamie

danny...@g.harvard.edu

unread,

Dec 10, 2020, 2:12:05 PM12/10/20

to Dataverse Users Community

Hi Jamie, you're right, you just made me remember that we added a section to the docs about this:

https://guides.dataverse.org/en/latest/admin/troubleshooting.html#a-dataset-is-locked-and-cannot-be-edited-or-published

The lock-specific endpoints are here:

https://guides.dataverse.org/en/latest/api/native-api.html#id69

Hope this helps!

- Danny

Jamie Jamison

unread,

Dec 10, 2020, 2:14:12 PM12/10/20

to Dataverse Users Community

Was googling (I guess that's a verb now) and found that just as your reply hit. Will try the above and post what happens.

Thank you again,

Jamie

Jamie Jamison

unread,

Dec 10, 2020, 3:02:09 PM12/10/20

to Dataverse Users Community

Success. I followed the links posed, deleted the lock and republished. It took something like 5 minutes. I've never had anything "stuck" before but it worked on the republish just as you described.