Processing PDFs, stalling at "Normalize for preservation"; "End Time: Invalid Date"

[Courtney Whitmore]

Good morning,

We have been having some problems in processing PDFs and have been unable to identify the exact factor that is causing the issues. Sometimes when we attempt to run PDFs through the system, it stalls out on the Normalize job of "Normalize for preservation". 

In the tasks, sometimes we generate errors, but for many of the files, it looks like this: 

Task UUID: 44f33b68-a372-4acc-ad76-60e1941cfa5b File UUID: 49e677a7-aa2a-4bf4-a163-cdcc490c7b30 File name: GenCenDigest_2014-September_edition.pdf Client: qamatica_2   (exit code: None)

Start time: Thursday, December 17, 2015 9:31:24 AM End time: Invalid Date Created time: Thursday, December 17, 2015 9:30:57 AM Duration: second(s)

On a separate issue, perhaps, we recently got an error that looks like this:

The last error obviously has to do with the format, but I have had problems similar to that in the past and attempted to convert the files myself prior to ingest, however I encountered problems, so I wondered if anyone else has run into problems similar to either of these and has some experience to share. 

Kind Regards,

Courtney Whitmore

Michigan State University Archives & Historical Collections 

[Sarah Romkey]

Hi Courtney,

For the first error you're reporting, which task did you receive the error on? And was there any output below the lines that you pasted in? Some tasks don't report any tool output, and I'm thinking this might be one of them.

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To post to this group, send email to archiv...@googlegroups.com.
Visit this group at https://groups.google.com/group/archivematica.
For more options, visit https://groups.google.com/d/optout.

[Sarah Romkey]

Sorry, as soon as I hit send I knew I missed something- this is the output from the Normalize for Preservation task. There should be more output below what you pasted, if you could check and report it, it might help us troubleshoot.

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

[Courtney Whitmore]

Hello Sarah,

Thank you for the help. I am hoping this is what you are asking for. It's the part under the "Show Arguments". 

normalize_v1.0 preservation "49e677a7-aa2a-4bf4-a163-cdcc490c7b30" "/var/archivematica/sharedDirectory/currentlyProcessing/A.2015.0201_001-ecc4334b-599f-4596-952c-8db57b92fa92/objects/GenCenDigest_2014-September_edition.pdf" "/var/archivematica/sharedDirectory/currentlyProcessing/A.2015.0201_001-ecc4334b-599f-4596-952c-8db57b92fa92/" "ecc4334b-599f-4596-952c-8db57b92fa92" "%taskUUID%" "original"

As for the red error bit (the image in red above), there was nothing after that, but quite a lot before it. I am attaching a pdf of the full readout. 

Best,

Courtney 

--
You received this message because you are subscribed to a topic in the Google Groups "archivematica" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/archivematica/tpUTpCM7udU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to archivematic...@googlegroups.com.

[Sarah Romkey]

Hi Courtney,

Hmm, not exactly- I was hoping for some tool output below "Show Arguments". If you're allowed to share these PDF's I wonder if you could send me a sample on or off list and I'll see if I can do some testing locally?

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

[Courtney Whitmore]

Hello Sarah,

Sorry for the delay. I have a few files here for you to try. 

Thank you for all the assistance with this. 

Best,

Courtney 

[Kari R Smith]

Hi Courtney,

I just processed your three files through my instance of Archivematica and they were normalized for Preservation (PDFA using ghostscript) correctly.

 

Kari Smith, MIT

[Courtney Whitmore]

Hello again,

As a follow up to these posts, I just processed a different set of files and have run into a similar, but somewhat different problem. It is still stalling at the "Normalize for Preservation" step, but the files have an End Time now, and I have some specific errors codes, which I wondered if anyone had run into. 

Here is one part:

Command stdout:
GPL Ghostscript 9.10 (2013-08-30)
Copyright (C) 2013 Artifex Software, Inc.  All rights reserved.
This software comes with NO WARRANTY: see the file PUBLIC for details.
Unrecoverable error: rangecheck in .putdeviceprops

-----
Command exit code: 255

And the STDERR:

Failed: Transcoding to pdfa with Ghostscript
Standard out: GPL Ghostscript 9.10 (2013-08-30)
Copyright (C) 2013 Artifex Software, Inc.  All rights reserved.
This software comes with NO WARRANTY: see the file PUBLIC for details.
Unrecoverable error: rangecheck in .putdeviceprops

Standard error: 
Command Transcoding to pdfa with Ghostscript failed!

One file seems to have normalized and had this message, which I have seen before:

GPL Ghostscript 9.10: Annotation set to non-printing,
 not permitted in PDF/A, annotation will not be present in output file

In any case, at this point, I think we are going to simply try a reinstall, since we think some configuration got screwed up at some point, but I wanted to post here and see if anyone had experienced this and had some input to share. 

Thank you for any feedback or advice.

Best,

Courtney Whitmore

[Sarah Romkey]

Hi Courtney,

I had some trouble in the past few weeks with my messages to the user group going to spam, so I see now that you maybe didn't get my response. Like Kari, I was able to process your PDF samples through normalization without error. If you're reinstalling something, I think you could just reinstall/upgrade Ghostscript- the problem seems to be specific to that tool on your server.

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

[Courtney Whitmore]

Hello Sarah,

Thank you for the advice! We will try that. 

Best,

Courtney 

--
You received this message because you are subscribed to a topic in the Google Groups "archivematica" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/archivematica/tpUTpCM7udU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to archivematic...@googlegroups.com.

[Grant Hurley]

Came across this post with a similar error listed above coming from Ghostscript:

Unrecoverable error: rangecheck in .putdeviceprops

-----
Command exit code: 255

I fixed it as suggested by Sarah by updating Ghostscript from source - instructions are available here - https://askubuntu.com/questions/199489/whats-the-easiest-way-to-upgrade-ghostscript