Possibility to stop ingest when files are not recognized

[robert....@gmail.com]

Hi everyone,

For the processing of digitized material we would ideally like Archivematica to stop the ingest when when files are not recognized. In this case Archivematica has the standard behaviour to copy masterfiles to the DIP which in this context and for us is unwanted behaviour.

As far as I know the current version of Archivematica does not have the possibility to set up a processing pipelines that will fail ingest in this case. Or is there?

Thanks!

All the best,

Robert Gillesse
Specialist digital preservation
International Institute of Social History
Amsterdam

[Jens Steidl]

Hi,

we changed the default behaviour of the job "Validate formats" to stop ingests on validation errors by editing the JSON-encoded workflow of the instance itself.

File path (in AM 1.18): /opt/archivematica/archivematica/src/archivematica/MCPServer/assets/workflow.json

Maybe something similar can be achieved with the job "Identify file format" or another custom command that provides a stable exit code for your error case?

More details:

• initial post with idea: https://groups.google.com/g/archivematica/c/PHqCSXxMDV0/m/Xe3WSBZkAgAJ
• workflow visualization tool (may help find the correct connections): https://github.com/artefactual-labs/amflow
• our enhancement request/issue: https://github.com/archivematica/Issues/issues/1490
• our current patch for validation

--- workflow.json 2025-02-11 15:53:47.617974670 +0100
+++ workflow.fail-on_validation-error.json 2025-02-14 17:19:34.887327388 +0100
@@ -8109,10 +8109,14 @@
         "0": {
           "job_status": "Completed successfully",
           "link_id": "ec3c965c-c056-47e3-a551-ad1966e00824"
+        },
+        "1": {
+          "job_status": "Failed",
+          "link_id": "61c316a6-0a50-4f65-8767-1f44b1eeb6dd"
         }
       },
       "fallback_job_status": "Failed",
-      "fallback_link_id": "ec3c965c-c056-47e3-a551-ad1966e00824",
+      "fallback_link_id": "61c316a6-0a50-4f65-8767-1f44b1eeb6dd",
       "group": {
         "en": "Validation",
         "es": "Validación",

• • links the validation job return value "1" as well as the fallback to job "Email fail report" instead of the next regular job
  • job "Email fail report" seems to start the chain for failed transfers

Best regards,

Jens Steidl

team member SLUBArchiv.digital | digital long-term preservation
Saxon State and University Library Dresden (SLUB)