Looping processes in mysql after error in transfer
224 views
Skip to first unread message
frank....@gmail.com
Mar 22, 2023, 5:22:46 AM3/22/23
to archivematica
Hi,
.png?part=0.1&view=1)
We have a strange problem here. Back in January, we uploaded a fileset to Archivematica. It reported a couple of errors while being processed, but succeded, and is now in storage. Afterwards we put in a two more, without any errors. As far as Archivematica is concerned, all three are in order.
But now, several weeks later, we have problems with the server. It's going slow, and we looked into it. The command 'top' shows that mysqld is taking all processor capacity, and after logging into the database, 'SHOW FULL PROCESSLIST' reveals that the last three uploaded packages are continously being re-processed in mysql:
Restarting the server has no effect. Mysql just start up the same way again.
Does anyone have an idea what going wrong here, and how to stop it correctly?
The part of the MCPServer.log regarding the first package, are below, with the errors highlighted:
INFO 2023-01-19 10:13:35 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc created (%sharedPath%watchedDirectories/activeTransfers/standardTransfer/A-1925_Greater_Stavanger_IKS_2005-2020/)
INFO 2023-01-19 10:13:35 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Approve standard transfer (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable activeAgent created for 17e60062-1140-4a05-83cc-d6852eafbacc: 3 (MSCL: None)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 6953950b-c101-4f4c-a0c3-0cd0684afe5e for link 0c94e6b5-4714-4bec-82c8-e187e0c04d77
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Set transfer type: Standard (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Remove hidden files and directories (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Remove unneeded files (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:02 archivematica.mcp.server.jobs.local:local:run:29: Running Determine if Dataverse conversion needs to happen (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:02 archivematica.mcp.server.jobs.client:client:run:113: Running Attempt restructure for compliance (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:02 archivematica.mcp.server.jobs.client:client:run:113: Running Verify transfer compliance (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Verify mets_structmap.xml compliance (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Rename with transfer UUID (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Include default Transfer processingMCP.xml (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Assign UUIDs to directories? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Assign UUIDs to directories (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Assign file UUIDs to objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:15:44 archivematica.mcp.server.jobs.client:client:run:113: Running Assign checksums and file sizes to objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:18:15 archivematica.mcp.server.jobs.client:client:run:113: Running Process transfer JSON metadata (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:18:15 archivematica.mcp.server.jobs.client:client:run:113: Running Verify metadata directory checksums (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:18:15 archivematica.mcp.server.jobs.client:client:run:113: Running Scan for viruses (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:53 archivematica.mcp.server.jobs.client:client:run:113: Running Move to generate transfer tree (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/createTree/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Generate transfer structure report (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain df54fec1-dae1-4ea6-8d17-a839ee7ac4a7 for link 56eebd45-5600-4768-a8c2-ec0114555a3d
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.client:client:run:113: Running Save directory tree (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.client:client:run:113: Running Change object and directory filenames (package 17e60062-1140-4a05-83cc-d6852eafbacc)
ERROR 2023-01-19 10:44:22 archivematica.mcp.server.tasks:task:_write_file_to_disk:106: Unable to write to: /var/archivematica/sharedDirectory/currentlyProcessing/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/logs/filenameCleanup.log
Traceback (most recent call last):
File "/usr/lib/archivematica/MCPServer/server/tasks/task.py", line 103, in _write_file_to_disk
f.write(contents)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xf8' in position 735: ordinal not in range(128)
INFO 2023-01-19 10:44:22 archivematica.mcp.server.jobs.client:client:run:113: Running Change transfer name (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:22 archivematica.mcp.server.jobs.client:client:run:113: Running Move to select file ID tool (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:23 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/selectFormatIDToolTransfer/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 10:44:23 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Do you want to perform file format identification? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:52 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 10:44:52 archivematica.mcp.server.jobs.local:local:run:29: Running Determine which files to identify (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:52 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:57:05 archivematica.mcp.server.jobs.client:client:run:113: Running Move to extract packages (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:57:05 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/extractPackagesChoice/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 10:57:06 archivematica.mcp.server.jobs.client:client:run:113: Running Determine if transfer contains packages (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:57:15 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Extract packages? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:00:39 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 11:00:39 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 79f1f5af-7694-48a4-b645-e42790bbf870 for link dec97e3c-5598-4b99-b26e-f87a435a6b7f
INFO 2023-01-19 11:00:39 archivematica.mcp.server.jobs.client:client:run:113: Running Store file modification dates (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:00:49 archivematica.mcp.server.jobs.client:client:run:113: Running Load rights (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:00:49 archivematica.mcp.server.jobs.client:client:run:113: Running Characterize and extract metadata (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:03:07 archivematica.mcp.server.jobs.client:client:run:113: Running Load labels from metadata/file_labels.csv (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:03:07 archivematica.mcp.server.jobs.client:client:run:113: Running Load PREMIS events from metadata/premis.xml (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:03:07 archivematica.mcp.server.jobs.client:client:run:113: Running Validate formats (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:26:29 archivematica.mcp.server.jobs.client:client:run:113: Running Generate METS.xml document (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:04 archivematica.mcp.server.jobs.local:local:run:29: Running Determine if Dataverse METS XML needs to be parsed (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:04 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Perform policy checks on originals? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:04 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 3e891cc4-39d2-4989-a001-5107a009a223 for link 70fc7040-d4fb-4d19-a0e6-792387ca1006
INFO 2023-01-19 12:28:05 archivematica.mcp.server.jobs.client:client:run:113: Running Move to examine contents (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:05 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/examineContentsChoice/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 12:28:05 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Examine contents? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain e0a39199-c62a-4a2f-98de-e9d1116460a8 for link accea2bf-ba74-4a3a-bb97-614775c74459
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.local:local:run:29: Running Check for specialized processing (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.client:client:run:113: Running Parse external METS (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.client:client:run:113: Running Create transfer metadata XML (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.client:client:run:113: Running Move to SIP creation directory for completed transfers (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/SIPCreation/completedTransfers/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.jobs.client:client:run:113: Running Check transfer directory for objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.jobs.local:local:run:29: Running Load options to create SIPs (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Create SIP(s) (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 61cfa825-120e-4b17-83e6-51a42b67d969 for link bb194013-597c-4e4a-8493-b36d190f8717
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.client:client:run:113: Running Serialize Dublin Core metadata to disk (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.client:client:run:113: Running Create SIP from transfer objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/system/autoProcessSIP/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.jobs.client:client:run:113: Running Verify SIP compliance (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.jobs.client:client:run:113: Running Check if SIP is from Maildir Transfer (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:40 archivematica.mcp.server.jobs.client:client:run:113: Running Rename SIP directory with SIP UUID (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:40 archivematica.mcp.server.jobs.client:client:run:113: Running Include default SIP processingMCP.xml (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:40 archivematica.mcp.server.jobs.client:client:run:113: Running Remove cache files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Change SIP name (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Load Dublin Core metadata from disk (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Identify manually normalized files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Check for Service directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Check for Access directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.local:local:run:29: Running Set remove preservation and access normalized files to renormalize link. (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable reNormalize created for b39c3c70-fce2-4941-b44b-43b092caaa9d: (MSCL: 8ba83807-2832-4e41-843c-2e55ad10ea0b)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.local:local:run:29: Running Grant normalization options for no pre-existing DIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable resumeAfterNormalizationFileIdentificationToolSelected created for b39c3c70-fce2-4941-b44b-43b092caaa9d: (MSCL: cb8e5706-e73f-472f-ad9b-d1236af8095f)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Move to select file ID tool (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/workFlowDecisions/selectFormatIDToolIngest/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Do you want to perform file format identification? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:31:14 archivematica.mcp.server.jobs.local:local:run:29: Running Resume after normalization file identification tool selected. (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:31:14 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Normalize (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:15 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 12:32:15 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 89cb80dd-0636-464f-930d-57b61e3928b2 for link cb8e5706-e73f-472f-ad9b-d1236af8095f
INFO 2023-01-19 12:32:15 archivematica.mcp.server.jobs.client:client:run:113: Running Create thumbnails directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.local:local:run:29: Running Set normalize path (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable normalizationThumbnailProcessing created for b39c3c70-fce2-4941-b44b-43b092caaa9d: (MSCL: f6fdd1a7-f0c5-4631-b5d3-19421155bd7a)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Choose thumbnail mode (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.local:local:run:29: Running Return to normalization step (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.client:client:run:113: Running Normalize for thumbnails (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:00 archivematica.mcp.server.jobs.client:client:run:113: Running Remove files without linking information (failed normalization artifacts etc.) (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Perform policy checks on preservation derivatives? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain b7ce05f0-9d94-4b3e-86cc-d4b2c6dba546 for link 153c5f41-3cfb-47ba-9150-2dd44ebc27df
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Perform policy checks on access derivatives? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 76befd52-14c3-44f9-838f-15a4e01624b0 for link 8ce07e94-6130-4987-96f0-2399ad45c5c2
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.client:client:run:113: Running Move to metadata reminder (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/workFlowDecisions/metadataReminder/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Reminder: add metadata if desired (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:20 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:00:20 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 5727faac-88af-40e8-8c10-268644b0142d for link eeb23509-57e2-4529-8857-9d62525db048
INFO 2023-01-19 13:00:20 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Transcribe SIP contents? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:28 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:00:28 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 0a24787c-00e3-4710-b324-90e792bfb484 for link 82ee9ad2-2c74-4c7c-853e-e4eaf68fc8b6
INFO 2023-01-19 13:00:28 archivematica.mcp.server.jobs.client:client:run:113: Running Copy transfer submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:28 archivematica.mcp.server.jobs.client:client:run:113: Running Check for submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Move submission documentation into objects directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Assign file UUIDs to submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Assign checksums and file sizes to submissionDocumentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Sanitize file and directory names in submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:30 archivematica.mcp.server.jobs.client:client:run:113: Running Scan for viruses in submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:31 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Do you want to perform file format identification? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:31 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
ERROR 2023-01-19 13:00:32 archivematica.mcp.server.rpc_server:rpc_server:wrap:188: Exception raised by handler approveJob: u'179fefc0-21a2-4504-a968-b0fca07db888'
Traceback (most recent call last):
File "/usr/lib/archivematica/MCPServer/server/rpc_server.py", line 180, in wrap
resp = handler(*args)
File "/usr/lib/archivematica/MCPServer/server/rpc_server.py", line 212, in _job_approve_handler
job_chain = self.package_queue.decide(job_id, chain, user_id=user_id)
File "/usr/lib/archivematica/MCPServer/server/queues.py", line 357, in decide
decision = self.waiting_choices[job_uuid]
KeyError: u'179fefc0-21a2-4504-a968-b0fca07db888'
INFO 2023-01-19 13:00:33 archivematica.mcp.server.jobs.client:client:run:113: Running Characterize and extract metadata on submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:34 archivematica.mcp.server.jobs.client:client:run:113: Running Remove files without linking information (failed normalization artifacts etc.) (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:06 archivematica.mcp.server.jobs.client:client:run:113: Running Copy transfers metadata and logs (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Process JSON metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Move metadata to objects directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Assign file UUIDs to metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Assign checksums and file sizes to metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Sanitize file and directory names in metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:08 archivematica.mcp.server.jobs.client:client:run:113: Running Scan for viruses in metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:10 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format of metadata files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:11 archivematica.mcp.server.jobs.client:client:run:113: Running Characterize and extract metadata on metadata files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:13 archivematica.mcp.server.jobs.client:client:run:113: Running Load persistent identifiers from external file (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:13 archivematica.mcp.server.jobs.client:client:run:113: Running Remove empty manual normalization directories (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:13 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Bind PIDs? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:40 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 44a7c397-8187-4fd2-b8f7-c61737c4df49 for link a2ba5278-459a-4638-92d9-38eb1588717d
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Document empty directories? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 65273f18-5b4e-4944-af4f-09be175a88e8 for link d0dfa5fc-e3c2-4638-9eda-f96eea1070e0
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.client:client:run:113: Running Generate METS.xml document (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:04:45 archivematica.mcp.server.jobs.client:client:run:113: Running Add README file (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:04:45 archivematica.mcp.server.jobs.client:client:run:113: Running Check if DIP should be generated (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:04:45 archivematica.mcp.server.jobs.client:client:run:113: Running Prepare AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:40 archivematica.mcp.server.jobs.client:client:run:113: Running Move to compressionAIPDecisions directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/workFlowDecisions/compressionAIPDecisions/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Select compression algorithm (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Select compression level (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.jobs.client:client:run:113: Running Compress AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Copy submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Set bag file permissions (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Check if AIP is a file or directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Remove bagged files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:49 archivematica.mcp.server.jobs.client:client:run:113: Running Move to the store AIP approval directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:49 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/storeAIP/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 13:31:49 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Store AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:56 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:31:56 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 9efab23c-31dc-4cbd-a39d-bb1665460cbe for link 2d32235c-02d4-4686-88a6-96f4d6c7b1c3
INFO 2023-01-19 13:31:57 archivematica.mcp.server.jobs.client:client:run:113: Running Retrieve AIP Storage Locations (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:57 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Store AIP location (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:32:00 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:32:00 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:32:00 archivematica.mcp.server.jobs.client:client:run:113: Running Verify AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:44:47 archivematica.mcp.server.jobs.client:client:run:113: Running Store the AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:51:23 archivematica.mcp.server.jobs.client:client:run:113: Running Index AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:54:56 archivematica.mcp.server.jobs.client:client:run:113: Running Clean up after storing AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:54:56 archivematica.mcp.server.jobs.client:client:run:113: Running Remove the processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 10:13:35 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Approve standard transfer (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable activeAgent created for 17e60062-1140-4a05-83cc-d6852eafbacc: 3 (MSCL: None)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 6953950b-c101-4f4c-a0c3-0cd0684afe5e for link 0c94e6b5-4714-4bec-82c8-e187e0c04d77
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Set transfer type: Standard (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Remove hidden files and directories (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:13:44 archivematica.mcp.server.jobs.client:client:run:113: Running Remove unneeded files (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:02 archivematica.mcp.server.jobs.local:local:run:29: Running Determine if Dataverse conversion needs to happen (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:02 archivematica.mcp.server.jobs.client:client:run:113: Running Attempt restructure for compliance (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:02 archivematica.mcp.server.jobs.client:client:run:113: Running Verify transfer compliance (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Verify mets_structmap.xml compliance (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Rename with transfer UUID (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Include default Transfer processingMCP.xml (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Assign UUIDs to directories? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Assign UUIDs to directories (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:14:03 archivematica.mcp.server.jobs.client:client:run:113: Running Assign file UUIDs to objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:15:44 archivematica.mcp.server.jobs.client:client:run:113: Running Assign checksums and file sizes to objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:18:15 archivematica.mcp.server.jobs.client:client:run:113: Running Process transfer JSON metadata (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:18:15 archivematica.mcp.server.jobs.client:client:run:113: Running Verify metadata directory checksums (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:18:15 archivematica.mcp.server.jobs.client:client:run:113: Running Scan for viruses (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:53 archivematica.mcp.server.jobs.client:client:run:113: Running Move to generate transfer tree (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/createTree/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Generate transfer structure report (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain df54fec1-dae1-4ea6-8d17-a839ee7ac4a7 for link 56eebd45-5600-4768-a8c2-ec0114555a3d
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.client:client:run:113: Running Save directory tree (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:42:54 archivematica.mcp.server.jobs.client:client:run:113: Running Change object and directory filenames (package 17e60062-1140-4a05-83cc-d6852eafbacc)
ERROR 2023-01-19 10:44:22 archivematica.mcp.server.tasks:task:_write_file_to_disk:106: Unable to write to: /var/archivematica/sharedDirectory/currentlyProcessing/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/logs/filenameCleanup.log
Traceback (most recent call last):
File "/usr/lib/archivematica/MCPServer/server/tasks/task.py", line 103, in _write_file_to_disk
f.write(contents)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xf8' in position 735: ordinal not in range(128)
INFO 2023-01-19 10:44:22 archivematica.mcp.server.jobs.client:client:run:113: Running Change transfer name (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:22 archivematica.mcp.server.jobs.client:client:run:113: Running Move to select file ID tool (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:23 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/selectFormatIDToolTransfer/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 10:44:23 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Do you want to perform file format identification? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:52 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 10:44:52 archivematica.mcp.server.jobs.local:local:run:29: Running Determine which files to identify (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:44:52 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:57:05 archivematica.mcp.server.jobs.client:client:run:113: Running Move to extract packages (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:57:05 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/extractPackagesChoice/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 10:57:06 archivematica.mcp.server.jobs.client:client:run:113: Running Determine if transfer contains packages (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 10:57:15 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Extract packages? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:00:39 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 11:00:39 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 79f1f5af-7694-48a4-b645-e42790bbf870 for link dec97e3c-5598-4b99-b26e-f87a435a6b7f
INFO 2023-01-19 11:00:39 archivematica.mcp.server.jobs.client:client:run:113: Running Store file modification dates (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:00:49 archivematica.mcp.server.jobs.client:client:run:113: Running Load rights (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:00:49 archivematica.mcp.server.jobs.client:client:run:113: Running Characterize and extract metadata (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:03:07 archivematica.mcp.server.jobs.client:client:run:113: Running Load labels from metadata/file_labels.csv (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:03:07 archivematica.mcp.server.jobs.client:client:run:113: Running Load PREMIS events from metadata/premis.xml (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 11:03:07 archivematica.mcp.server.jobs.client:client:run:113: Running Validate formats (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:26:29 archivematica.mcp.server.jobs.client:client:run:113: Running Generate METS.xml document (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:04 archivematica.mcp.server.jobs.local:local:run:29: Running Determine if Dataverse METS XML needs to be parsed (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:04 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Perform policy checks on originals? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:04 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 3e891cc4-39d2-4989-a001-5107a009a223 for link 70fc7040-d4fb-4d19-a0e6-792387ca1006
INFO 2023-01-19 12:28:05 archivematica.mcp.server.jobs.client:client:run:113: Running Move to examine contents (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:05 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/workFlowDecisions/examineContentsChoice/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 12:28:05 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Examine contents? (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain e0a39199-c62a-4a2f-98de-e9d1116460a8 for link accea2bf-ba74-4a3a-bb97-614775c74459
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.local:local:run:29: Running Check for specialized processing (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.client:client:run:113: Running Parse external METS (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.client:client:run:113: Running Create transfer metadata XML (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:14 archivematica.mcp.server.jobs.client:client:run:113: Running Move to SIP creation directory for completed transfers (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:808: Transfer 17e60062-1140-4a05-83cc-d6852eafbacc updated (%sharedPath%watchedDirectories/SIPCreation/completedTransfers/A-1925_Greater_Stavanger_IKS_2005-2020-17e60062-1140-4a05-83cc-d6852eafbacc/)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.jobs.client:client:run:113: Running Check transfer directory for objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.jobs.local:local:run:29: Running Load options to create SIPs (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:15 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Create SIP(s) (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for 17e60062-1140-4a05-83cc-d6852eafbacc updated to 3 (MSCL None)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 61cfa825-120e-4b17-83e6-51a42b67d969 for link bb194013-597c-4e4a-8493-b36d190f8717
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.client:client:run:113: Running Serialize Dublin Core metadata to disk (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:27 archivematica.mcp.server.jobs.client:client:run:113: Running Create SIP from transfer objects (package 17e60062-1140-4a05-83cc-d6852eafbacc)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/system/autoProcessSIP/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.jobs.client:client:run:113: Running Verify SIP compliance (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:39 archivematica.mcp.server.jobs.client:client:run:113: Running Check if SIP is from Maildir Transfer (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:40 archivematica.mcp.server.jobs.client:client:run:113: Running Rename SIP directory with SIP UUID (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:40 archivematica.mcp.server.jobs.client:client:run:113: Running Include default SIP processingMCP.xml (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:40 archivematica.mcp.server.jobs.client:client:run:113: Running Remove cache files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Change SIP name (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Load Dublin Core metadata from disk (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Identify manually normalized files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Check for Service directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Check for Access directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.local:local:run:29: Running Set remove preservation and access normalized files to renormalize link. (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable reNormalize created for b39c3c70-fce2-4941-b44b-43b092caaa9d: (MSCL: 8ba83807-2832-4e41-843c-2e55ad10ea0b)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.local:local:run:29: Running Grant normalization options for no pre-existing DIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable resumeAfterNormalizationFileIdentificationToolSelected created for b39c3c70-fce2-4941-b44b-43b092caaa9d: (MSCL: cb8e5706-e73f-472f-ad9b-d1236af8095f)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Move to select file ID tool (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/workFlowDecisions/selectFormatIDToolIngest/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Do you want to perform file format identification? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:28:57 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:31:14 archivematica.mcp.server.jobs.local:local:run:29: Running Resume after normalization file identification tool selected. (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:31:14 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Normalize (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:15 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 12:32:15 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 89cb80dd-0636-464f-930d-57b61e3928b2 for link cb8e5706-e73f-472f-ad9b-d1236af8095f
INFO 2023-01-19 12:32:15 archivematica.mcp.server.jobs.client:client:run:113: Running Create thumbnails directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.local:local:run:29: Running Set normalize path (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.packages:packages:set_variable:699: New UnitVariable normalizationThumbnailProcessing created for b39c3c70-fce2-4941-b44b-43b092caaa9d: (MSCL: f6fdd1a7-f0c5-4631-b5d3-19421155bd7a)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Choose thumbnail mode (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.local:local:run:29: Running Return to normalization step (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:32:16 archivematica.mcp.server.jobs.client:client:run:113: Running Normalize for thumbnails (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:00 archivematica.mcp.server.jobs.client:client:run:113: Running Remove files without linking information (failed normalization artifacts etc.) (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Perform policy checks on preservation derivatives? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain b7ce05f0-9d94-4b3e-86cc-d4b2c6dba546 for link 153c5f41-3cfb-47ba-9150-2dd44ebc27df
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Perform policy checks on access derivatives? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 76befd52-14c3-44f9-838f-15a4e01624b0 for link 8ce07e94-6130-4987-96f0-2399ad45c5c2
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.client:client:run:113: Running Move to metadata reminder (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/workFlowDecisions/metadataReminder/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 12:53:33 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Reminder: add metadata if desired (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:20 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:00:20 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 5727faac-88af-40e8-8c10-268644b0142d for link eeb23509-57e2-4529-8857-9d62525db048
INFO 2023-01-19 13:00:20 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Transcribe SIP contents? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:28 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:00:28 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 0a24787c-00e3-4710-b324-90e792bfb484 for link 82ee9ad2-2c74-4c7c-853e-e4eaf68fc8b6
INFO 2023-01-19 13:00:28 archivematica.mcp.server.jobs.client:client:run:113: Running Copy transfer submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:28 archivematica.mcp.server.jobs.client:client:run:113: Running Check for submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Move submission documentation into objects directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Assign file UUIDs to submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Assign checksums and file sizes to submissionDocumentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:29 archivematica.mcp.server.jobs.client:client:run:113: Running Sanitize file and directory names in submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:30 archivematica.mcp.server.jobs.client:client:run:113: Running Scan for viruses in submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:31 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Do you want to perform file format identification? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:31 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
ERROR 2023-01-19 13:00:32 archivematica.mcp.server.rpc_server:rpc_server:wrap:188: Exception raised by handler approveJob: u'179fefc0-21a2-4504-a968-b0fca07db888'
Traceback (most recent call last):
File "/usr/lib/archivematica/MCPServer/server/rpc_server.py", line 180, in wrap
resp = handler(*args)
File "/usr/lib/archivematica/MCPServer/server/rpc_server.py", line 212, in _job_approve_handler
job_chain = self.package_queue.decide(job_id, chain, user_id=user_id)
File "/usr/lib/archivematica/MCPServer/server/queues.py", line 357, in decide
decision = self.waiting_choices[job_uuid]
KeyError: u'179fefc0-21a2-4504-a968-b0fca07db888'
INFO 2023-01-19 13:00:33 archivematica.mcp.server.jobs.client:client:run:113: Running Characterize and extract metadata on submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:00:34 archivematica.mcp.server.jobs.client:client:run:113: Running Remove files without linking information (failed normalization artifacts etc.) (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:06 archivematica.mcp.server.jobs.client:client:run:113: Running Copy transfers metadata and logs (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Process JSON metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Move metadata to objects directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Assign file UUIDs to metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Assign checksums and file sizes to metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:07 archivematica.mcp.server.jobs.client:client:run:113: Running Sanitize file and directory names in metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:08 archivematica.mcp.server.jobs.client:client:run:113: Running Scan for viruses in metadata (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:10 archivematica.mcp.server.jobs.client:client:run:113: Running Identify file format of metadata files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:11 archivematica.mcp.server.jobs.client:client:run:113: Running Characterize and extract metadata on metadata files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:13 archivematica.mcp.server.jobs.client:client:run:113: Running Load persistent identifiers from external file (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:13 archivematica.mcp.server.jobs.client:client:run:113: Running Remove empty manual normalization directories (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:13 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Bind PIDs? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:40 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 44a7c397-8187-4fd2-b8f7-c61737c4df49 for link a2ba5278-459a-4638-92d9-38eb1588717d
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Document empty directories? (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 65273f18-5b4e-4944-af4f-09be175a88e8 for link d0dfa5fc-e3c2-4638-9eda-f96eea1070e0
INFO 2023-01-19 13:01:40 archivematica.mcp.server.jobs.client:client:run:113: Running Generate METS.xml document (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:04:45 archivematica.mcp.server.jobs.client:client:run:113: Running Add README file (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:04:45 archivematica.mcp.server.jobs.client:client:run:113: Running Check if DIP should be generated (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:04:45 archivematica.mcp.server.jobs.client:client:run:113: Running Prepare AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:40 archivematica.mcp.server.jobs.client:client:run:113: Running Move to compressionAIPDecisions directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/workFlowDecisions/compressionAIPDecisions/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Select compression algorithm (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.jobs.decisions:decisions:run:211: Running Select compression level (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:07:41 archivematica.mcp.server.jobs.client:client:run:113: Running Compress AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Copy submission documentation (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Set bag file permissions (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Check if AIP is a file or directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:45 archivematica.mcp.server.jobs.client:client:run:113: Running Remove bagged files (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:49 archivematica.mcp.server.jobs.client:client:run:113: Running Move to the store AIP approval directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:49 archivematica.mcp.server.packages:packages:get_or_create_from_db_by_path:745: SIP b39c3c70-fce2-4941-b44b-43b092caaa9d updated (%sharedPath%watchedDirectories/storeAIP/A-1925_Greater_Stavanger_IKS_2005-2020-b39c3c70-fce2-4941-b44b-43b092caaa9d/)
INFO 2023-01-19 13:31:49 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Store AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:56 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:31:56 archivematica.mcp.server.jobs.decisions:decisions:decide:127: Using user selected chain 9efab23c-31dc-4cbd-a39d-bb1665460cbe for link 2d32235c-02d4-4686-88a6-96f4d6c7b1c3
INFO 2023-01-19 13:31:57 archivematica.mcp.server.jobs.client:client:run:113: Running Retrieve AIP Storage Locations (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:31:57 archivematica.mcp.server.jobs.decisions:decisions:run:52: Running Store AIP location (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:32:00 archivematica.mcp.server.packages:packages:set_variable:699: Existing UnitVariable activeAgent for b39c3c70-fce2-4941-b44b-43b092caaa9d updated to 3 (MSCL None)
INFO 2023-01-19 13:32:00 archivematica.mcp.server.jobs.client:client:run:113: Running Move to processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:32:00 archivematica.mcp.server.jobs.client:client:run:113: Running Verify AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:44:47 archivematica.mcp.server.jobs.client:client:run:113: Running Store the AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:51:23 archivematica.mcp.server.jobs.client:client:run:113: Running Index AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:54:56 archivematica.mcp.server.jobs.client:client:run:113: Running Clean up after storing AIP (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
INFO 2023-01-19 13:54:56 archivematica.mcp.server.jobs.client:client:run:113: Running Remove the processing directory (package b39c3c70-fce2-4941-b44b-43b092caaa9d)
Joseph Anderson
Mar 22, 2023, 9:54:45 AM3/22/23
to archivematica
I'm not sure if this is the case here, but I've have had instances where there have been errors of some sort or another and there's a remnant of the transfer left somewhere in the watchedDirectories directory, which causes Archivematica to keep attempting to process it. In those cases, I've found the remnants by browsing through watchedDirectories and deleting the remnants, and then restarting everything. Again, not sure if this what's happening...
frank....@gmail.com
Mar 23, 2023, 7:37:44 AM3/23/23
to archivematica
Thanks for your reply, Joseph.
We checked the directory (and everything under /var/archivematica/...), and it's empty. So the problem has to originate somewhere else. We looked for the uuid and filename of all three packages.
Maybe another forum member have an idea?
frank....@gmail.com
Mar 31, 2023, 6:18:33 AM3/31/23
to archivematica
As a test, we tried to add another package, after yet another reboot, and after cleaning out everything under watchedDirectories and the looping packages in CurrentlyProcessing. Now we have 4 packages running in a loop in MySql.
Anyone have a suggestion as to how we can make the database behave?
Joseph Anderson
Mar 31, 2023, 9:29:49 AM3/31/23
to archivematica
The other idea I had was this: https://www.archivematica.org/en/docs/archivematica-1.13/admin-manual/maintenance/maintenance/#how-to-clear-the-application-database
You have to be careful in using this because if you run it without the appropriate flags it will clear out the search index, so make sure you read the help first. But basically this will clear out all records in your application database. The thing about the archivematica is that even if you delete a transfer or ingest from the the dashboard it still keeps a record of it in the application database indefinitely unless you use this to clear them out. This may clear out your problematic transfers?? Also, by default it will only clear things out older than 6 hours so you may need to change that as well because your transfer are constantly running. Maybe back up your database before giving it a try.
Arif Shaon
Mar 31, 2023, 10:22:09 AM3/31/23
to archiv...@googlegroups.com
Hi Frank,
Have you tried Ross Spencer's suggestion from this 2021 thread - https://groups.google.com/g/archivematica/c/DfbNIei3GIE/m/0u6FxVdVAAAJ?pli=1?
Here is a snippet of what he suggested as a way to clear any remnants from the database:
SET FOREIGN_KEY_CHECKS=0;
truncate table Derivations;
truncate table Events_agents;
truncate table Events;
truncate table FilesIdentifiedIDs;
truncate table FilesIDs;
truncate table Files;
truncate table Jobs;
truncate table main_fpcommandoutput;
truncate table SIPs;
truncate table Tasks;
truncate table Transfers;
truncate table UnitVariables;
SET FOREIGN_KEY_CHECKS=1;
truncate table Derivations;
truncate table Events_agents;
truncate table Events;
truncate table FilesIdentifiedIDs;
truncate table FilesIDs;
truncate table Files;
truncate table Jobs;
truncate table main_fpcommandoutput;
truncate table SIPs;
truncate table Tasks;
truncate table Transfers;
truncate table UnitVariables;
SET FOREIGN_KEY_CHECKS=1;
Hope this helps.
Best
Arif
--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/2ea8b56c-36ba-4890-9780-ba28f2248d99n%40googlegroups.com.
Message has been deleted
Message has been deleted
Message has been deleted
Joseph Anderson
Apr 11, 2023, 9:36:04 AM4/11/23
to archiv...@googlegroups.com
Awesome!
I wish it were something that was built into the everyday workings of the application itself, but we're thinking it's probably a good idea to set it up as a monthly cron job.
Hi, and sorry for the late reply. I've been on holiday.Thanks to Joseph and Arif for their useful suggestions. I recall the issue from 2021, but i Ifailed to realise it was valid again. But a colleague of mine tried it, and it worked like a charm. The database is now back to normal. I guess this should be a default routine from now on when we have database problems. Again thank you all for your help :)Frank
You received this message because you are subscribed to a topic in the Google Groups "archivematica" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/archivematica/Ge4OKYMjADs/unsubscribe.
To unsubscribe from this group and all its topics, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/29d3a2e2-5e85-4bf4-ada9-c5c98c766b2en%40googlegroups.com.
Joseph Anderson (he, him, his)
Digital Initiatives Librarian | Assistant Professor
Gladys Marcus Library | Fashion Institute of Technology
Seventh Avenue at 27th Street, Room E619
New York, New York 10001
Reply all
Reply to author
Forward
0 new messages