Still nothing, I'm afraid. It looks like the problem appears after the files have been successfully uploaded to the S3 buckets.
DEBUG 2020-12-22 04:52:53 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
INFO 2020-12-22 04:53:33 locations.models.package:package:replicate:582: Replicating package 287f6c30-1fdc-4d4a-8ab0-5e4b290565f9 (type is file: False), to replicator location 486a81dc-6209-420c-b560-428ac150d36c
DEBUG 2020-12-22 04:53:33 common.utils:utils:uuid_to_path:579: path 8fb8/1f43/169d/4999/ad12/b96d/0699/3297
DEBUG 2020-12-22 04:53:33 locations.models.space:space:move_to_storage_service:344: TO: src: aip-store/287f/6c30/1fdc/4d4a/8ab0/5e4b/2905/65f9/285-287f6c30-1fdc-4d4a-8ab0-5e4b290565f9/
DEBUG 2020-12-22 04:53:33 locations.models.space:space:move_to_storage_service:345: TO: dst: 8fb8/1f43/169d/4999/ad12/b96d/0699/3297/285-8fb81f43-169d-4999-ad12-b96d06993297
DEBUG 2020-12-22 04:53:33 locations.models.space:space:move_to_storage_service:346: TO: staging: /var/archivematica/storage_service
DEBUG 2020-12-22 04:53:33 locations.models.s3:s3:_ensure_bucket_exists:116: Test the S3 bucket 'nicollier' exists
DEBUG 2020-12-22 04:53:34 boto3.resources.factory:factory:load_from_definition:66: Loading s3:s3
DEBUG 2020-12-22 04:53:34 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
DEBUG 2020-12-22 04:53:34 locations.models.s3:s3:_ensure_bucket_exists:121: S3 bucket's response: {'LocationConstraint': None, 'ResponseMetadata': {'RetryAttempts': 0, 'HTTPStatusCode': 200, 'HTTPHeaders': {'content-length': '107', 'expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'server': 'HGST-HGST Active Archive System/42.4.0-97a930e7c3601ab1b966578481102c82967c0202', 'pragma': 'no-cache', 'cache-control': 'no-cache', 'date': 'Tue, 22 Dec 2020 12:53:34 GMT', 'content-type': 'application/xml'}}}
DEBUG 2020-12-22 04:53:34 boto3.resources.factory:factory:load_from_definition:66: Loading s3:Bucket
DEBUG 2020-12-22 04:53:34 boto3.resources.model:model:_load_name_with_category:358: Renaming Bucket attribute name
DEBUG 2020-12-22 04:53:34 boto3.resources.factory:factory:load_from_definition:66: Loading s3:Bucket
DEBUG 2020-12-22 04:53:34 boto3.resources.model:model:_load_name_with_category:358: Renaming Bucket attribute name
DEBUG 2020-12-22 04:53:34 boto3.resources.collection:collection:pages:152: Calling paginated s3:list_objects with {'Prefix': u'aip-store/287f/6c30/1fdc/4d4a/8ab0/5e4b/2905/65f9/285-287f6c30-1fdc-4d4a-8ab0-5e4b290565f9/', u'Bucket': u'nicollier'}
DEBUG 2020-12-22 04:53:34 boto3.resources.factory:factory:load_from_definition:66: Loading s3:ObjectSummary
DEBUG 2020-12-22 04:53:34 boto3.resources.model:model:_load_name_with_category:358: Renaming ObjectSummary attribute key
DEBUG 2020-12-22 04:53:39 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
Mirror bucket:
DEBUG 2020-12-22 07:46:00 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
INFO 2020-12-22 07:46:01 locations.models.package:package:should_have_pointer_file:752: Package should not have a pointer file because aip-store/287f/6c30/1fdc/4d4a/8ab0/5e4b/2905/65f9/285-287f6c30-1fdc-4d4a-8ab0-5e4b290565f9 is not a file
DEBUG 2020-12-22 07:46:01 locations.models.space:space:move_from_storage_service:421: FROM: src: 8fb8/1f43/169d/4999/ad12/b96d/0699/3297/285-8fb81f43-169d-4999-ad12-b96d06993297
DEBUG 2020-12-22 07:46:01 locations.models.space:space:move_from_storage_service:422: FROM: dst: aip-store/8fb8/1f43/169d/4999/ad12/b96d/0699/3297/285-8fb81f43-169d-4999-ad12-b96d06993297/
DEBUG 2020-12-22 07:46:01 locations.models.s3:s3:_ensure_bucket_exists:116: Test the S3 bucket 'nicollier-secondary' exists
DEBUG 2020-12-22 07:46:01 boto3.resources.factory:factory:load_from_definition:66: Loading s3:s3
DEBUG 2020-12-22 07:46:01 locations.models.s3:s3:_ensure_bucket_exists:121: S3 bucket's response: {'LocationConstraint': None, 'ResponseMetadata': {'RetryAttempts': 0, 'HTTPStatusCode': 200, 'HTTPHeaders': {'content-length': '107', 'expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'server': 'HGST-HGST Active Archive System/42.4.0-97a930e7c3601ab1b966578481102c82967c0202', 'pragma': 'no-cache', 'cache-control': 'no-cache', 'date': 'Tue, 22 Dec 2020 15:46:01 GMT', 'content-type': 'application/xml'}}}
DEBUG 2020-12-22 07:46:01 boto3.resources.factory:factory:load_from_definition:66: Loading s3:Bucket
DEBUG 2020-12-22 07:46:01 boto3.resources.model:model:_load_name_with_category:358: Renaming Bucket attribute name
DEBUG 2020-12-22 08:50:29 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
Another bit of log here:
DEBUG 2020-12-22 11:00:17 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
INFO 2020-12-22 11:01:04 locations.models.package:package:replicate:716: Finished replicating package 287f6c30-1fdc-4d4a-8ab0-5e4b290565f9 as replica package 8fb81f43-169d-4999-ad12-b96d06993297
DEBUG 2020-12-22 11:01:04 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
DEBUG 2020-12-22 11:01:07 locations.api.resources:resources:hydrate_current_location:945: `current_location` was not matched by `default_location_regex`
DEBUG 2020-12-22 11:01:09 locations.models.async_manager:async_manager:_watchdog_loop:123: Watchdog sees 0 tasks running
I don't see any error or anything suspicious after that.
Olivier