Re: [archivematica] AIP Failure 500 Error

67 views
Skip to first unread message

Plaistowe, Sean

unread,
Nov 18, 2022, 12:45:48 PM11/18/22
to archivematica

Sorry I forgot to add its a manual install of Ubuntu 18.04 server inside a virtual box, hosted on a Linux Mint system (essentially Ubuntu 22.04 without snaps). Also tried searching the github issues and wasn't able to find anything closely related.


Also despite the browse errors at the start of the log, I was able to open directories and see the files within them in the transfer tab. I know that error has shown up as in issue around symbolic links for others where items are not showing up in transfer drop down. I'm not using any links, but just trying to transfer to from mounted file systems not sure if the issues could be related, but wanted to flag that.



Thanks again and have a great day!



From: archiv...@googlegroups.com <archiv...@googlegroups.com> on behalf of Sean Plaistowe <plai...@bostonchildrensmuseum.org>
Sent: Tuesday, November 15, 2022 4:40:45 PM
To: archivematica
Subject: [archivematica] AIP Failure 500 Error
 

CAUTION: This email originated from outside Boston Children's Museum. Do not click links, open, or download attachments unless you recognize the sender and know the content is safe.

Hello folks really hope someone has a solution on this one because I'm stumped. I'm running a manual install  inside a VirtualBox. I keep running into failures trying to store  AIPs. DIPs were originally failing in the same way but are now completing after changing permissions however can't be downloaded from the storage service (but not my main concern at the moment).

My instance of archivematica instance is was manually installed on a VirtualBox, the only issue I had was that the storage service was not running on my first attempt I managed to find this post: https://groups.google.com/g/archivematica/c/qYwtqu1rK14/m/DJcHC36tAAAJ which seemed to mirror the issue I was having so I manually installed mysql and libmysqlclient-dev before installing storage-service. 

In searching around this google group, I managed to figure out that part of the problem was around permissions so I updated the mount options I was using for the Vboxfs shared folder I was trying to import and export to (but have now tried using default storage locations and importing directories created inside the Virtualbox with the same results). I used the mount options provided here: https://groups.google.com/g/archivematica/c/2jJRb3CkDwE/m/LvPey45kOGcJ
with little change in the error log for AIPs but DIPs started storing around that time. 



I've included the failure report info from the dashboard and storage service debug log below. Happy to provide more as needed. Sorry if I'm missing something obvious but tried to search through the group and user manual with no luck so far. Thanks for any help and have a great day!

Module storeAIP_v0.0

"/api/v2/location/3c4123c7-bcb3-43dc-bfce-d6aef4899e84/" "/var/archivematica/sharedDirectory/currentlyProcessing/005-ca87fa87-9ffb-4fa7-95ce-57d823ed3004/005-ca87fa87-9ffb-4fa7-95ce-57d823ed3004.7z" "ca87fa87-9ffb-4fa7-95ce-57d823ed3004" "005" "SIP"


Errors and diagnostics (stderr)

500 Server Error: Internal Server Error for url: http://127.0.0.1:8000/api/v2/file/Traceback (most recent call last):
  File "/usr/lib/archivematica/MCPClient/job.py", line 113, in JobContext
    yield
  File "/usr/lib/archivematica/MCPClient/clientScripts/store_aip.py", line 369, in call
    args.sip_type,
  File "/usr/lib/archivematica/MCPClient/clientScripts/store_aip.py", line 244, in store_aip
    related_package_uuid,
  File "/usr/lib/archivematica/MCPClient/clientScripts/store_aip.py", line 80, in _create_file
    agents=get_agents_from_db(uuid),
  File "/usr/lib/archivematica/archivematicaCommon/storageService.py", line 415, in create_file
    response.raise_for_status()
  File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://127.0.0.1:8000/api/v2/file/



/var/log/archivematica/storage-service/storage_service_debug.log

`INFO      2022-11-15 10:27:41  common.startup:startup:startup:17:  Running startup
INFO      2022-11-15 11:42:15  locations.models.space:space:browse:275:  path: /home
DEBUG     2022-11-15 11:42:16  locations.models.space:space:browse:279:  AttributeError while browsing /home: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
DEBUG     2022-11-15 11:42:16  locations.models.space:space:browse:280:  Falling back to default browse local
INFO      2022-11-15 11:42:51  locations.models.space:space:browse:275:  path: /home/bcma
DEBUG     2022-11-15 11:42:51  locations.models.space:space:browse:279:  AttributeError while browsing /home/bcma: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
DEBUG     2022-11-15 11:42:51  locations.models.space:space:browse:280:  Falling back to default browse local
INFO      2022-11-15 11:42:54  locations.models.space:space:browse:275:  path: /home/bcma/transfer_source
DEBUG     2022-11-15 11:42:54  locations.models.space:space:browse:279:  AttributeError while browsing /home/bcma/transfer_source: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
DEBUG     2022-11-15 11:42:54  locations.models.space:space:browse:280:  Falling back to default browse local
INFO      2022-11-15 11:42:57  locations.models.space:space:browse:275:  path: /home/bcma/ext-storage
DEBUG     2022-11-15 11:42:57  locations.models.space:space:browse:279:  AttributeError while browsing /home/bcma/ext-storage: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
DEBUG     2022-11-15 11:42:57  locations.models.space:space:browse:280:  Falling back to default browse local
INFO      2022-11-15 11:43:11  locations.models.space:space:browse:275:  path: /home/bcma/ext-storage/archivematica
DEBUG     2022-11-15 11:43:11  locations.models.space:space:browse:279:  AttributeError while browsing /home/bcma/ext-storage/archivematica: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
DEBUG     2022-11-15 11:43:11  locations.models.space:space:browse:280:  Falling back to default browse local
INFO      2022-11-15 11:45:35  locations.models.space:space:browse:275:  path: /home/bcma/ext-storage/archivematica
DEBUG     2022-11-15 11:45:35  locations.models.space:space:browse:279:  AttributeError while browsing /home/bcma/ext-storage/archivematica: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
DEBUG     2022-11-15 11:45:35  locations.models.space:space:browse:280:  Falling back to default browse local
DEBUG     2022-11-15 11:45:50  locations.api.resources:resources:_move_files_between_locations:554:  Moving files from this location is not allowed
DEBUG     2022-11-15 11:45:50  locations.models.space:space:move_to_storage_service:346:  TO: src: home/bcma/ext-storage/archivematica/BCM Charter Scans/.
DEBUG     2022-11-15 11:45:50  locations.models.space:space:move_to_storage_service:347:  TO: dst: /var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/.
DEBUG     2022-11-15 11:45:50  locations.models.space:space:move_to_storage_service:348:  TO: staging: /var/archivematica/storage_service
INFO      2022-11-15 11:45:50  locations.models.space:space:move_rsync:552:  Moving from /home/bcma/ext-storage/archivematica/BCM Charter Scans/. to /var/archivematica/storage_service/var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/.
INFO      2022-11-15 11:45:50  locations.models.space:space:move_rsync:594:  rsync command: ['rsync', '-t', '-O', '--protect-args', '-vv', '--chmod=Fug+rw,o-rwx,Dug+rwx,o-rwx', '-r', '/home/bcma/ext-storage/archivematica/BCM Charter Scans/.', '/var/archivematica/storage_service/var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/.']
DEBUG     2022-11-15 11:45:50  locations.models.space:space:move_from_storage_service:423:  FROM: src: /var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/.
DEBUG     2022-11-15 11:45:50  locations.models.space:space:move_from_storage_service:424:  FROM: dst: /var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/.
INFO      2022-11-15 11:45:50  locations.models.space:space:move_rsync:552:  Moving from /var/archivematica/storage_service/var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/./ to /var/archivematica/sharedDirectory/tmp/tmp6rrzenaq/006/.
DEBUG     2022-11-15 11:45:50  locations.models.space:space:move_rsync:566:  os.rename failed, trying with normalized paths
DEBUG     2022-11-15 11:46:48  locations.api.resources:resources:hydrate_current_location:1023:  `current_location` was not matched by `default_location_regex`
INFO      2022-11-15 11:46:48  locations.models.package:package:store_aip:842:  store_aip called in Package class of SS
INFO      2022-11-15 11:46:48  locations.models.package:package:store_aip:843:  store_aip got origin_path watchedDirectories/uploadDIP/006-c12ad0ce-49ea-499d-a759-f1f123a17f39/
DEBUG     2022-11-15 11:46:48  common.utils:utils:uuid_to_path:656:  path 9ef7/1455/e314/4d6c/bf0b/c070/7c2c/f241
INFO      2022-11-15 11:46:48  locations.models.package:package:should_have_pointer_file:799:  Package should not have a pointer file because /var/archivematica/sharedDirectory/watchedDirectories/uploadDIP/006-c12ad0ce-49ea-499d-a759-f1f123a17f39/ is not a file
INFO      2022-11-15 11:46:48  locations.models.package:package:should_have_pointer_file:805:  Package should not have a pointer file because it is not an AIP or an AIC; it is a(n) DIP
DEBUG     2022-11-15 11:46:49  locations.models.space:space:posix_move:318:  posix_move: source_path: var/archivematica/sharedDirectory/watchedDirectories/uploadDIP/006-c12ad0ce-49ea-499d-a759-f1f123a17f39/
DEBUG     2022-11-15 11:46:49  locations.models.space:space:posix_move:319:  posix_move: destination_path: bcma/ext-storage/archivematica/storage/dip/9ef7/1455/e314/4d6c/bf0b/c070/7c2c/f241/006-c12ad0ce-49ea-499d-a759-f1f123a17f39
DEBUG     2022-11-15 11:46:49  locations.models.space:space:posix_move:320:  posix_move: destination_space.path: /home/
INFO      2022-11-15 11:46:49  locations.models.space:space:move_rsync:552:  Moving from /var/archivematica/sharedDirectory/watchedDirectories/uploadDIP/006-c12ad0ce-49ea-499d-a759-f1f123a17f39/ to /home/bcma/ext-storage/archivematica/storage/dip/9ef7/1455/e314/4d6c/bf0b/c070/7c2c/f241/006-c12ad0ce-49ea-499d-a759-f1f123a17f39
DEBUG     2022-11-15 11:46:49  locations.models.space:space:move_rsync:566:  os.rename failed, trying with normalized paths
DEBUG     2022-11-15 11:46:49  locations.models.space:space:move_rsync:578:  os.rename failed, falling back to rsync. Source: /var/archivematica/sharedDirectory/watchedDirectories/uploadDIP/006-c12ad0ce-49ea-499d-a759-f1f123a17f39; Destination: /home/bcma/ext-storage/archivematica/storage/dip/9ef7/1455/e314/4d6c/bf0b/c070/7c2c/f241/006-c12ad0ce-49ea-499d-a759-f1f123a17f39
INFO      2022-11-15 11:46:49  locations.models.space:space:move_rsync:594:  rsync command: ['rsync', '-t', '-O', '--protect-args', '-vv', '--chmod=Fug+rw,o-rwx,Dug+rwx,o-rwx', '-r', '/var/archivematica/sharedDirectory/watchedDirectories/uploadDIP/006-c12ad0ce-49ea-499d-a759-f1f123a17f39/', '/home/bcma/ext-storage/archivematica/storage/dip/9ef7/1455/e314/4d6c/bf0b/c070/7c2c/f241/006-c12ad0ce-49ea-499d-a759-f1f123a17f39']
DEBUG     2022-11-15 11:46:51  locations.api.resources:resources:hydrate_current_location:1023:  `current_location` was not matched by `default_location_regex`
INFO      2022-11-15 11:46:51  locations.models.package:package:store_aip:842:  store_aip called in Package class of SS
INFO      2022-11-15 11:46:51  locations.models.package:package:store_aip:843:  store_aip got origin_path currentlyProcessing/006-c12ad0ce-49ea-499d-a759-f1f123a17f39/006-c12ad0ce-49ea-499d-a759-f1f123a17f39.7z
DEBUG     2022-11-15 11:46:51  common.utils:utils:uuid_to_path:656:  path c12a/d0ce/49ea/499d/a759/f1f1/23a1/7f39
ERROR     2022-11-15 11:46:51  django.request.tastypie:resources:_handle_500:321:  Internal Server Error: /api/v2/file/
Traceback (most recent call last):
  File "/usr/share/archivematica/virtualenvs/archivematica-storage-service/lib/python3.6/site-packages/tastypie/resources.py", line 227, in wrapper
    response = callback(request, *args, **kwargs)
  File "/usr/share/archivematica/virtualenvs/archivematica-storage-service/lib/python3.6/site-packages/tastypie/resources.py", line 467, in dispatch_list
    return self.dispatch('list', request, **kwargs)
  File "/usr/share/archivematica/virtualenvs/archivematica-storage-service/lib/python3.6/site-packages/tastypie/resources.py", line 499, in dispatch
    response = method(request, **kwargs)
  File "/usr/share/archivematica/virtualenvs/archivematica-storage-service/lib/python3.6/site-packages/tastypie/resources.py", line 1408, in post_list
    updated_bundle = self.obj_create(bundle, **self.remove_api_resource_names(kwargs))
  File "/usr/lib/archivematica/storage-service/locations/api/resources.py", line 1140, in obj_create
    self._store_bundle(bundle)
  File "/usr/lib/archivematica/storage-service/locations/api/resources.py", line 1075, in _store_bundle
    aip_subtype=aip_subtype,
  File "/usr/lib/archivematica/storage-service/locations/models/package.py", line 844, in store_aip
    v = self._store_aip_to_pending(origin_location, origin_path)
  File "/usr/lib/archivematica/storage-service/locations/models/package.py", line 911, in _store_aip_to_pending
    purpose=Location.STORAGE_SERVICE_INTERNAL
  File "/usr/share/archivematica/virtualenvs/archivematica-storage-service/lib/python3.6/site-packages/django/db/models/manager.py", line 85, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
  File "/usr/share/archivematica/virtualenvs/archivematica-storage-service/lib/python3.6/site-packages/django/db/models/query.py", line 384, in get
    (self.model._meta.object_name, num)
locations.models.location.MultipleObjectsReturned: get() returned more than one Location -- it returned 2!
DEBUG     2022-11-15 11:46:52  locations.api.resources:resources:hydrate_current_location:1023:  `current_location` was not matched by `default_location_regex``


--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/d90474d5-6a5b-4b77-9a7e-b7b1fd10338en%40googlegroups.com.


This email was scanned by Bitdefender
Reply all
Reply to author
Forward
0 new messages