Transfer source not displaying

McGranahan, Jamen (VU)

unread,

May 16, 2022, 11:27:16 AM5/16/22

to archiv...@googlegroups.com

For some reason, our Transfer source is not displaying within the Archivematica dashboard. Instead of seeing a list of folders like we normally would, all we get is “Default transfer source”, with nothing underneath:

In the /var/log/Archivematica/dashboard logs, I am seeing the following errors:

ERROR 2022-05-16 15:21:00 django.request:exception:handle_uncaught_exception:135: Internal Server Error: /filesystem/children/location/b2919f5a-7a17-4356-afda-2c0d986b088e/

Traceback (most recent call last):

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/connectionpool.py", line 445, in _make_request

six.raise_from(e, None)

File "<string>", line 3, in raise_from

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request

httplib_response = conn.getresponse()

File "/usr/lib64/python3.6/http/client.py", line 1346, in getresponse

response.begin()

File "/usr/lib64/python3.6/http/client.py", line 307, in begin

version, status, reason = self._read_status()

File "/usr/lib64/python3.6/http/client.py", line 268, in _read_status

line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")

File "/usr/lib64/python3.6/socket.py", line 586, in readinto

return self._sock.recv_into(b)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/gevent/_socket3.py", line 433, in recv_into

self._wait(self._read_event)

File "src/gevent/_hub_primitives.py", line 265, in gevent.__hub_primitives.wait_on_socket

File "src/gevent/_hub_primitives.py", line 266, in gevent.__hub_primitives.wait_on_socket

File "src/gevent/_hub_primitives.py", line 261, in gevent.__hub_primitives._primitive_wait

File "src/gevent/_hub_primitives.py", line 262, in gevent.__hub_primitives._primitive_wait

File "src/gevent/_hub_primitives.py", line 46, in gevent.__hub_primitives.WaitOperationsGreenlet.wait

File "src/gevent/_hub_primitives.py", line 55, in gevent.__hub_primitives.WaitOperationsGreenlet.wait

File "src/gevent/_waiter.py", line 151, in gevent.__waiter.Waiter.get

File "src/gevent/_greenlet_primitives.py", line 59, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch

File "src/gevent/_greenlet_primitives.py", line 63, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch

File "src/gevent/__greenlet_primitives.pxd", line 35, in gevent.__greenlet_primitives._greenlet_switch

socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/requests/adapters.py", line 449, in send

timeout=timeout

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/connectionpool.py", line 756, in urlopen

method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/util/retry.py", line 532, in increment

raise six.reraise(type(error), error, _stacktrace)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/packages/six.py", line 770, in reraise

raise value

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen

chunked=chunked,

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/connectionpool.py", line 447, in _make_request

self._raise_timeout(err=e, url=url, timeout_value=read_timeout)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/urllib3/connectionpool.py", line 337, in _raise_timeout

self, url, "Read timed out. (read timeout=%s)" % timeout_value

urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='storage.library.vanderbilt.edu', port=80): Read timed out. (read timeout=5.0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/django/core/handlers/exception.py", line 41, in inner

response = get_response(request)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/django/core/handlers/base.py", line 187, in _get_response

response = self.process_exception_by_middleware(e, request)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/django/core/handlers/base.py", line 185, in _get_response

response = wrapped_callback(request, *callback_args, **callback_kwargs)

File "/usr/share/archivematica/dashboard/components/filesystem_ajax/views.py", line 125, in directory_children_proxy_to_storage_server

response = storage_service.browse_location(location_uuid, path)

File "/usr/lib/archivematica/archivematicaCommon/storageService.py", line 275, in browse_location

response = _storage_api_session().get(url, params=params)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/requests/sessions.py", line 555, in get

return self.request('GET', url, **kwargs)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/requests/sessions.py", line 542, in request

resp = self.send(prep, **send_kwargs)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/requests/sessions.py", line 655, in send

r = adapter.send(request, **kwargs)

File "/usr/lib/archivematica/archivematicaCommon/storageService.py", line 75, in send

return super(HTTPAdapterWithTimeout, self).send(*args, **kwargs)

File "/usr/share/archivematica/virtualenvs/archivematica/lib/python3.6/site-packages/requests/adapters.py", line 529, in send

raise ReadTimeout(e, request=request)

requests.exceptions.ReadTimeout: HTTPConnectionPool(host='storage.library.vanderbilt.edu', port=80): Read timed out. (read timeout=5.0)

It would appear that our Archivematica server is unable to communicate with our Storage server, but I have no idea why. Telnet works fine, so I know it’s not a firewall issue:

[root@libvm01 dashboard]# telnet storage.library.vanderbilt.edu 80

Trying 10.1.208.25...

Connected to storage.library.vanderbilt.edu.

Escape character is '^]'.

^]

telnet> quit

Connection closed.

And on our storage server, I see the following (which may be a separate issue – I don’t know for sure):

INFO 2022-05-16 08:17:40 locations.models.space:space:browse:275: path: /apps/Archivematica_tmp

DEBUG 2022-05-16 08:17:40 locations.models.space:space:browse:279: AttributeError while browsing /apps/Archivematica_tmp: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)

DEBUG 2022-05-16 08:17:40 locations.models.space:space:browse:280: Falling back to default browse local

[root@libvm05 storage-service]#

Vanderbilt

Jamen McGranahan
Associate Director of Library Technology & Digital Services, Vanderbilt Library
Vanderbilt University
615.343.1614 | jamen.mc...@vanderbilt.edu | https://www.library.vanderbilt.edu/

Central Library, 419 21st Avenue South
Nashville, TN 37203

Pronouns: he/him/his

Tim Schofield

unread,

May 19, 2022, 8:45:20 AM5/19/22

to archivematica

Try this

Go into general settings Administration > General and see if Archivematica complains about not being able to communicate with the server.

1. Check that the URLs for Archivematica and the Storage Service are correct

2. Check that the Storage Service API key is correct

McGranahan, Jamen (VU)

unread,

May 19, 2022, 9:33:39 AM5/19/22

to archiv...@googlegroups.com

Thanks for the suggestions, Tim. Unfortunately, I did all of that – even re-entered the API key to be sure I wasn’t going bonkers. When I first launch Archivematica via browser and go to Administration -> General, it does give me this:

Storage Service inaccessible. Please contact an administrator or update the Storage Sevice URL below.

HTTPConnectionPool(host='storage.library.vanderbilt.edu', port=80): Read timed out. (read timeout=5.0)

But I don’t know why because it can access the other server. And then the error goes away for a while; then returns. I really need to get this fixed. Ideas? Suggestions?

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/07582285-49b3-4a86-a4b1-fd8cae9bb9c1n%40googlegroups.com.

Murilo Souza

unread,

Aug 24, 2022, 1:42:34 PM8/24/22

to archivematica

Hi Jamen,

Hope you have resolved the issue.
The same thing happened with me when I edited the username registered in the Storage Service whose API Key is used in the pipeline. Just correct.
In Archivematica Dashboard > Administration > General > Storage Service User