new install

[jmcgr...@gmail.com]

First, my apologies for bombarding this list with emails. But I have been able to install Archivematica on 2 CentOS 7 virtual servers. I have the Storage Service running on one server and the Archivematica application running on another server. I've been testing the Transfer and I'm not getting anywhere. The application acts like it wants to process the files, but it never does and the /var/log/archivematica logs are showing MCP errors:

MCPServer/MCPServer.debug.log:ERROR     2020-12-08 21:14:08  archivematica.mcp.server.packages:packages:wrap:389:  Exception occurred during transfer processing
MCPServer/MCPServer.debug.log:Exception: The following errors occurred: 500 Server Error: Internal Server Error for url: http://archivematica-storage.library.vanderbilt.edu/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/
MCPServer/MCPServer.debug.log:WARNING   2020-12-08 21:27:02  archivematica.common:storageService:copy_files:322:  Unable to move files with {'files': [{u'source': u'RG515_A2020-11-20/Alumni Newsletters-selected/newsletters.zip', u'destination': u'/var/archivematica/sharedDirectory/tmp/tmp7F1T3R/newsletters.zip'}], 'pipeline': u'/api/v2/pipeline/5a1b92f3-f92a-4975-9bd4-bc4c515d4d11/', 'origin_location': u'/api/v2/location/0b6835bc-876c-41be-812f-f070e2980109/'} because 500 Server Error: Internal Server Error for url: http://archivematica-storage.library.vanderbilt.edu/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/
MCPServer/MCPServer.debug.log:ERROR     2020-12-08 21:27:02  archivematica.mcp.server.packages:packages:wrap:389:  Exception occurred during transfer processing
MCPServer/MCPServer.debug.log:Exception: The following errors occurred: 500 Server Error: Internal Server Error for url: http://archivematica-storage.library.vanderbilt.edu/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/
MCPServer/MCPServer.debug.log:WARNING   2020-12-08 21:36:34  archivematica.common:storageService:copy_files:322:  Unable to move files with {'files': [{u'source': u'RG515_A2020-11-20/Alumni Newsletters-selected/newsletters.zip', u'destination': u'/var/archivematica/sharedDirectory/tmp/tmpAa8HMZ/newsletters.zip'}], 'pipeline': u'/api/v2/pipeline/5a1b92f3-f92a-4975-9bd4-bc4c515d4d11/', 'origin_location': u'/api/v2/location/0b6835bc-876c-41be-812f-f070e2980109/'} because 500 Server Error: Internal Server Error for url: http://archivematica-storage.library.vanderbilt.edu/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/
MCPServer/MCPServer.debug.log:ERROR     2020-12-08 21:36:34  archivematica.mcp.server.packages:packages:wrap:389:  Exception occurred during transfer processing
MCPServer/MCPServer.debug.log:Exception: The following errors occurred: 500 Server Error: Internal Server Error for url: http://archivematica-storage.library.vanderbilt.edu/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/

The strange thing is, I can access http://archivematica-storage.library.vanderbilt.edu/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/ without a problem, getting some XML code:

<?xml version='1.0' encoding='utf-8'?>
<object>
    <description type="null"/>
    <enabled type="boolean">True</enabled>
    <path>/var/archivematica/sharedDirectory</path>
    <pipeline type="list">
        <value>/api/v2/pipeline/5a1b92f3-f92a-4975-9bd4-bc4c515d4d11/</value>
    </pipeline>
    <purpose>CP</purpose>
    <quota type="null"/>
    <relative_path>var/archivematica/sharedDirectory/</relative_path>
    <resource_uri>/api/v2/location/f5875bf4-f0fb-40c1-8c65-6f109eba5bdf/</resource_uri>
    <space>/api/v2/space/e9d51e1d-acbf-4c3b-9699-3db9cb0502d2/</space>
    <used type="integer">0</used>
    <uuid>f5875bf4-f0fb-40c1-8c65-6f109eba5bdf</uuid>
</object>

AND, though it complains " Unable to move files with", the file is actually in that directory that it said it couldn't move to. So I'm really confused - again. Please help. Thank you.

[Ross Spencer]

Hi Jamen! 

No need to apologize. It's really valuable that you are sharing this stuff. 

I haven't an immediate instinct here, that XML object is helpful. It looks the same as mine, so it looks configured okay taking a first look.

<object>

    <description type="null"/>

    <enabled type="boolean">True</enabled>

    <path>/var/archivematica/sharedDirectory</path>

    <pipeline type="list">

    <value>/api/v2/pipeline/7aeb3632-c4e6-41dd-b590-5c5e8cab2b13/</value>

    </pipeline>

    <purpose>CP</purpose>

    <quota type="null"/>

    <relative_path>var/archivematica/sharedDirectory/</relative_path>

    <resource_uri>/api/v2/location/87dfaa2e-9d3b-43bc-bf38-5721a2dd4324/</resource_uri>

    <space>/api/v2/space/1ef4f166-ebf3-4494-9631-1aa9fcb44e79/</space>

    <used type="integer">0</used>

    <uuid>87dfaa2e-9d3b-43bc-bf38-5721a2dd4324</uuid>

</object>

To complement the error logging that you've provided are you seeing anything that looks like a more obvious error in: /var/log/archivematica/storage-service/storage_service.log

Ross

[Jamen McGranahan]

Ross - well, that did identify an issue. Since the Storage Service is on a different server than the Archivematica service, it didn't create the /var/archivematica/sharedDirectory. I just now did that, hoping it would solve my issue, but even though that error is gone, I have a different error message showing up on the Storage Service:

storage-service/storage_service_debug.log:DEBUG     2020-12-09 10:45:56  locations.models.space:space:browse:277:  AttributeError while browsing /apps/Transfer_Source: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
storage-service/storage_service_debug.log:DEBUG     2020-12-09 10:46:12  locations.models.space:space:browse:277:  AttributeError while browsing /apps/Transfer_Source/RG515_A2020-11-20: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
storage-service/storage_service_debug.log:DEBUG     2020-12-09 10:46:13  locations.models.space:space:browse:277:  AttributeError while browsing /apps/Transfer_Source/RG515_A2020-11-20/Alumni Newsletters-selected: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)

I'm not sure what "LocalFilesystem object has no attribute brows" means. Ideas?

--Jamen

--
You received this message because you are subscribed to a topic in the Google Groups "archivematica" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/archivematica/s9WwiAbrPX0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/bb1aed19-5b0e-47f8-b89b-6b76d81c55f6n%40googlegroups.com.

--

Jamen

[Ross Spencer]

Thanks Jamen. I haven't as much experience setting up a transfer folder from a different storage service it might mean they can't yet communicate with each other? But maybe one of our other team colleagues on the team can confirm that if they see this? I might also have a look at the transfer folder permissions, some of the requirements for that are discussed here: https://www.archivematica.org/en/docs/archivematica-1.12/user-manual/transfer/transfer/#transfer-permissions maybe have a quick look at those and let us know?

Ross

[Jamen McGranahan]

Ross - unfortunately, still no luck. I made sure all of my permissions are set to owner/group archivematica. I even uninstall the Storage Service and reinstalled it since someone had a similar issue back in 2015 (https://groups.google.com/g/archivematica/c/m3AFlCdzj5U/m/DnJ2e20PBQAJ), but I am still getting that same error message on the storage service:

storage-service/storage_service_debug.log:DEBUG     2020-12-09 12:40:21  locations.models.space:space:browse:277:  AttributeError while browsing /apps/Transfer_Source: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
storage-service/storage_service_debug.log:DEBUG     2020-12-09 12:40:30  locations.models.space:space:browse:277:  AttributeError while browsing /apps/Transfer_Source/RG515_A2020-11-20: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)
storage-service/storage_service_debug.log:DEBUG     2020-12-09 12:40:31  locations.models.space:space:browse:277:  AttributeError while browsing /apps/Transfer_Source/RG515_A2020-11-20/Alumni Newsletters-selected: AttributeError("'LocalFilesystem' object has no attribute 'browse'",)

To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/21fd4b43-cc0d-43ca-9863-ac1b8805f631n%40googlegroups.com.

--

Jamen

[Sean Kalynuk]

I might be totally off base here, but if your pipeline and storage service are on different servers, do you not require a “Pipeline Local Filesystem” instead of a “Local Filesystem”? “Local Filesystem” would work if using an NFS mount at the same point on both servers, but I don’t know if that’s how your system is configured.

 

--

Sean

 

From: archiv...@googlegroups.com <archiv...@googlegroups.com>
Date: Wednesday, December 9, 2020 at 2:44 PM
To: archiv...@googlegroups.com <archiv...@googlegroups.com>
Subject: Re: [archivematica] Re: new install

Caution: This message was sent from outside the University of Manitoba.

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/CAE9VS3nAgTY9OMwAdcehjX%2BJQEXHhO33%2Bt0okf%3DYiQv_cnFNZw%40mail.gmail.com.

[Jamen McGranahan]

That might be it - I'm going to test it out this evening and see if that works. Thanks for the suggestion.

--Jamen

To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/YTXPR0101MB0848FEF2359C28C8CAAF91B1E8CC0%40YTXPR0101MB0848.CANPRD01.PROD.OUTLOOK.COM.

--

Jamen

[jmcgr...@gmail.com]

Is there documentation on setting this up properly?

Pipeline Local Filesystem

I've got the passwordless SSH access set between the two servers, but not sure what to use in the configuration on the Storage Service for the "Pipeline Local Filesystem". The only documentation I have found just describes it but not how to set it up correctly.

[Sean Kalynuk]

Someone posted this link just recently (although I don’t have the link to the original discussion thread):

 

“Pipeline local FS space configuration”

 

https://docs.google.com/document/d/11TG4T9jM8R5w5PdtuTAGbnk22rgIseNGVTMguWrw8CA/edit

To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/b712587d-852d-44b5-a0b6-13c17c37e1d8n%40googlegroups.com.

[Jamen McGranahan]

Just to let others know, I never was able to get this to work correctly. I eventually nuked the whole thing and now am just using one server for both Archivematica and the Storage Service. To me, that is not ideal, but I couldn't waste any more time trying to get it to work on 2 servers. It would seem it would be simple to do, but alas, it wasn't - at least not for me. But at least I am running the most current version now.

To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/YTXPR0101MB0848969BF54FF59F7B334204E8CB0%40YTXPR0101MB0848.CANPRD01.PROD.OUTLOOK.COM.

--

Jamen

[Ross Spencer]

Thanks for the info Jamen, and Sean, thank you as always for your responses!

Sorry it didn't work this time Jamen. It should be possible to reconfigure in future if that remains in scope for you. I hope the workflow works smoothly for you and that your team now you're up and running. 

Best,

Ross

To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/CAE9VS3mFRr77w%3DPWvKkRT5zHspFC1TKYbsJHGibEq8X6A%2BmXMQ%40mail.gmail.com.

--

Ross Spencer

Software Developer, Artefactual Systems Inc.

www.artefactual.com

[Tatiana Canelhas]

Hi,

I managed to work with this configuration:

- One server with the whole archivematica application and 

- another server with the same installation, but, I disabled the storage service and pointed the dashboard of this server to the storage service of the server above.

What I am trying to do now is to install only dashboard, server and client in one server and the dashboard in another server. Is it possible? So I won't need to install and storage and have to disabled it.

Thanks,

Tatiana Canelhas

[Tatiana Canelhas]

Hi,

We are trying to install Archivematica with multiple pipelines in a docker environment.

Can anybody tell me if this is possible? How can we configure the volumes? What kind of protocols in Space do we have to use? Is it Pipeline Local FS (even for docker?)?

Thanks.