Issues Uploading DIPs from Archivematica to AtoM

[Felipe Melo]

Hello,

I am a student working on a digital preservation research project, and I am learning how to use Archivematica and AtoM. I am trying to upload DIPs (Digital Information Packages) from Archivematica to AtoM, but I am unable to complete the process correctly. I believe I might be doing something wrong in the configuration to address AtoM, or something may be missing.

I have already reviewed the configurations, but I am still facing difficulties. I have attached two screenshots that illustrate the issue. If anyone can help me identify what might be wrong or provide guidance on the correct configuration to upload DIPs, I would be very grateful.

Thank you in advance for your attention and assistance!

Best regards,
Felipe

[MATIN RAUF BIN RAMDZAN (ARKIB)]

Hello,

My name is Rauf and I am a student majoring in digitization. It is difficult to configure DIP Upload from Archivematica to AtoM but you should first make sure that SSH works on both servers. However, here is the URL address as an example and the process for DIP Upload to AtoM.

https://www.granthurley.ca/blog/running-and-integrating-archivematica-and-atom-with-vagrant/

https://wiki.archivematica.org/Upload_DIP

Hope to be able to help you.

Best regards,
Rauf

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/archivematica/137b87a1-ea43-4d4e-afbc-089b6c309d85n%40googlegroups.com.

Peringatan 

Pengguna Perkhidmatan MyGovUC adalah bertanggungjawab melindungi kerahsiaan data/maklumat Rahsia Rasmi Kerajaan. Adalah diingatkan agar pengguna sentiasa peka dengan SEMUA peraturan, arahan keselamatan dan pekeliling semasa yang berkuatkuasa bagi semua pengendalian data/maklumat Rahsia Rasmi Kerajaan yang berkaitan.

[Murilo Souza dos Santos]

Hi Felipe,

I think your problem is in the sword deposit configuration. AtoM no longer accepts receiving the DIP in the /tmp directory. Then you need to configure a suitable directory on the AtoM host and enter the correct directory for Archivematica. Also, don't forget to configure so that Archimetica can transfer to AtoM without a password. More information here:

https://www.accesstomemory.org/en/docs/2.8/user-manual/administer/settings/#sword-directory

https://www.archivematica.org/en/docs/archivematica-1.15/admin-manual/installation-setup/customization/dashboard-config/#admin-dashboard-atom

Cheers,

Murilo Souza

[Felipe Melo]

Hi Murilo,

Thanks again for your help! I followed your suggestions and changed the deposit directory to an appropriate location, replacing the old /tmp with /home/archivematica/atom_sword_deposit. The permissions have been configured correctly to ensure that AtoM can access and remove the files, but I am still facing issues with the DIP transfer.

As shown in the screenshots, the error indicates that when trying to process the DIP, the system cannot find the file in the configured directory (/home/archivematica/atom_sword_deposit/cartaMeta-642fd094-a406-4104-893b-96a41ac4b9b4). After processing is complete, the attempt to delete the file fails, causing the "File not found" error.

If you have any more suggestions or additional steps, I would appreciate your help.

Best regards,
Felipe

[Murilo Souza dos Santos]

Hi Felipe,

Can I see a screenshot of Archivematica > Administration > Atom/Binder? The rest seems properly configured, but not that.

If your sword deposit is /home/archivematica/atom_sword_deposit, rsync target must be ATOM-USERNAME@ATOM-IP:/home/archivematica/atom_sword_deposit. 

REST API key also needs to be filled in (with the key generated for the provided atom-username).

I hope it works, but if it doesn't, I'm still at your disposal.

Cheers,

Murilo.

:

[MATIN RAUF BIN RAMDZAN (ARKIB)]

Hi Felipe,

Please check your rsync from Archivematica to the deposit directory.

Best Regards,

Rauf

--

You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.

To view this discussion visit https://groups.google.com/d/msgid/archivematica/c7b5bc71-76c4-47ab-afaf-c74efc889e88n%40googlegroups.com.

[Felipe Melo]

Hi Murilo,

Thank you for your detailed guidance! Following your instructions, I reviewed the Archivematica Administration > AtoM/Binder settings and ensured that:

• The Rsync target was correctly set to felipe@atom-http://192.168.0.105 (as shown in the screenshot).
• The REST API key was filled with the key provided by AtoM (b7ded21480ced525).
• The destination directory matches /home/archivematica/atom_sword_deposit, as you recommended.

After uploading a DIP, I confirmed the successful integration with AtoM. The DIP was properly reflected in the hierarchy under "Cartas de JAA" in AtoM, as shown in the second screenshot.

Your suggestions resolved the issue completely, and I managed to transfer a DIP to AtoM without errors.

I do have one additional question: is it possible to import metadata into AtoM directly through Archivematica using a CSV file? I’ve formatted the CSV with the correct encoding and Dublin Core fields, but AtoM doesn’t recognize it when I try to import it directly. If this is feasible via Archivematica, is there a specific folder structure or naming convention I should follow when preparing a DIP with both files and metadata?

Thank you so much for your support—your guidance made a significant difference. Please let me know if I can provide more details or if you have any advice on this final question.

Best regards,
Felipe

[Murilo Souza dos Santos]

Hi Felipe,
I'm really glad you solved it.

Regarding your question: yes, it is possible! If the "Metadata-only DIP upload to AtoM" option didn't work, there are several other ways to do it.
What happens if you enter a different AtoM slug before starting the transfer ("Access system ID" field, in the Transfer tab)? Are objects and descriptive metadata indexed in the slug in AtoM? If so, it may be a problem with the "Metadata-only DIP upload to AtoM" functionality, which you used.

If it doesn't work, check if the descriptive metadata is in the AIP METS.xml file, for example:
          <dc:title>Morning view from lookout over Queenstown towards the Remarkables in spring</dc:title>
          <dc:creator>Pseudopanax at English Wikipedia</dc:creator>
          <dc:subject>The Remarkables</dc:subject>
          <dc:subject>Lake Wakatipu</dc:subject>
          <dc:publisher>Wikimedia Commons</dc:publisher>
          <dc:date>7 October 2014</dc:date>
          <dc:source>Wikimedia Commons</dc:source>
          <dc:coverage>Lake Wakatipu</dc:coverage>
          <dc:rights>Public domain</dc:rights>

If it isn't, your metadata.csv spreadsheet was probably not formatted properly. The instructions for this are here (https://www.archivematica.org/en/docs/archivematica-1.16/user-manual/transfer/import-metadata/), but if they are not enough, you can download test packages from the following link (https://github.com/artefactual/archivematica-sampledata) and adapt them according to your needs (the SampleTransfers/DemoTransferCSV package is perfect for this test). I hope this helps!

Best regards,

Felipe

[Felipe Melo]

Hi Murilo,

I hope you're doing well!

I'm facing difficulties uploading DIPs to AtoM via Rsync from Archivematica, even after following the instructions from the SWORD repository configuration manual. When I try the upload through the ingestion microservices, the process fails with the error:

Error: [Upload DIP] Rsync quit unexpectedly (exit 12) - The upload script will be stopped here

I have been able to upload DIPs only using the "metadata-only DIP upload to AtoM," but I can't get it to work with the regular method.

I've tried several configuration approaches:

1. The felipe user (AtoM administrator) has been used for the upload to AtoM.
2. The SWORD deposit directory was configured as /home/archivematica/atom_sword_deposit, following the AtoM manual.
3. The archivematica user was created for the SWORD repository.
4. The fcja user is the server user, and I also tried using this user for the Rsync.

Despite these attempts, the error persists. I've attached a screenshot showing the error and the Rsync target format that I configured as per your suggestion. It seems like the communication between Archivematica and AtoM is not happening properly.

Could you help me understand what might be causing this issue and if there's something I might have missed in the configuration?

I really appreciate your help!

Best regards,
Felipe

[Murilo Souza dos Santos]

Dear Felipe,
It is likely that the fcja user does not have permission to transfer files to the archivematica user's home. And even if it does, the file transfer will not work if the local archivematica user (on the host where Archivematica is installed) cannot transfer files to the remote archivematica user's directories (on the AtoM host) without using a password.

Therefore, on the local host, generate an ssh key for the archivematica user (example: sudo -u archivematica ssh-keygen -t rsa -b 4096), copy the generated public key and paste it into the archivematica user's authorized_keys file on the remote host. If properly configured (more details here), the local archivematica user will be able to authenticate without a password and transfer packages to the remote archivematica user without any problems.

To test, on the local host, try the following:
sudo -u archivematica echo "Test" > test.txt #create an archive using the archivematica user
sudo -u archivematica rsync /tmp/test.txt archiv...@192.168.0.106:/home/archivematica/atom_sword_deposit #transfer the file to the AtoM host

Then, check if the file was transferred to the destination directory. The "Upload DIP" job (regular method) will only work if you are able to successfully transfer files using the command above.

But once it is working, just adjust your settings in the Archivematica dashboard.

Cheers,

Murilo Souza

[Jayachristrayar S]

hi everyone , 
could you please sent the documentation for rectify this issue. am facing the same issue here  i attached my error screenshot  for your reference. 

thanks and regards,

jayachristrayar

sjayachr...@gmail.com

[Tatiana Canelhas]

Hi Felipe,

there's a basic instruction on how to configure dip upload here.

But I guess you already figured out right?

Best regards,

Tati

Em segunda-feira, 18 de novembro de 2024 às 17:19:07 UTC-3, medei...@gmail.com escreveu: