Local to S3 Storage Migration + Other S3 questions

[tmi...@gmail.com]

Has anyone moved from local to s3, and have the steps they would be willing to share?

Also, is it possible to pull the S3 credentials via an attached instance role? I saw that you can set environmental variables, but wanted to check here first while we look at upgrading our system to the latest version.

Last, does any one have any guidance on what type of storage classes you recommend, or do you recommend using the Intelligent Tiering option (assuming Archivematica doesn't have regular processes running touching the files, checking items. For example, fixity.

Thank you!

Tom

[Joseph Anderson]

Regarding storage classes, we use the following and find it works really well for us both functionally and economically:

AIP's: Glacier Instant

AIP Replicas: Glacier Deep Archive

DIP's: Standard class

-Joe

[Charlie Hosale]

Hi Tom,

In the last year we started using S3 more for transfer sources and AIP storage. Our Archivematica is hosted on a local VM, not in AWS, so the details might be slightly different. We’re using standard storage class while we settle into S3 and work out some of the rough spots with how Archivematica interacts with objects in S3. I shared your questions with our admin and they shared these words of wisdom:

"I’m not totally sure that I understand the “ is it possible to pull the S3 credentials via an attached instance role?” question. It sounds like their instance running the Archivematica software will live in AWS (as an EC2 instance). If that’s the case, and I understand their question, then, yes, it is straightforward to assign an IAM Policy to the EC2 Instance Role that will grant that EC2 instance access to the S3 bucket and the objects in the bucket. That said, I have no idea if the Archivematica software will respect that — I don’t quite know how an S3 target is defined in the Archivematica Storage Service. It might not be possible to configure and S3 bucket for Archivematica without specifying and IAM User key/secret pair…”

Take care,

Charlie Hosale

Digital Preservation Coordinator

MIT Libraries | Scholarly Communications & Collections Strategy

cho...@mit.edu

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/archivematica/26d088a4-8d32-40d9-938a-1f8fd96835f0n%40googlegroups.com.

[Joseph Anderson]

You should be able to set up the credentials via the attached instance role. We don't do that, but we do have the credentials stored in local file on the server, so it's definitely possible not to directly store the credentials through the Archivematica SS interface.