Creation of a DIP from an AIP

[Simeon Warner]

Hi,

We are exploring Arcivematica and I am puzzled by what seems like missing base functionality: the ability to create a DIP from an AIP. I've tried to summarize my understanding in the attached picture: that creation of a DIP from an AIP is supported only through a re-ingest of the AIP.

From what I can find, AIP->DIP functionality was present in the 2009 use case analysis (as it come straight from OAIS) [1] and then in the activity diagrams [2]. However, I have failed to find later trace of it.

The re-ingest approach currently documented [3] (as of 1.4) seems supported by a number of thread on the mailing list (e.g. [4, 5, 6]) as the way to accomplish AIP->DIP. But this leaves me with a few questions:

1. Is re-ingest the current and planned approach for supporting AIP->DIP generation?

And, assuming it is:

2. Is there some documentation or discussion of the rationale for this approach?

3. Is there good understanding of what should be the same/different in a DIP generated from SIP->DIP vs SIP->AIP->(SIP)->DIP (assuming otherwise same settings)?

Cheers,

Simeon

[1] UC-6.6 Generate DIP https://wiki.archivematica.org/UC-6.6 based on "OAIS s. 4.1.1.7, pp 4-15, 4-16 -- The Generate DIP function accepts a dissemination request, retrieves the AIP from Archival Storage, and moves a copy of the data to a staging area for further processing. This function also transmits a report request to Data Management to obtain Descriptive Information needed for the DIP. If special processing is required, the Generate DIP function accesses data objects in staging storage and applies the requested processes. The types of operations, which may be carried out, include statistical functions, sub-sampling in temporal or spatial dimensions, conversions between different data types or output formats, and other specialized processing (e.g., image processing). This function places the completed DIP response in the staging area and notifies the Coordinate Access Activities function that the DIP is ready for delivery."

[2] AD13 Deliver DIP picture: https://wiki.archivematica.org/File:Archivematica_AD13_DeliverDIP_v1.pdf

[3] https://www.archivematica.org/en/docs/archivematica-1.5/user-manual/ingest/ingest/#reingest-aip

[4] https://groups.google.com/d/msg/archivematica/OrDFb8Yz6Qg/sFq085qsOf0J "when we introduce the Re-ingest AIP feature in Archivematica 1.4. You will be able to re-ingest an AIP, and update its metadata (if desired) and generate a DIP from it"

[5] https://groups.google.com/d/msg/archivematica/Sa9uRa18RZk/AqCTV0eLOQAJ "AIP reingest error & issues", noting a number of outstanding issues

[6] https://groups.google.com/d/msg/archivematica/68ainjjgZq8/RLMA-BcxNwAJ describes: "AIP re-ingest for DIP generation and metadata updates (Sponsored by Zuse Institut of Berlin). Allows you to re-ingest an existing Archivematica AIP for the purpose of normalizing for access (DIP creation) or to update the Dublin Core and PREMIS rights metadata. Note that full AIP re-ingest, allowing for the re-running of all micro-services including re-normalization for preservation purposes, is currently under development and is targeted for the 1.6 release." https://projects.artefactual.com/issues/8679 

[Sarah Romkey]

Hello Simeon,

Thank you for your post! Your understanding is correct (and, great diagram!). If you have an AIP and you require a DIP from that AIP, the current and planned methodology for that is to re-ingest the AIP. You can read some development documentation for this feature here: https://wiki.archivematica.org/AIP_re-ingest

In Archivematica 1.5, AIP re-ingest is supported for updating metadata, creating a DIP (referred to in the dashboard as "Normalize for access", or both. Part of the rationale for this approach is you can change your Preservation Planning rules for normalizing access and re-make a DIP if your access needs or policies have changed, for example. If you do not change your normalization rules, you could expect the same outcome from a DIP created upon first ingest as created through re-ingest.

There are surely improvements that could be made to this method. For example, one idea we've floated is being able to create a "DIP on demand" from objects which reside in various AIPs- there's nothing in the OAIS reference model that describes the one-to-one AIP-to-DIP equivalency that Archivematica enforces. This kind of development would require sponsorship or a community pull-request. Do you  (or anyone else) have other ideas?

Thanks again for your post,

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematica+unsubscribe@googlegroups.com.
To post to this group, send email to archiv...@googlegroups.com.
Visit this group at https://groups.google.com/group/archivematica.
For more options, visit https://groups.google.com/d/optout.

[Buddha Buck]

On Thursday, March 9, 2017 at 5:21:38 PM UTC-5, Sarah Romkey wrote:

Hello Simeon,

Thank you for your post! Your understanding is correct (and, great diagram!). If you have an AIP and you require a DIP from that AIP, the current and planned methodology for that is to re-ingest the AIP. You can read some development documentation for this feature here: https://wiki.archivematica.org/AIP_re-ingest

In Archivematica 1.5, AIP re-ingest is supported for updating metadata, creating a DIP (referred to in the dashboard as "Normalize for access", or both. Part of the rationale for this approach is you can change your Preservation Planning rules for normalizing access and re-make a DIP if your access needs or policies have changed, for example. If you do not change your normalization rules, you could expect the same outcome from a DIP created upon first ingest as created through re-ingest.

I am on Simeon's team, trying to test if I can really expect the same outcome from a DIP created on first ingest or from re-ingest, as you suggest. I seem to be running into the same problem as described in Julie Allinson's posting from last June (https://groups.google.com/forum/#!msg/archivematica/QuUAgCqi73E/SgKMETcmNwAJ). Is there a known solution? I can't re-ingest anything.

 

To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.

[Sarah Romkey]

Hi there,

What version of the Storage Service are you using?

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

To unsubscribe from this group and stop receiving emails from it, send an email to archivematica+unsubscribe@googlegroups.com.

[Buddha Buck]

It appears, based on the version page, to be version "Whoops!", but looking elsewhere I think it 0.9.1

We are in the process of upgrading our test system to Archivematica 1.6. I'll wait until then to try it again.

[Sarah Romkey]

The broken version page is a little suspect- I hope you have better luck after your upgrade!

Cheers,

Sarah

Sarah Romkey, MAS,MLIS

Archivematica Program Manager
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

To unsubscribe from this group and stop receiving emails from it, send an email to archivematica+unsubscribe@googlegroups.com.