[digital-curation] Micro-services BOF session at OR 2010

5 views
Skip to first unread message

Delphine Khanna

unread,
Apr 29, 2010, 1:57:31 PM4/29/10
to digital-...@googlegroups.com
Hi,

Several of us are trying to put together a birds-of-a-feather session
focusing on CDL-style Curation Micro-Services at the next Open
Repositories conference (July 6-9, in Madrid). The idea would be to
focus particularly on emerging best practices, and the more practical
side of things. The people involved in this right now are CDL's John
Kunze & Stephen Abrams, as well as Michael Giarlo, and myself (although
some of us are still working on getting their approval for traveling).

We were wondering if there are other people out there who are slated to
go to OR, and would be interested in participating in such a session. Of
course everybody would be welcome to attend, but we would be
particularly interested in identifying people who are currently in the
process of implementing micro-services (even on a small scale) and would
be willing to share their experience.

Thanks,
Delphine

--
Delphine Khanna, Digital Projects Librarian
University of Pennsylvania Library (http://www.library.upenn.edu)
ITaDD Department, Room 335W, 3420 Walnut Street, Philadelphia, PA 19104
Tel:215.573.9086 | Fax:215.898.0559 | Email:delp...@pobox.upenn.edu

--
You received this message because you are subscribed to the Google Groups "Digital Curation" group.
To post to this group, send email to digital-...@googlegroups.com.
To unsubscribe from this group, send email to digital-curati...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/digital-curation?hl=en.

Minor

unread,
Apr 29, 2010, 2:05:34 PM4/29/10
to Digital Curation
I'm planning to go to OR and would be interested in attending.

Mark A. Matienzo

unread,
Apr 29, 2010, 2:15:02 PM4/29/10
to digital-...@googlegroups.com
Wow, that would be fantastic! I'd love to attend, but unfortunately
I'm not going to OR10.

Mark A. Matienzo
Digital Archivist, Manuscripts and Archives
Yale University Library
cell: +1 734 834-4334

Ben O'Steen

unread,
Apr 29, 2010, 2:20:26 PM4/29/10
to digital-...@googlegroups.com

I'm hoping to go to or10 and would love to join in :)

On Apr 29, 2010 7:15 PM, "Mark A. Matienzo" <mark.m...@gmail.com> wrote:

Wow, that would be fantastic! I'd love to attend, but unfortunately
I'm not going to OR10.

Mark A. Matienzo
Digital Archivist, Manuscripts and Archives
Yale University Library
cell: +1 734 834-4334

-- You received this message because you are subscribed to the Google Groups "Digital Curation" gr...

Stephen Abrams

unread,
Apr 29, 2010, 3:00:20 PM4/29/10
to digital-...@googlegroups.com
As a bit background, here is the abstract for the paper that I and,
hopefully, John will be presenting at OR on our local micro-services
development.

--sla

Stephen Abrams
UC Curation Center
California Digital Library
University of California
Stephen...@ucop.edu

On Apr 29, 10:57 am, Delphine Khanna <delph...@pobox.upenn.edu> wrote:
> Hi,
>
> Several of us are trying to put together a birds-of-a-feather session
> focusing on CDL-style Curation Micro-Services at the next Open
> Repositories conference (July 6-9, in Madrid). The idea would be to
> focus particularly on emerging best practices, and the more practical
> side of things. The people involved in this right now are CDL's John
> Kunze & Stephen Abrams, as well as Michael Giarlo, and myself (although
> some of us are still working on getting their approval for traveling).
>
> We were wondering if there are other people out there who are slated to
> go to OR, and would be interested in participating in such a session. Of
> course everybody would be welcome to attend, but we would be
> particularly interested in identifying people who are currently in the
> process of implementing micro-services (even on a small scale) and would
> be willing to share their experience.
>
> Thanks,
> Delphine

OR-2010-micro-services.pdf

Bing Zhu

unread,
Apr 29, 2010, 2:19:39 PM4/29/10
to digital-...@googlegroups.com
I am also planning to attend the OR 2010 and will definitely join the BOF
session.

Bing Zhu
INC/SDSC
UCSD

Simon Spero

unread,
Apr 29, 2010, 2:28:30 PM4/29/10
to digital-...@googlegroups.com
Any chance of setting up a skype or similar conference call for the BOF?

Simon

sut...@sdsc.edu

unread,
Apr 29, 2010, 3:29:44 PM4/29/10
to digital-...@googlegroups.com
David

Any chance I can go to this?

Don
-----Original Message-----
From: Minor <mpemul...@gmail.com>
Date: Thu, 29 Apr 2010 11:05:34
To: Digital Curation<digital-...@googlegroups.com>
Subject: [digital-curation] Re: Micro-services BOF session at OR 2010

Michael J. Giarlo

unread,
Apr 29, 2010, 3:57:32 PM4/29/10
to digital-...@googlegroups.com
I will be at the BOF unless it's scheduled early on the first day.

Folks who are not planning to be at OR2010: there does seem to be a
community forming around the idea of curation micro-services, and so I
see the BOF as the first in a series of events about this topic. Do
stay tuned!

-Mike

Michael B. Klein

unread,
Apr 29, 2010, 4:53:11 PM4/29/10
to digital-...@googlegroups.com
I'm hoping to go to OR, and if I do make it, I'd like to attend this as well.

peterVG

unread,
May 1, 2010, 12:31:44 AM5/1/10
to Digital Curation
I won't be attending OR2010 but I will be at IS&T Archiving in the
Hague in June and iPress in Vienna in September. I would be happy to
help co-ordinate an informal Micro-Services BOF session at either one
of these conferences to build on the OR2010 session. Please be sure to
post any OR2010 updates to the list.

I was really excited to hear the CDL first present on micro-services
at the iPRESS conference last September. It provided us with the
conceptual framework for the proof-of-concept development work we were
doing at the City of Vancouver Archives and the IMF Archives. With
some support from UNESCO Memory of the World, this work has now been
packaged into a GPL licensed, open-source project called
Archivematica. We will make release 0.6-alpha available in mid-May as
the first working prototype version.

From my IS&T Archiving paper: "Archivematica is an implementation of
the micro-services approach which is a light-weight alternative to
repository and framework based solutions. [3] Instead of relying on a
repository interface to a digital object store, this approach uses
loosely-coupled tools to provide granular and orthogonal digital
preservation services built around file-system storage. This reduces
technical complexity for development and maintenance but is also
relevant as a long-term preservation strategy because it provides
archivists with direct, unmediated access to archival storage.
Furthermore, file system technology is long-proven and extremely
robust, typically outlasting the lifespan of enterprise information
systems. [3] See for example California Digital Library Curation Micro-
Services, http://www.cdlib.org/services/uc3/curation/"

Thanks Stephen for posting your OR2010 paper to this thread. Along
with the great content on your UC Curation website, this paper
continues to give shape to the theoretical underpinnings of the
digital curation micro-services approach and legitimize it as a
serious alternative to (IMHO) overly complex repository and J2EE
framework based systems. I especially like the focus on state transfer
which compliments our own strong preference for RESTful APIs over
bulky web services and the explanation of the Unix pipeline pattern,
which we've also implemented in Archivematica by using incron, flock,
Thunar, and Bash/Python scripts to shepherd digital objects through
our micro-services on top of a lightweight Xubuntu instance (that can
be run surprisingly well directly from a USB key, inside a virtual
machine or deployed to dedicated hardware with a single 'dd' command).

While the origins of CDL's micro-services definitions are based on
providing support services to a campus community, Archivematica's
micro-service definitions are based on a use-case and workflow
analysis of the OAIS functional model and the business process of
public archival institutions (see http://archivematica.org/wiki/index.php?title=Micro-services).

However, at first glance most of our own definitions are identical in
definition if not in name, while in other places it looks to simply be
a case of one model being more granular or overlapping several of the
other's services. We will take a look at how much we can map and sync
our model to CDL's and perhaps provide an Archivematica API that
responds to requests which use the CDL syntax. Of course, because we
are implementing a micro-services approach the tools we've assigned to
each process can also be easily swapped (e.g. to use NOID instead of
UUID to generate unique identifiers).

Anyway, I'd love the opportunity to discuss all of this in more detail
with other micro-services enthusiasts at IS&T Archiving or iPress,
hopefully some other micro-services BOFs will be attending those
conferences.

Cheers,

Peter Van Garderen

Project Manager, Archivematica -- http://archivematica.org
President/Systems Archivist, Artefactual Systems -- http://artefactual.com

On Apr 29, 1:53 pm, "Michael B. Klein" <mbkl...@gmail.com> wrote:
> I'm hoping to go to OR, and if I do make it, I'd like to attend this as
> well.
>
> On Thu, Apr 29, 2010 at 10:57 AM, Delphine Khanna
> <delph...@pobox.upenn.edu>wrote:
>
>
>
> > Hi,
>
> > Several of us are trying to put together a birds-of-a-feather session
> > focusing on CDL-style Curation Micro-Services at the next Open Repositories
> > conference (July 6-9, in Madrid). The idea would be to focus particularly on
> > emerging best practices, and the more practical side of things. The people
> > involved in this right now are CDL's  John Kunze & Stephen Abrams, as well
> > as Michael Giarlo, and myself (although some of us are still working on
> > getting their approval for traveling).
>
> > We were wondering if there are other people out there who are slated to go
> > to OR, and would be interested in participating in such a session. Of course
> > everybody would be welcome to attend, but we would be particularly
> > interested in identifying people who are currently in the process of
> > implementing micro-services (even on a small scale) and would be willing to
> > share their experience.
>
> > Thanks,
> > Delphine
>
> > --
> > Delphine Khanna, Digital Projects Librarian
> > University of Pennsylvania Library (http://www.library.upenn.edu)
> > ITaDD Department, Room 335W, 3420 Walnut Street, Philadelphia, PA 19104
> > Tel:215.573.9086 | Fax:215.898.0559 | Email:delph...@pobox.upenn.edu<Email%3Adelph...@pobox.upenn.edu>
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Digital Curation" group.
> > To post to this group, send email to digital-...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > digital-curati...@googlegroups.com<digital-curation%2Bunsu...@googlegroups.com>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/digital-curation?hl=en.
>
> --
> You received this message because you are subscribed to the Google Groups "Digital Curation" group.
> To post to this group, send email to digital-...@googlegroups.com.
> To unsubscribe from this group, send email to digital-curati...@googlegroups.com.
> For more options, visit this group athttp://groups.google.com/group/digital-curation?hl=en.

slabrams

unread,
May 3, 2010, 1:20:14 PM5/3/10
to Digital Curation
Hi Peter:

Unfortunately, we will not be sending anyone to Archiving 2010 this
month. (With travel budgets extremely tight, we have to be more
selective than we would prefer to be.) However, I am planning on
attending iPRES in September. We'd be happy to work together on a
micro-services BOF in Vienna.

--sla

On Apr 30, 9:31 pm, peterVG <vangarderen.pe...@gmail.com> wrote:
> I won't be attending OR2010 but I will be at IS&T Archiving in the
> Hague in June and iPress in Vienna in September. I would be happy to
> help co-ordinate an informal Micro-Services BOF session at either one
> of these conferences to build on the OR2010 session. Please be sure to
> post any OR2010 updates to the list.

peterVG

unread,
May 4, 2010, 1:52:02 PM5/4/10
to Digital Curation
Hi Stephen,

That would be great. I look forward to hearing about any discussions
you will have on this at OR2010 and getting a follow-up session
organized for iPress 2010.

Cheers,

--peter
Reply all
Reply to author
Forward
0 new messages