Blacklight & OAI

100 views
Skip to first unread message

Corey A Harper

unread,
Oct 27, 2011, 12:28:15 PM10/27/11
to blacklight-...@googlegroups.com
Dear All,

I recently stumbled across Chris Beer's thoughts (& code!) for
harvesting OAI into Blacklight [1], and as part of some
experimentation here at NYU, have gotten a working demo of it up with
a few hundred digital library items from a few different collections.

I've been having a back & forth with Chris about refactoring this to
work with the newer versions of Blacklight, and he suggested it'd be a
good idea to reach out to the list and poll how much interest /
activity there is around non-MARC, OAI based collections in the
Blacklight community.

Are people playing this this kind of work? Interested in doing so? I'd
like to take Chris' code & extend it to support profiles of Dublin
Core beyond oai_dc, and possible to support other metadata formats. Is
that something this community would be interested in seeing become
part of the Blacklight project?

A few of my colleagues & I will be demoing this, as well as a few
other approaches to cross-collection digital library indexing at DLF
next week, so if you're there, please stop by!

Regards,
-Corey

[1] http://cbeer.info/blog/2011/blacklight-oai-demonstrator/


--
Corey A Harper
Metadata Services Librarian
New York University Libraries
20 Cooper Square, 3rd Floor
New York, NY 10003-7112
212.998.2479
corey....@nyu.edu

Tom Cramer

unread,
Oct 27, 2011, 2:35:06 PM10/27/11
to blacklight-...@googlegroups.com, Tom Cramer
Hi Corey,

This sounds very interesting--thanks both for the work and sharing it. 

1. Is NYU an active BL user, or is this an R&D project for which Blacklight was a convenient platform?

2. We're having a Blacklight Contributors Day the Thursday after DLF. Would you or any of your colleagues be interested in attending? 

3. For the Hydra project (which uses BL as a searching / reading front end), distributing records via OAI-PMH is a key requirement for many institutions. There are institutions with MODS, PBcore and VRAcore records. Fedora's OAI data provider is an option, but I believe others may be interested in doing this via Blacklight. 

- Tom



--
You received this message because you are subscribed to the Google Groups "Blacklight Development" group.
To post to this group, send email to blacklight-...@googlegroups.com.
To unsubscribe from this group, send email to blacklight-develo...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/blacklight-development?hl=en.


Corey A Harper

unread,
Oct 27, 2011, 3:52:10 PM10/27/11
to blacklight-...@googlegroups.com
Hi Tom,

This is just an R&D project, and at the very early stages. There's
also some middleware that spits OAI out of SOLR directly, so that
might be useful to the blacklight / hydra people.

What time on Thursday? I was debating between whether to head back
Wed. night or thursday morning, and could maybe justify staying a bit
later depending on timing and agenda for the Contributors Day.

Thanks,
-Corey

Erik Hatcher

unread,
Oct 27, 2011, 4:05:35 PM10/27/11
to blacklight-...@googlegroups.com

Jonathan Rochkind

unread,
Oct 27, 2011, 4:14:03 PM10/27/11
to blacklight-...@googlegroups.com, Erik Hatcher
That's not really an agenda exactly though. It's just a giant list of
features/projects people are interested in. We don't have a very
specific agenda at present (unless Tom has one I don't know about!).

>>> I've been having a back& forth with Chris about refactoring this to


>>> work with the newer versions of Blacklight, and he suggested it'd be a
>>> good idea to reach out to the list and poll how much interest /
>>> activity there is around non-MARC, OAI based collections in the
>>> Blacklight community.
>>>
>>> Are people playing this this kind of work? Interested in doing so? I'd

>>> like to take Chris' code& extend it to support profiles of Dublin


>>> Core beyond oai_dc, and possible to support other metadata formats. Is
>>> that something this community would be interested in seeing become
>>> part of the Blacklight project?
>>>

>>> A few of my colleagues& I will be demoing this, as well as a few

Chris Beer

unread,
Oct 27, 2011, 4:13:07 PM10/27/11
to blacklight-...@googlegroups.com
After Corey contacted me earlier this week, I started work on an OAI-PMH harvesting frontend on Blacklight 3 (using the config refactor feature branch!) at https://github.com/cbeer/blacklight_oai_harvester_demo

There's already an OAI-PMH provider plugin for Blacklight at https://github.com/cbeer/blacklight_oai_provider that uses the Blacklight document extension framework, which may be useful for the Hydra work?

Chris

Corey A Harper

unread,
Oct 28, 2011, 2:52:27 PM10/28/11
to blacklight-...@googlegroups.com, Tom Cramer
Hi Tom, et al.,

It looks like I'm going to be able to stick around for the Blacklight
meeting on Thursday, though my primary reason for attending will be to
observe & to learn.

Others here at NYU are more expert with Rails than I. I'm only just
starting to wrap my head around the Rails "way of doing things",
starting with serious crash-courses in M-V-C best practice. That said,
I think my server's one of the few boxes at NYU that's got a running
Blacklight, so I've at least gotten that far.

If you don't mind a somewhat Rails-green observer at your meeting,
then please count me in.

(Btw, I'm *very* interested in Hydra along with Blacklight, so may try
to pick some Stanford brains about that during breaks...)

Best,
-Corey

On Thu, Oct 27, 2011 at 2:35 PM, Tom Cramer <tcr...@stanford.edu> wrote:

Tom Cramer

unread,
Oct 30, 2011, 1:08:36 PM10/30/11
to blacklight-...@googlegroups.com, Tom Cramer, Erik Hatcher
Jonathan, all,

In addition to all the developer and UI technical nitty gritty that's on the wiki, what I'm really hoping will emerge from this meeting is a robust exchange of current state, plans, hopes and dreams for Blacklight, and the opportunity to synthesize a technical and community roadmap. Towards that end, I'd really like it if we could spend some time in a few areas: 

- what are the most compelling features / sites people have deployed locally (but are perhaps not widely known)?
- what enhancements are on your wishlist? 
- what code / resources might you commit to scratch another's itch?

Given the excellence and breadth of the attendees, I also think there is an opportunity to do a little blue sky planning for Blacklight. Notre Dame's exhibits plugin seems to me that  it might open up a brand new wave of functionality (and adopters). Getting some exemplary EAD / Finding Aid code in place would make Blacklight a much more compelling front end to libraries that want a general purpose catalog as well as a special purpose tool for finding archival materials. JACKPHY enhancements could open up the BL audience (and contributor base) to a much wider set of institutions. Erik and others have suggested that with a little rebranding and perhaps some enhancements, Blacklight's natural user base might extend well past libraries and the academic community. 

So I'd like some discussion on where we think Blacklight might go--both to leverage the Rails3 architecture to meet our varied (and known) needs, and perhaps beyond that. 

- Tom


John Berryman

unread,
Oct 30, 2011, 7:25:22 PM10/30/11
to blacklight-...@googlegroups.com
Hello All,

I've heard this meetup alluded to, but I haven't been able to find the details... for instance, the wiki page (https://github.com/projectblacklight/blacklight/wiki/November-3-Agenda) doesn't mention a location or link to a more generic information page.  I'd hate to miss this if I can make it.

-John

Jessie Keck

unread,
Oct 30, 2011, 10:55:31 PM10/30/11
to blacklight-...@googlegroups.com
Hi John,

Please let us know if information that you need isn't covered here.

Thanks, 
- Jessie
Reply all
Reply to author
Forward
0 new messages