Re: [Blacklight-development] need help in installing Blacklight

128 views
Skip to first unread message

Yongming Wang

unread,
Feb 12, 2012, 5:28:21 PM2/12/12
to James Stuart, blacklight-...@googlegroups.com, Yongming Wang
Thanks James, I solved this problem based on your instruction, even though I had to install ruby1.8-dev instead of ruby1.9.1-dev.

Now I came to another problem.

When I come to step 3 to Install blacklight using Devise for user authentication: the first part is OK ($gem install devise) after solving some directory write permission issue.

but when I do the second part:

$rails generate blacklight --devise

The screen threw me a rails usage page like the following:

rails new App-Path (Option)
......


What's going on here?


Thanks very much for your help.


---------------------------------
Yongming Wang
Systems Librarian
The College of New Jersey Library
phone: 609-771-3337
email: wan...@tcnj.edu
---------------------------------

----- Original Message -----
From: "James Stuart" <james....@gmail.com>
To: blacklight-...@googlegroups.com
Cc: "Yongming Wang" <wan...@tcnj.edu>
Sent: Saturday, February 11, 2012 5:21:09 PM GMT -05:00 US/Canada Eastern
Subject: Re: [Blacklight-development] need help in installing Blacklight

I'm pretty sure that this is the next step:

sudo apt-get install ruby1.9.1-dev

http://blog.moonflare.com/2011/10/25/installing-ruby-1-9-2-and-gems-on-ubuntu-11-10/

On Sat, Feb 11, 2012 at 4:01 PM, Yongming Wang <wan...@tcnj.edu> wrote:
> Dear Blacklight community,
>
> I'm a newbie. I'm following the Quickstart Instruction from http://projectblacklight.org and have successfully installed Ruby (1.9.3) and Rails.
>
> When I came to step 2 of Install and Use section, after issuing the command "$bundle install" I got the following error:
>
> ......
> Installing rack-ssl (1.3.2)
> Installing json (1.6.5) with native extensions /usr/local/lib/site_ruby/1.8/rubygems/installer.rb:483:in `build_extensions': ERROR: Failed to build gem native extension. (Gem::Installer::ExtensionBuildError)
>
> /usr/bin/ruby1.8 extconf.rb
> extconf.rb:1:in `require': no such file to load -- mkmf (LoadError)
>        from extconf.rb:1
>
>
> Gem files will remain installed in /home/yongming/.bundler/tmp/2382/gems/json-1.6.5 for inspection.
> Results logged to /home/yongming/.bundler/tmp/2382/gems/json-1.6.5/ext/json/ext/parser/gem_make.out
>        from /usr/local/lib/site_ruby/1.8/rubygems/installer.rb:446:in `each'
>        from /usr/local/lib/site_ruby/1.8/rubygems/installer.rb:446:in `build_extensions'
>        from /usr/local/lib/site_ruby/1.8/rubygems/installer.rb:198:in `install'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/source.rb:101:in `install'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/rubygems_integration.rb:78:in `preserve_paths'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/source.rb:91:in `install'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/installer.rb:58:in `run'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/rubygems_integration.rb:93:in `with_build_args'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/installer.rb:57:in `run'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/spec_set.rb:12:in `each'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/spec_set.rb:12:in `each'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/installer.rb:49:in `run'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/installer.rb:8:in `install'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/cli.rb:222:in `install'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/vendor/thor/task.rb:22:in `send'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/vendor/thor/task.rb:22:in `run'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/vendor/thor/invocation.rb:118:in `invoke_task'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/vendor/thor.rb:246:in `dispatch'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/lib/bundler/vendor/thor/base.rb:389:in `start'
>        from /usr/lib/ruby/gems/1.8/gems/bundler-1.0.15/bin/bundle:13
>        from /usr/bin/bundle:19:in `load'
>        from /usr/bin/bundle:19
>
>
> I ignored the error and went on to next step "$gem install devise" but got the following error:
>
> yongming@ubuntu:~/my_app$ gem install devise
> ERROR:  While executing gem ... (Gem::FilePermissionError)
>    You don't have write permissions into the /usr/lib/ruby/gems/1.8 directory.
>
>
> Obviously I can't continue now.
>
> (I have to admit that a few months ago I tried to install Ruby but failed. Maybe I messed up with it. It seems that I have both Ruby 1.8 and 1.9. If that's the case, how can I clean up?)
>
> My server is Ubuntu 10.04 Server LTS x386 32 bits.
>
>
> Thank you very much in advance for your help and advice.
>
>
>
>
> Yongming
>
> ---------------------------------
> Yongming Wang
> Systems Librarian
> The College of New Jersey Library
> phone: 609-771-3337
> email: wan...@tcnj.edu
> ---------------------------------
>
> --
> You received this message because you are subscribed to the Google Groups "Blacklight Development" group.
> To post to this group, send email to blacklight-...@googlegroups.com.
> To unsubscribe from this group, send email to blacklight-develo...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/blacklight-development?hl=en.
>

Yongming Wang

unread,
Feb 12, 2012, 5:33:55 PM2/12/12
to James Stuart, blacklight-...@googlegroups.com
Dear Blacklight Community,

I have a bigger issue down the road when I look at the Quickstart instruction. The step 5 requires to install solr.

My physical server has VuFind on it which also uses Solr.

My question is: can these two products, or their Solr engines, co-exist on the same machine. What is my best strategy to implement step 5 as it gives three options for the Solr solution.


Thank you very much.

James Stuart

unread,
Feb 12, 2012, 6:17:59 PM2/12/12
to Yongming Wang, blacklight-...@googlegroups.com
The answer is yes. It's just a matter of how you do it.

If your other solr is not on port 8983, then just follow the
blacklight jetty instructions. They'll be on different ports and
that's fine.

If it's already on 8983, then you can change the port of the
blacklight jetty installation (google change port jetty). Note, you'll
need to change config/solr.yml as well.

More permanently, solr can be set up in a multi-core mode, which
allows you to run multiple cores under the same solr server.

Finally, blacklight can be configured to read almost any existing solr
index, but I'd recommend not starting with that.

James Stuart

unread,
Feb 12, 2012, 6:34:21 PM2/12/12
to Yongming Wang, blacklight-...@googlegroups.com
Can you try this again, and post on http://gist.github.com the command
and resulting trace?

Yongming Wang

unread,
Feb 13, 2012, 2:15:32 PM2/13/12
to James Stuart, blacklight-...@googlegroups.com
Hi,

This is the public gist: https://gist.github.com/1819191

I'm just wanting to quickly set it up and run. Can I skip this step?

And here is the error message:

yongming@ubuntu:~$ cd my_app
yongming@ubuntu:~/my_app$ rails generate blacklight --devise
Usage:
rails new APP_PATH [options]

Options:
-b, [--builder=BUILDER] # Path to a application builder (can be a filesystem path or URL)
[--old-style-hash] # Force using old style hash (:foo => 'bar') on Ruby >= 1.9
[--dev] # Setup the application with Gemfile pointing to your Rails checkout
[--skip-gemfile] # Don't create a Gemfile
-d, [--database=DATABASE] # Preconfigure for selected database (options: mysql/oracle/postgresql/sqlite3/frontbase/ibm_db/sqlserver/jdbcmysql/jdbcsqlite3/jdbcpostgresql/jdbc)
# Default: sqlite3
-O, [--skip-active-record] # Skip Active Record files
[--skip-bundle] # Don't run bundle install
-T, [--skip-test-unit] # Skip Test::Unit files
-S, [--skip-sprockets] # Skip Sprockets files
-j, [--javascript=JAVASCRIPT] # Preconfigure for selected JavaScript library
# Default: jquery
-m, [--template=TEMPLATE] # Path to an application template (can be a filesystem path or URL)
-J, [--skip-javascript] # Skip JavaScript files
-r, [--ruby=PATH] # Path to the Ruby binary of your choice
# Default: /usr/bin/ruby1.8
[--edge] # Setup the application with Gemfile pointing to Rails repository
-G, [--skip-git] # Skip Git ignores and keeps

Runtime options:
-s, [--skip] # Skip files that already exist
-f, [--force] # Overwrite files that already exist
-p, [--pretend] # Run but do not make any changes
-q, [--quiet] # Supress status output

Rails options:
-h, [--help] # Show this help message and quit
-v, [--version] # Show Rails version number and quit

Description:
The 'rails new' command creates a new Rails application with a default
directory structure and configuration at the path you specify.

You can specify extra command-line arguments to be used every time
'rails new' runs in the .railsrc configuration file in your home directory.

Note that the arguments specified in the .railsrc file don't affect the
defaults values shown above in this help message.

Example:
rails new ~/Code/Ruby/weblog

This generates a skeletal Rails installation in ~/Code/Ruby/weblog.
See the README in the newly created application to get going.
yongming@ubuntu:~/my_app$

James Stuart

unread,
Feb 13, 2012, 2:17:09 PM2/13/12
to Yongming Wang, blacklight-...@googlegroups.com
Did you run rails new my_app. I think rails give you that message
whenever you try to run a rails command inside a directory that isn't
a rails app.

Yongming Wang

unread,
Feb 13, 2012, 2:31:29 PM2/13/12
to James Stuart, blacklight-...@googlegroups.com
>Did you run rails new my_app.?

Yes. I did. That is the step one on the Quickstart Instruction. Here is the content of my_app directory:

yongming@ubuntu:~/my_app$ ls -larth
total 80K
drwxr-xr-x 3 yongming yongming 4.0K 2011-07-19 05:49 lib
drwxr-xr-x 6 yongming yongming 4.0K 2011-07-19 05:49 app
drwxr-xr-x 6 yongming yongming 4.0K 2011-07-19 05:49 tmp
drwxr-xr-x 7 yongming yongming 4.0K 2011-07-19 05:49 test
-rw-r--r-- 1 yongming yongming 11K 2011-07-19 05:49 README
-rw-r--r-- 1 yongming yongming 307 2011-07-19 05:49 Rakefile
drwxr-xr-x 5 yongming yongming 4.0K 2011-07-19 05:49 config
drwxr-xr-x 4 yongming yongming 4.0K 2011-07-19 05:49 script
drwxr-xr-x 2 yongming yongming 4.0K 2011-07-19 05:49 log
drwxr-xr-x 13 yongming yongming 4.0K 2011-07-19 06:13 server
-rw-r--r-- 1 yongming yongming 47 2011-07-19 06:27 Gemfile
drwxr-xr-x 2 yongming yongming 4.0K 2012-02-11 15:21 vendor
drwxr-xr-x 2 yongming yongming 4.0K 2012-02-11 15:21 doc
drwxr-xr-x 5 yongming yongming 4.0K 2012-02-11 15:22 public
-rw-r--r-- 1 yongming yongming 2.6K 2012-02-12 11:48 Gemfile.lock
drwxr-xr-x 14 yongming yongming 4.0K 2012-02-12 11:48 .
drwxr-xr-x 50 yongming yongming 4.0K 2012-02-13 09:05 ..
drwxr-xr-x 2 yongming yongming 4.0K 2012-02-13 14:16 db


And here is my environment:

yongming@ubuntu:~/my_app$ rails -v
Rails 3.2.1
yongming@ubuntu:~/my_app$ which rails
/usr/bin/rails
yongming@ubuntu:~/my_app$ ruby -v
ruby 1.8.7 (2010-01-10 patchlevel 249) [i486-linux]
yongming@ubuntu:~/my_app$ printenv PATH
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games

Thank you very much.

Yongming
---------------------------------
Yongming Wang
Systems Librarian
The College of New Jersey Library
phone: 609-771-3337
email: wan...@tcnj.edu
---------------------------------

James Stuart

unread,
Feb 13, 2012, 6:35:22 PM2/13/12
to Yongming Wang, blacklight-...@googlegroups.com
I'm not sure what's going wrong: it must be something weird and small.

Anybody else got any ideas?

Jessie Keck

unread,
Feb 13, 2012, 7:02:15 PM2/13/12
to blacklight-...@googlegroups.com, Yongming Wang
I think I have seen this elsewhere, but I can't exactly put my finger on where.

How many different version of rails do you have installed (paste or gist a 'gem list')? I think this ended up being a bundler/rvm issue for me, but I don't know how that would translate to ubuntu.

- Jessie

Yongming Wang

unread,
Feb 14, 2012, 8:13:01 AM2/14/12
to Jessie Keck, blacklight-...@googlegroups.com
Hi Jessie,

my gem list:

yongming@ubuntu:~$ gem list

*** LOCAL GEMS ***

abstract (1.0.0)
actionmailer (3.2.1, 3.0.9)
actionpack (3.2.1, 3.0.9)
activemodel (3.2.1, 3.0.9)
activerecord (3.2.1, 3.0.9)
activeresource (3.2.1, 3.0.9)
activesupport (3.2.1, 3.0.9)
arel (3.0.0, 2.0.10)
bcrypt-ruby (3.0.1)
blacklight (3.2.2)
builder (3.0.0, 2.1.2)
bundler (1.0.15)
chunky_png (1.2.5)
compass (0.12.rc.1)
devise (2.0.1)
erubis (2.7.0, 2.6.6)
fssm (0.2.8.1)
hike (1.2.1)
i18n (0.6.0, 0.5.0)
journey (1.0.1)
json (1.6.5)
kaminari (0.13.0, 0.12.4)
mail (2.4.1, 2.2.19)
marc (0.4.3)
mime-types (1.17.2, 1.16)
multi_json (1.0.4)
nokogiri (1.5.0)
orm_adapter (0.0.5)
polyglot (0.3.3, 0.3.1)
rack (1.4.1, 1.2.3)
rack-cache (1.1)
rack-mount (0.6.14)
rack-ssl (1.3.2)
rack-test (0.6.1, 0.5.7)
rails (3.2.1, 3.0.9)
railties (3.2.1, 3.0.9)
rake (0.9.2.2, 0.9.2)
rdoc (3.12, 3.8)
rsolr (1.0.6)
rsolr-ext (1.0.3)
sass (3.1.15)
sass-rails (3.2.4)
sprockets (2.1.2)
thor (0.14.6)
tilt (1.3.3)
treetop (1.4.10, 1.4.9)
tzinfo (0.3.31, 0.3.29)
unicode (0.4.1)
warden (1.1.0, 1.0.4)
yongming@ubuntu:~$


You are right. I have two versions of rails (3.2.1 and 3.0.9). What should I do next?


Thanks very much.

Yongming Wang

unread,
Feb 14, 2012, 1:22:48 PM2/14/12
to blacklight-...@googlegroups.com, Yongming Wang
Dear Blacklight Community,

A quick question regarding step 5 in Quickstart instruction:

After I did "$rails generate blacklight:jetty, do I still need to do "$rails generate blacklight:solr_conf path/to/output/directory/?


Thanks,

James Stuart

unread,
Feb 14, 2012, 1:28:57 PM2/14/12
to blacklight-...@googlegroups.com, Yongming Wang
You don't need to: the rails generate blacklight:jetty should do that step.

Jessie Keck

unread,
Feb 14, 2012, 1:30:59 PM2/14/12
to blacklight-...@googlegroups.com, Yongming Wang
Hi Yongming,
That 2nd line (w/ path/to/output/direcotry) is just telling you how to generate Blacklight's solr configuration to a solr instance outside of Blacklight (e.g. if you had a pre-existing solr instance and were not using the what that comes w/ Blacklight).

Just out of curiosity did you resolve the error you were running into before w/ the rails generate command?

- Jessie

Yongming Wang

unread,
Feb 14, 2012, 1:31:16 PM2/14/12
to James Stuart, blacklight-...@googlegroups.com
Thanks, James, You are really quick. Really appreciate it.

I'm almost there ....

---------------------------------
Yongming Wang
Systems Librarian
The College of New Jersey Library
phone: 609-771-3337
email: wan...@tcnj.edu
---------------------------------

----- Original Message -----
From: "James Stuart" <james....@gmail.com>
To: blacklight-...@googlegroups.com
Cc: "Yongming Wang" <wan...@tcnj.edu>
Sent: Tuesday, February 14, 2012 1:28:57 PM GMT -05:00 US/Canada Eastern
Subject: Re: [Blacklight-development] need help in installing Blacklight

Yongming Wang

unread,
Feb 14, 2012, 1:34:16 PM2/14/12
to Jessie Keck, blacklight-...@googlegroups.com
Jessie,

I started over again, from the scratch, a clean Ubuntu machine, only install ruby1.9.3 this time. So far I solved some dependency issue like missing javacript runtime, failed to install sqlite3, and nogokiri, etc. As I said, I came this far, I see the light in the end of the tunnel...

Thanks so much for your help.

Yongming

---------------------------------
Yongming Wang
Systems Librarian
The College of New Jersey Library
phone: 609-771-3337
email: wan...@tcnj.edu
---------------------------------

----- Original Message -----
From: "Jessie Keck" <jk...@stanford.edu>
To: blacklight-...@googlegroups.com
Cc: "Yongming Wang" <wan...@tcnj.edu>
Sent: Tuesday, February 14, 2012 1:30:59 PM GMT -05:00 US/Canada Eastern
Subject: Re: [Blacklight-development] need help in installing Blacklight

Yongming Wang

unread,
Feb 14, 2012, 2:37:25 PM2/14/12
to blacklight-...@googlegroups.com, Jessie Keck
I did it!!!

So happy. Thanks for all your help.

Now I need to index my own marc records.

Yongming Wang

unread,
Feb 17, 2012, 10:07:34 AM2/17/12
to blacklight-...@googlegroups.com, Yongming Wang
Dear Blacklight Community,

We are a library consortium in New Jersey. We want to evaluate Blacklight for our next generation discovery tool. A few days ago I installed Blacklight onto our testing server, imported 50,000 plus sample marc records from multiple libraries.

I have a couple of questions regarding the consortia feature of Blacklight:

1. How do we search and display records for different libraries?

2. Does Blacklight support resource sharing within the consortium?


I looked at the Blacklight installation list and didn't see any consortium name. If any of you know of such case, please let me know.


Thank you very much.

Justin Coyne

unread,
Feb 17, 2012, 10:12:58 AM2/17/12
to blacklight-...@googlegroups.com
You could index the library name as a facet and add it to the
configuration in app/controllers/catalog_controller.rb

Justin Coyne

James Stuart

unread,
Feb 17, 2012, 10:13:39 AM2/17/12
to blacklight-...@googlegroups.com, Yongming Wang
Can you elaborate on this a bit more?


If 1) is: How do we ingest multiple library's records into one index,
you will be able to just ingest multiple marc files. You can add tags
or identifying fields to denote which source they came from, and then
display either all the records, or libraries one at a time.


I'm not sure what 2) means. Could you elaborate a bit more?

Mark A. Matienzo

unread,
Feb 17, 2012, 10:24:55 AM2/17/12
to blacklight-...@googlegroups.com
On Fri, Feb 17, 2012 at 10:13 AM, James Stuart <james....@gmail.com> wrote:
> If 1) is: How do we ingest multiple library's records into one index,
> you will be able to just ingest multiple marc files. You can add tags
> or identifying fields to denote which source they came from, and then
> display either all the records, or libraries one at a time.

James is right about this. In short, you most likely will need to add
additional fields that denote the source, and you may want to add
links back to the original OPACs.

I did this to build a prototype for a consulting project, and ended up
using SolrMarc's custom BeanShell indexing scripts quite a bit to
insert custom values.

Mark

Tom Cramer

unread,
Feb 17, 2012, 11:20:07 AM2/17/12
to Yongming Wang, Tom Cramer, blacklight-...@googlegroups.com
Yongming, 

University of Wisconsin's Forward system is the best example of a consortial Blacklight instance that I'm aware of. 


You can search the combined records of all UW schools, or limit your search to a particular campus. If you want to add a facet by library location (something that I don't see in Forward's current views), you could do as James and Justin suggest. SearchWorks (http://searchworks.stanford.edu) has an example of this where we provide searchers with the ability to limit their searches or just browse by location of library on campus. 

By resource sharing, if you mean ILL or cross-library borrowing, I think this will be more of a function of your underlying ILS(es) than Blacklight as a discovery layer, but BL can certainly support this by letting you integrate ILL or paging / request forms into your application. We've done this at Stanford as well (as have several other schools) by building simple web forms and a little bit of logic that interact with the underlying ILS calls for paging items / putting a hold on them / etc. We're happy to share this code if you (or anyone else) is interested. Our ILS is SirsiDynix Symphony.

Hope this helps, 

- Tom

 | Tom Cramer
 | Chief Technology Strategist & Associate Director 
 | Digital Library Systems & Services
 | Stanford University Libraries & Academic Information Resources
 | Stanford University

Steve Meyer

unread,
Feb 17, 2012, 10:33:56 AM2/17/12
to blacklight-...@googlegroups.com
(Apologies if this is double posted, UW-Madison just signed up for Google Apps and my work email that I used to use for the BL list just rejected my first attempt to reply...)

Hi Yongming,

The University of Wisconsin-Madison is using Blacklight in a consortial mode:

http://forward.library.wisconsin.edu/
http://forward.library.wisconsin.edu/home/choose_campus

From our perspective, Blacklight is a general resource discovery system, whether it is used for an interface to digital collections or a library catalog. BL, in a sense, is data agnostic and very flexible in this way, but that means that the system does not have any consortial functionality natively. We have done a lot of local customization to develop BL to be used for all 14  campuses in the UW System:

* Designed our index with a schools facet with values like "UW-Madison" or "UW-Milwaukee"

As suggested by Justin, this allows us to scope searches to a single campus.

* Rewrote the BL views to display different data based on the default campus for a user

Compare a search at UW-Madison:

http://forward.library.wisconsin.edu/catalog?q=wittgenstein&qt=search&local=true&school_code=WU

to the same thing across the entire UW System:

http://forward.library.wisconsin.edu/catalog?&local=false&per_page=10&q=wittgenstein&qt=search&school_code=WU

Compare a single record view for a Madison-only e-resource:

http://forward.library.wisconsin.edu/catalog/ocm53363703?school_code=WU

to the view for a UW-Milwaukee patron:

http://forward.library.wisconsin.edu/catalog/ocm53363703?school_code=WMUW

* Wrote code to user our ILS Vendor's API for UW System borrowing

Because consortial borrowing is critically important, we have written code to work with our ILS API to make sure that we can place requests for book delivery from one campus to another.

-Steve

Bess Sadler

unread,
Feb 14, 2012, 2:45:30 PM2/14/12
to blacklight-...@googlegroups.com
Yongming++

I really enjoyed following this email thread, and I hope you'll continue to share your process with us. It is so helpful to understand what new adopters go through and understanding what it's like for you can really influence the direction of the project and its documentation and installation process.

Once you get some content indexed I hope you'll share with us what you made.

Cheers,
Bess

Yongming Wang

unread,
Feb 17, 2012, 1:05:28 PM2/17/12
to blacklight-...@googlegroups.com, Yongming Wang
Thank you to all who replied to my question.

I studied both Wisconsin's and Stanford's Blacklight implementations. Both are very impressive!

It seems to me that the two implementations took different approaches. Am I right in saying that Wisconsin has multiple ILS across the system and Stanford has one ILS only. The Location facet at Stanford is very eye-catching. And the request feature ("Paging for Delivery" link) is what I meant by saying "Resource Sharing". But can you do that in the multi-ILS environment which is our case? -- not only we have multiple ILS but also they are from different vendors.

My next question (I don't know if it is right question to ask): I'd also like to know that in Wisconsin's case, have you built a shared, centralized bib database to support the Solr search engine? If not, how do you update your solr index?

I can see that in both implementations you have to add additional Marc tag/fields (852 in Wisconsin's case and 999 for Stanford) to display the holding information. Does that require heavy customization work? I just want to get a sense of how much work and what kind of skills needed to make this happens.


Thank you so much, again, for all you inputs and guidance.


Yongming

---------------------------------
Yongming Wang
Systems Librarian
The College of New Jersey Library
phone: 609-771-3337
email: wan...@tcnj.edu
---------------------------------

----- Original Message -----
From: "Tom Cramer" <tcr...@stanford.edu>
To: "Yongming Wang" <wan...@tcnj.edu>

Cc: "Tom Cramer" <tcr...@stanford.edu>, blacklight-...@googlegroups.com
Sent: Friday, February 17, 2012 11:20:07 AM GMT -05:00 US/Canada Eastern
Subject: Re: [Blacklight-development] Blacklight in consortia setting?

Yongming,


University of Wisconsin's Forward system is the best example of a consortial Blacklight instance that I'm aware of.


http://forward.library.wisconsin.edu/


You can search the combined records of all UW schools, or limit your search to a particular campus. If you want to add a facet by library location (something that I don't see in Forward's current views), you could do as James and Justin suggest. SearchWorks ( http://searchworks.stanford.edu ) has an example of this where we provide searchers with the ability to limit their searches or just browse by location of library on campus.


By resource sharing, if you mean ILL or cross-library borrowing, I think this will be more of a function of your underlying ILS(es) than Blacklight as a discovery layer, but BL can certainly support this by letting you integrate ILL or paging / request forms into your application. We've done this at Stanford as well (as have several other schools) by building simple web forms and a little bit of logic that interact with the underlying ILS calls for paging items / putting a hold on them / etc. We're happy to share this code if you (or anyone else) is interested. Our ILS is SirsiDynix Symphony.


Hope this helps,


- Tom


| Tom Cramer

| Chief Technology Strategist & Associate Director
| Digital Library Systems & Services

| Stanford University Libraries & Academic Information Resources

| Stanford University

| tcr...@stanford.edu


On Feb 17, 2012, at 7:07 AM, Yongming Wang wrote:

Dear Blacklight Community,

We are a library consortium in New Jersey. We want to evaluate Blacklight for our next generation discovery tool. A few days ago I installed Blacklight onto our testing server, imported 50,000 plus sample marc records from multiple libraries.

I have a couple of questions regarding the consortia feature of Blacklight:

1. How do we search and display records for different libraries?

2. Does Blacklight support resource sharing within the consortium?


I looked at the Blacklight installation list and didn't see any consortium name. If any of you know of such case, please let me know.


Thank you very much.

Yongming

Naomi Dushay

unread,
Feb 17, 2012, 1:36:20 PM2/17/12
to blacklight-...@googlegroups.com, Yongming Wang

On Feb 17, 2012, at 10:05 AM, Yongming Wang wrote:

> Thank you to all who replied to my question.
>
> I studied both Wisconsin's and Stanford's Blacklight implementations. Both are very impressive!
>
> It seems to me that the two implementations took different approaches. Am I right in saying that Wisconsin has multiple ILS across the system and Stanford has one ILS only.

this is correct - Stanford's SearchWorks MARC data is from our sirsi Symphony installation


> The Location facet at Stanford is very eye-catching. And the request feature ("Paging for Delivery" link) is what I meant by saying "Resource Sharing". But can you do that in the multi-ILS environment which is our case? -- not only we have multiple ILS but also they are from different vendors.

The Paging for Delivery is done with a locally grown application that interfaces with Symphony as needed. There is no barrier to having more than one such application, one for each ILS.

>
> My next question (I don't know if it is right question to ask): I'd also like to know that in Wisconsin's case, have you built a shared, centralized bib database to support the Solr search engine? If not, how do you update your solr index?
>
> I can see that in both implementations you have to add additional Marc tag/fields (852 in Wisconsin's case and 999 for Stanford) to display the holding information. Does that require heavy customization work? I just want to get a sense of how much work and what kind of skills needed to make this happens.

The Sirsi API provided a way to get item information in 999 fields. UVa, which is also a Sirsi site, does the same thing. In both our case and UVa's case, the local gurus for sirsi are separate people from the ones who index the marc data into Solr for blacklight.

- Naomi

Steve Meyer

unread,
Feb 17, 2012, 2:00:46 PM2/17/12
to blacklight-...@googlegroups.com
On Fri, Feb 17, 2012 at 12:05 PM, Yongming Wang <wan...@tcnj.edu> wrote:
It seems to me that the two implementations took different approaches. Am I right in saying that Wisconsin has multiple ILS across the system and Stanford has one ILS only.

The UW System has 14 instances of the same ILS. 
 
My next question (I don't know if it is right question to ask): I'd also like to know that in Wisconsin's case, have you built a shared, centralized bib database to support the Solr search engine? If not, how do you update your solr index?

We have a process that extracts 13 million bib records out of 14 different ILSes. The code then sorts them by OCLC numbers (where they exist), which we use as our BL identifiers. We then merge all the records that share an OCLC number together. This is the modified MARC record set of 8 million records that we then index in Solr. 

We run this extract, sort and merge process once a week. We then diff the previous week's MARC record set against the current one and index the updates, deletes, additions. We are not using SolrMarc, but custom code that we developed for this process.
 
I can see that in both implementations you have to add additional Marc tag/fields (852 in Wisconsin's case and 999 for Stanford) to display the holding information. Does that require heavy customization work? I just want to get a sense of how much work and what kind of skills needed to make this happens

Our BL install is heavily customized. Basically, we are using BL for the data access to Solr and some common searching functionality like search history and the excellent advanced search plugin. But the indexing and views are almost entirely locally developed. 

-Steve

Robert Haschart

unread,
Feb 17, 2012, 4:20:50 PM2/17/12
to blacklight-...@googlegroups.com
Yongming,

Here at the University of Virginia (similar to Stanford) the holdings information is appended to the MARC records in 999 fields.  This is done by the ILS system as it dumps out the MARC records.  The info is in that field merely because that is where the SirsiDynix Symphony software decides to put it.  In our case the holdings info is directly appended to the records as they are out, other systems write out the holdings info into a separate file, or as subsequent MARC records only containing the holdings info in the same record stream.

Once you know how the ILS system (or systems) that you will have to work with provides the holdings information, it is a relatively simple matter to create a SolrMarc indexing specification to extract that information and write it to the Solr index.  Depending on where/how the info you want is stored in the holdings info, the skills needed extract it can be as simple as editing a couple of properties files, or it might require some java-like scripting, or small bits of custom java code.   

Robert Haschart

Robert Haschart

unread,
Feb 17, 2012, 4:34:52 PM2/17/12
to blacklight-...@googlegroups.com
Steve,

As the primary developer on SolrMarc, I'm interested in the reasons for developing custom code to handle the updating and indexing of your records.   There are tools built into SolrMarc that seem that they would do most or all of what you are currently doing.  

The updating process here at UVA is similar in many respects to what you do (except for the merging records with a common OCLC number) and nearly all of it is done via the scripts that are included as a part of the SolrMarc distribution.

-Robert Haschart
Reply all
Reply to author
Forward
0 new messages