Islandora MODS

[Poulter, Dale]

Good afternoon,

 

After reading many posts about adding MODs to our index and display we have been attempting to do so using the Discovery Garden gsearch.  However, we cannot seem to get the process to work.  Here is what we have done:

 

1-      Installed the basic-solr-config (https://github.com/discoverygarden/basic-solr-config)

2-      Added the gsearch extensions (https://github.com/discoverygarden/dgi_gsearch_extensions)

3-      Installed the gsearch from https://github.com/discoverygarden/gsearch

4-      Edited the foxmlToSolr.xslt to include the needed templates and correct the file paths.

 

Tomcat starts ok and indexing appears to occur but I am unable to view the mods fields.  Thank you for any assistance.

 

 

 

 

--Dale

 

---------------------------------------
Dale Poulter

Director

Library Technology and Digital Services
Vanderbilt University

419 21st Avenue South, Office 812 
Nashville, TN  37203-2427
(615)343-5388
(615)207-9705 (cell)
dale.p...@vanderbilt.edu

 

[Mark Jordan]

Dale, when you say you are unable to view any MODS, where are you looking? Have you been able to see any MODS data using the Solr admin interface?

1. Go to http://yourserver:8080/solr/#/collection1/query (your ports etc. may vary)
2. Click on Execute Query (*:*)
   
3. If you want to search for an object you know is in your repo, change the query to PID:namespace\:number
   

Mark

--
For more information about using this group, please read our Listserv Guidelines: http://islandora.ca/content/welcome-islandora-listserv
---
You received this message because you are subscribed to the Google Groups "islandora" group.
To unsubscribe from this group and stop receiving emails from it, send an email to islandora+...@googlegroups.com.
Visit this group at https://groups.google.com/group/islandora.
To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/4B55C1D28471794C811F425520B7B22566E69E0F%40ITS-HCWNEM104.ds.vanderbilt.edu.
For more options, visit https://groups.google.com/d/optout.

[Poulter, Dale]

Interesting,  I can access fedoragsearch but cannot access  solr from a workstation.  Solr is accessible from the server (at least returns the basic admin page). 

 

 

-Dale

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/1572937445.292670145.1520468670472.JavaMail.zimbra%40sfu.ca.

[Mark Jordan]

I wonder if there is a default security policy in your tomcat config that limits access to sole - anyone know if that's the default case?

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/4B55C1D28471794C811F425520B7B22566E6A33F%40ITS-HCWNEM104.ds.vanderbilt.edu.

[Mark Jordan]

Solr, not sole. Autocorrect.

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/9e93e504-95fa-4c90-891c-b692c0b4e1a9%40email.android.com.

[Poulter, Dale]

The strange thing is that I did not make any changes to solr – only to gsearch.  Tomcat is running on port 8080 with both solr and gsearch.

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/032236f4-a371-436d-8377-4fdf6a717ba1%40email.android.com.

[Mark Jordan]

Dale, in case you haven't worked out access to Solr, here's a URL template you can use with curl from the server that should confirm whether or not you have MODS data in our Solr:

curl "http://localhost:8080/solr/collection1/select?q=*%3A*&wt=xml&indent=true"

Mark

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/4B55C1D28471794C811F425520B7B22566E6A3BC%40ITS-HCWNEM104.ds.vanderbilt.edu.

[Poulter, Dale]

Thank you this helped.  It appears I do not have all of MODS being pulled in.  Here are the only two references to MODS in the output.

 

 

    <arr name="dsmd_MODS.Content-Type">

      <str>application/xml</str>

    </arr>

    <arr name="ds.MODS">

      <str>

 

 

 

-Dale

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/1577135633.293695407.1520533728619.JavaMail.zimbra%40sfu.ca.

[bse...@amherst.edu]

In case it is helpful, I just spent a day or two figuring out how to get the MODS data into Solr.  I'm using the discovery garden config you're using as well. 

It finally started to work when I changed this line in the foxmlToSolr.xslt (https://github.com/discoverygarden/basic-solr-config/blob/modular/foxmlToSolr.xslt#L230):

<xsl:with-param name="content" select="document(concat($PROT, '://', encoder:encode($FEDORAUSER), ':', encoder:encode($FEDORAPASS), '@', $HOST, ':', $PORT, '/fedora/objects/', $PID, '/datastreams/', @ID, '/content'))"/>

To this: 

<xsl:with-param name="content" select="exts:getDatastreamXML($PID,$REPOSITORYNAME, @ID, $FEDORASOAP, $FEDORAUSER, $FEDORAPASS, $TRUSTSTOREPATH, $TRUSTSTOREPASS)"/>

I started seeing MODS data in solr after that change when fedoragsearch to reindex.

(Many thanks to Diego -- I found this in an earlier email on this list that he wrote). 

-Bethany

[dp...@metro.org]

Cool Bethany, happy you got it working!  I wonder if its time to have a canonical Islandora repo for this? Nothing fancy but a config that works out of the box and that can be extended then via the more complete DGI one. I have been changing this before moving a year and a half to the US and still, people are confronted with this XACML issue 

Best

Diego Pino

Metro.org

[Bethany Seeger]

Yes – I think that would be a good idea.  I thought MODS would work “out of the box” and was surprised when it didn’t.  That being said, I’m new to Islandora 7, so I don’t really know how many folks work with MODS and would want that ability from the get go.  I imagine quite a few, but don’t really know.

It might be on the site somewhere, but the flip side could be including more description about what you do get indexed by default when installing Solr & Gsearch on the Milestone 6 page (https://wiki.duraspace.org/display/ISLANDORA/milestone+6+-+Installing+Solr+and+Gsearch)

I had missed the small warning box about indexing specific datastreams and needing the DGI code for more datastreams, assuming that MODS was just going to be indexed by default.    The install pages are rich with content (good stuff!) and could maybe just use a little more info.  

-Bethany

From: <isla...@googlegroups.com> on behalf of "dp...@metro.org" <dp...@metro.org>
Reply-To: "isla...@googlegroups.com" <isla...@googlegroups.com>
Date: Monday, April 9, 2018 at 9:27 AM
To: islandora <isla...@googlegroups.com>
Subject: [islandora] Re: Islandora MODS

Cool Bethany, happy you got it working!  I wonder if its time to have a canonical Islandora repo for this? Nothing fancy but a config that works out of the box and that can be extended then via the more complete DGI one. I have been changing this before moving a year and a half to the US and still, people are confronted with this XACML issue 

Best

Diego Pino

Metro.org

On Friday, April 6, 2018 at 3:28:47 PM UTC-4, bse...@amherst.edu wrote:

In case it is helpful, I just spent a day or two figuring out how to get the MODS data into Solr.  I'm using the discovery garden config you're using as well. 

It finally started to work when I changed this line in the foxmlToSolr.xslt (https://github.com/discoverygarden/basic-solr-config/blob/modular/foxmlToSolr.xslt#L230):

<xsl:with-paramname="content"select="document(concat($PROT, '://', encoder:encode($FEDORAUSER), ':', encoder:encode($FEDORAPASS), '@', $HOST, ':', $PORT, '/fedora/objects/', $PID, '/datastreams/', @ID, '/content'))"/>

To this: 

<xsl:with-param name="content" select="exts:getDatastreamXML($PID,$REPOSITORYNAME, @ID, $FEDORASOAP, $FEDORAUSER, $FEDORAPASS, $TRUSTSTOREPATH, $TRUSTSTOREPASS)"/>

I started seeing MODS data in solr after that change when fedoragsearch to reindex.

(Many thanks to Diego -- I found this in an earlier email on this list that he wrote). 

-Bethany

On Wednesday, March 7, 2018 at 5:12:09 PM UTC-5, Dale Poulter wrote:

Good afternoon,

 

After reading many posts about adding MODs to our index and display we have been attempting to do so using the Discovery Garden gsearch.  However, we cannot seem to get the process to work.  Here is what we have done:

 

1-      Installed the basic-solr-config (https://github.com/discoverygarden/basic-solr-config)

2-      Added the gsearch extensions (https://github.com/discoverygarden/dgi_gsearch_extensions)

3-      Installed the gsearch from https://github.com/discoverygarden/gsearch

4-      Edited the foxmlToSolr.xslt to include the needed templates and correct the file paths.

 

Tomcat starts ok and indexing appears to occur but I am unable to view the mods fields.  Thank you for any assistance.

 

 

 

 

--Dale

 

---------------------------------------
Dale Poulter

Director

Library Technology and Digital Services
Vanderbilt University

419 21st Avenue South, Office 812 
Nashville, TN  37203-2427
(615)343-5388
(615)207-9705 (cell)
dale.p...@vanderbilt.edu

 

--

For more information about using this group, please read our Listserv Guidelines: http://islandora.ca/content/welcome-islandora-listserv
---
You received this message because you are subscribed to the Google Groups "islandora" group.
To unsubscribe from this group and stop receiving emails from it, send an email to islandora+...@googlegroups.com.
Visit this group at https://groups.google.com/group/islandora.

To view this discussion on the web visit https://groups.google.com/d/msgid/islandora/798d885b-3090-4d9d-8390-fe93229e054b%40googlegroups.com.