Has anyone used the Getty TGN as a source for an Authority/Choice Plugin?

140 views
Skip to first unread message

Hardy Pottinger

unread,
May 30, 2017, 9:43:12 PM5/30/17
to DSpace Technical Support
I'm working on a repository for which our PI would like us to use the Getty TGN (Getty Thesaurus of Geographic Names) [1] as part of the submission form, for dc.coverage.spatial. I will probably end up using a small subset of the TGN, because the XML for the complete set weighs in at 160MB. However, that's a big job in an of itself... so... I'm wondering if either anyone has done something similar, *or* have you written a plugin to use the online version of the TGN? If you have, would you mind sharing your work? We'd be ever so grateful. Thanks!

On a related note, I bet we could fill out the example controlled vocabularies configuration for DSpace [2] with many more examples. That would be a great contribution to DSpace 7, and it's not dependent on a UI, so it would be a great thing to contribute *right now*.

helix84

unread,
May 31, 2017, 7:01:12 AM5/31/17
to Hardy Pottinger, DSpace Technical Support
On Wed, May 31, 2017 at 3:43 AM, Hardy Pottinger
<hardy.p...@gmail.com> wrote:
> On a related note, I bet we could fill out the example controlled
> vocabularies configuration for DSpace [2] with many more examples. That
> would be a great contribution to DSpace 7, and it's not dependent on a UI,
> so it would be a great thing to contribute *right now*.

Here's another possible addition in case someone is interested
in writing the XSLT:

https://jira.duraspace.org/browse/DS-3610


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Pascarelli Luigi Andrea

unread,
May 31, 2017, 7:12:12 AM5/31/17
to Hardy Pottinger, DSpace Technical Support

For our GLAM application based on DSpace-CRIS (https://dspace-glam.4science.it/) we have developed and released on github the Getty TGN integration using the authority framework, please see

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/GettyAuthority.java

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/TGNAuthority.java

Hope this helps.

Regards,

Luigi Andrea

--
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To post to this group, send email to dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come spam.


-- 
Luigi Andrea Pascarelli

DSpace and DSpace-CRIS Committer

4Science,  www.4science.it 

office: Via Edoardo D'Onofrio 304, 00155 Roma, Italy
tel: +39 333 934 1782
skype: l_a_p82
linkedin: luigiandreapascarelli

an Itway Group Company 
Italy, France, Spain, Portugal, Greece, Turkey, Lebanon, Qatar, U.A.Emirates

====================================
Save a tree. Don't print this e-mail unless it's really necessary.

DISCLAIMER: The information contained in this message is confidential, can be legally protected by local Laws, 
and must be exclusively used by the recipient. The publication, use, distribution, printing or unauthorized copy 
of the content of this message is strictly forbidden and it can be illegal. If you received this message by mistake, 
please destroy it and notify it to the sender.

-- 
This message has been checked by Libra ESVA and is believed to be clean.

Hardy Pottinger

unread,
May 31, 2017, 8:17:50 PM5/31/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Thanks, Luigi Andrea! I have looked into porting this over to our 6x-based repository, however I can see I need to make some modifications, since the getMatches method has changed from 5x to 6x:

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/GettyAuthority.java#L126


Since I'm a very lazy developer, I will ask before I start on the migration process if you have already migrated this code to 6x?


--Hardy


On Wed, May 31, 2017 at 6:12 AM, Pascarelli Luigi Andrea <LuigiAndrea...@4science.it> wrote:

For our GLAM application based on DSpace-CRIS (https://dspace-glam.4science.it/) we have developed and released on github the Getty TGN integration using the authority framework, please see

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/GettyAuthority.java

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/TGNAuthority.java

Hope this helps.

Regards,

Luigi Andrea

Il 31/05/2017 03:43, Hardy Pottinger ha scritto:
I'm working on a repository for which our PI would like us to use the Getty TGN (Getty Thesaurus of Geographic Names) [1] as part of the submission form, for dc.coverage.spatial. I will probably end up using a small subset of the TGN, because the XML for the complete set weighs in at 160MB. However, that's a big job in an of itself... so... I'm wondering if either anyone has done something similar, *or* have you written a plugin to use the online version of the TGN? If you have, would you mind sharing your work? We'd be ever so grateful. Thanks!

On a related note, I bet we could fill out the example controlled vocabularies configuration for DSpace [2] with many more examples. That would be a great contribution to DSpace 7, and it's not dependent on a UI, so it would be a great thing to contribute *right now*.

--
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech+unsubscribe@googlegroups.com.

To post to this group, send email to dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come spam.

Pascarelli Luigi Andrea

unread,
Jun 1, 2017, 8:44:02 AM6/1/17
to Hardy Pottinger, DSpace Technical Support

Dear Hardy,

I'm working to the migration of DSpace-CRIS 6 based on DSpace 6.x, it is an unstable version and I kept private the branch.

Maybe time has come to share with community...

Here the link to the GettyAuthority on DSpace-CRIS 6.x: https://github.com/4Science/DSpace/blob/dspace-6_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/GettyAuthority.java

Thank you very much.

Regards,

Luigi Andrea
-- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com. To post to this group, send email to dspac...@googlegroups.com. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.

-- Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto. Clicca qui per segnalarlo come spam.

Hardy Pottinger

unread,
Jun 1, 2017, 10:12:56 AM6/1/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Thank you so much! I can confirm that this version of the TGN & Getty Authority plugin code compiles cleanly with our fork of DSpace 6x. I'm looking forward to configuring it and testing it out later this morning.

If you don't mind my suggesting it, this would make an excellent addition to DSpace 7.0, please do consider submitting a pull request for it.

--Hardy

-- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech+unsubscribe@googlegroups.com. To post to this group, send email to dspac...@googlegroups.com. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.

-- Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto. Clicca qui per segnalarlo come spam.

Hardy Pottinger

unread,
Jun 1, 2017, 6:21:57 PM6/1/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Hi, I ran into a problem after configuring this plugin. Here's what I saw in the dspace.log file

2017-06-01 13:00:45,228 ERROR org.dspace.core.LegacyPluginServiceImpl @ No named plugins found for interface=org.dspace.content.authority.ChoiceAuthority
2017-06-01 13:00:45,229 WARN  org.dspace.core.LegacyPluginServiceImpl @ Cannot find named plugin for interface=org.dspace.content.authority.ChoiceAuthority, name="TGNAuthority"
2017-06-01 13:00:45,229 WARN  org.dspace.content.authority.ChoiceAuthorityServiceImpl @ Skipping invalid configuration for choices.plugin.dc.coverage.spatial because named plugin not found: TGNAuthority

I had forgotten a bit of configuration farther up in dspace.cfg, I set this up:

#####  Authority Control Settings  #####
plugin.named.org.dspace.content.authority.ChoiceAuthority = \
org.dspace.content.authority.TGNAuthority = TGNAuthority, \

and now the form loads correctly. However, even though I have a lookup button on the form, it does not appear to work, and there are no errors in dspace.log. Any ideas?

--Hardy


On Thu, Jun 1, 2017 at 9:12 AM, Hardy Pottinger <hardy.p...@gmail.com> wrote:
Thank you so much! I can confirm that this version of the TGN & Getty Authority plugin code compiles cleanly with our fork of DSpace 6x. I'm looking forward to configuring it and testing it out later this morning.

If you don't mind my suggesting it, this would make an excellent addition to DSpace 7.0, please do consider submitting a pull request for it.

--Hardy

Hardy Pottinger

unread,
Jun 2, 2017, 2:47:32 PM6/2/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Another point of data: it looks like there is a Javascript error on this form, I'll investigate a bit more, and will copy/paste the error if I can't figure it out.

Hardy Pottinger

unread,
Jun 2, 2017, 4:27:51 PM6/2/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Here is the error: 

submit:305 Uncaught SyntaxError: Invalid or unexpected token

line 305 is:

<span id="aspect_submission_StepTransformer_field_dc_coverage_spatial_confidence_indicator" class="ds-authority-confidence glyphicon btn-xs cf-blank " title="untranslated">&nbsp;</span><input class="ds-authority-value hidden " type="text" readonly name="dc_coverage_spatial_authority" id="aspect_submission_StepTransformer_field_dc_coverage_spatial_authority" value="" onChange="javascript: return DSpaceAuthorityOnChange(this, 'aspect_submission_StepTransformer_field_dc_coverage_spatial_confidence','');"><input type="hidden" class="ds-authority-confidence-input" name="dc_coverage_spatial_confidence" id="aspect_submission_StepTransformer_field_dc_coverage_spatial_confidence" value="blank"><input class="pull-right ds-button-field btn btn-default ds-add-button" name="lookup_dc_coverage_spatial" type="button" value="Lookup" onClick="javascript:DSpaceChoiceLookup('/xmlui/admin/lookup', 'dc_coverage_spatial', 'aspect_submission_StepTransformer_div_submit-describe', 'dc_coverage_spatial', 'dc_coverage_spatial_authority', 'aspect_submission_StepTransformer_field_dc_coverage_spatial_confidence_indicator', 72af0269-cc2c-4b0b-ae19-4a47e5aa7c72, false, false);">

And now that I've tried to parse through that line, I think I see it: the UUID (72af0269....) is not quoted. I suspect this is from a Handlebars template, I'll look and see.

I'll just mention that DS-3387/DSPR#1573 addressed a similar problem with the ORCID lookup. So... perhaps a template was missed in that fix?

--Hardy

Hardy Pottinger

unread,
Jun 2, 2017, 4:55:01 PM6/2/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Oh, it's not handlebars, it's in the XSLT, here it is in Mirage2

https://github.com/DSpace/DSpace/blob/dspace-6_x/dspace-xmlui-mirage2/src/main/webapp/xsl/aspect/general/choice-authority-control.xsl#L74-L82

That probably worked fine when our IDs were integers.

Hardy Pottinger

unread,
Jun 4, 2017, 7:31:17 AM6/4/17
to Pascarelli Luigi Andrea, DSpace Technical Support
Jira issue: https://jira.duraspace.org/browse/DS-3611 and my tiny PR: https://github.com/DSpace/DSpace/pull/1764

I've said thanks privately, but let me just say publicly that this lookup is really cool, and exactly what our PI was asking for. Thank you so much, Luigi Andrea, for sharing it with us. Please do consider contributing it for DSpace 7.0.

--Hardy

euler

unread,
Feb 28, 2020, 11:50:34 PM2/28/20
to DSpace Technical Support
Hi Luigi Andrea,

Thank you for sharing the code for Getty TGN integration, I've implemented it on one of the repositories I'm maintaining. I have a question though. The TGNAuthority lookup seems to limit its search of placeType to inhabited places only (http://vocab.getty.edu/aat/300008347) [1]. Would it be possible to also include other placeTypes like landscapes or bodies of water. For example, if I search for "Manila", the lookup works perfectly, but I have no search results when I tried "Manila Bay". Or, is there some configuration that I may have missed?

[1] https://github.com/4Science/DSpace/blob/dspace-6_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/TGNAuthority.java#L22

Thanks again and regards,
euler


On Wednesday, May 31, 2017 at 7:12:12 PM UTC+8, Pascarelli Luigi Andrea wrote:

For our GLAM application based on DSpace-CRIS (https://dspace-glam.4science.it/) we have developed and released on github the Getty TGN integration using the authority framework, please see

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/GettyAuthority.java

https://github.com/4Science/DSpace/blob/dspace-5_x_x-cris/dspace-api/src/main/java/org/dspace/content/authority/TGNAuthority.java

Hope this helps.

Regards,

Luigi Andrea

Il 31/05/2017 03:43, Hardy Pottinger ha scritto:
I'm working on a repository for which our PI would like us to use the Getty TGN (Getty Thesaurus of Geographic Names) [1] as part of the submission form, for dc.coverage.spatial. I will probably end up using a small subset of the TGN, because the XML for the complete set weighs in at 160MB. However, that's a big job in an of itself... so... I'm wondering if either anyone has done something similar, *or* have you written a plugin to use the online version of the TGN? If you have, would you mind sharing your work? We'd be ever so grateful. Thanks!

On a related note, I bet we could fill out the example controlled vocabularies configuration for DSpace [2] with many more examples. That would be a great contribution to DSpace 7, and it's not dependent on a UI, so it would be a great thing to contribute *right now*.

--
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspac...@googlegroups.com.

To post to this group, send email to dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come spam.

David Bigwood

unread,
Mar 2, 2020, 11:00:04 AM3/2/20
to DSpace Technical Support
It would need to include Extraterrestrial Places for it to be of value to us. Thanks.

David Bigwood
Regional Planetary Image Facility/Library
Lunar and Planetary Institute

euler

unread,
Aug 31, 2023, 1:56:40 AM8/31/23
to DSpace Technical Support
Dear Luigi Andrea,

I want to ask if you have migrated the GettyAuthority and the VIAFAuthority code to work for DSpace 7.x? I tried to migrate the code but I'm not really sure if my migration is correct. In our production servers running 6.x, we rely heavily on these Authority plugins as a way to maintain good metadata quality. Unfortunately, some features like editing the metadata via lookup have not been ported yet to 7.x. (https://github.com/DSpace/dspace-angular/issues/1758)

Thanks in advance!

Regards,
euler



To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To post to this group, send email to dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


--
Questo messaggio e' stato analizzato con Libra ESVA ed e' risultato non infetto.
Clicca qui per segnalarlo come spam.


-- Luigi Andrea Pascarelli DSpace and DSpace-CRIS Committer 4Science, www.4science.it office: Via Edoardo D'Onofrio 304, 00155 Roma, Italy tel: +39 333 934 1782 skype: l_a_p82 linkedin: luigiandreapascarelli an Itway Group Company Italy, France, Spain, Portugal, Greece, Turkey, Lebanon, Qatar, U.A.Emirates ==================================== Save a tree. Don't print this e-mail unless it's really necessary. DISCLAIMER: The information contained in this message is confidential, can be legally protected by local Laws, and must be exclusively used by the recipient. The publication, use, distribution, printing or unauthorized copy of the content of this message is strictly forbidden and it can be illegal. If you received this message by mistake, please destroy it and notify it to the sender.

--  This message has been checked by Libra ESVA and is believed to be clean.

Reply all
Reply to author
Forward
0 new messages