SKOSMOS and Getty AAT

102 views
Skip to first unread message

Nicola Carboni

unread,
Jan 17, 2017, 12:04:19 PM1/17/17
to Skosmos Users
Hello, 
I am currently trying Skosmos and I have a few problems using it with the Art and Architecture Thesaurus from Getty. 
I used the guide available on github wiki (https://github.com/NatLibFi/Skosmos/wiki/InstallTutorial) and I got a working installation of Fuseki with the STW and UNESCO thesaurus in it  (in a dataset called skosmos). I added the Iconclass classification in the same dataset, and everything seems working fine (there are a few problems with the interface, but the API work fine). 
Now I wanted to add the Getty AAT. I created a new dataset and uploaded the full AAT export in it. After the usual memory problems, I managed to load everything, and now I have it on fuseki. I added

:aat a skosmos:Vocabulary, void:Dataset ;
    dc:title "AAT"@en ;
    skosmos:shortName "aat";
    dc:subject :cat_general ;
    void:uriSpace "http://vocab.getty.edu";
    skosmos:language "en";
    skosmos:defaultLanguage "en";
    void:sparqlEndpoint <http://localhost:3030/aat/sparql> ;
    skosmos:sparqlGraph <http://vocab.getty.edu> .


in vocabularies.ttl in /var/www/html/Skosmos

and changed the default SPARQL as http://localhost:3030/aat/sparql in setting in /var/www/html/Skosmos/config.inc

Now, if I try to use the API, for example
localhost/Skosmos/rest/v1/search?query=*arc*&vocab=aat or localhost/Skosmos/rest/v1/search?query=arc*&vocab=aat or any other I get 0 results:

{
    "@context": {
        "altLabel": "skos:altLabel",
        "broader": "skos:broader",
        "hiddenLabel": "skos:hiddenLabel",
        "onki": "http://schema.onki.fi/onki#",
        "prefLabel": "skos:prefLabel",
        "results": {
            "@container": "@list",
            "@id": "onki:results"
        },
        "skos": "http://www.w3.org/2004/02/skos/core#",
        "type": "@type",
        "uri": "@id"
    },
    "results": [],
    "uri": ""
}


the other thesaurus work fine though 

@context": {
        "altLabel": "skos:altLabel",
        "broader": "skos:broader",
        "hiddenLabel": "skos:hiddenLabel",
        "onki": "http://schema.onki.fi/onki#",
        "prefLabel": "skos:prefLabel",
        "results": {
            "@container": "@list",
            "@id": "onki:results"
        },
        "skos": "http://www.w3.org/2004/02/skos/core#",
        "type": "@type",
        "uri": "@id"
    },
    "results": [
        {
            "exvocab": "???",
            "lang": "fr",
            "prefLabel": "activités et événements non-miraculeux ~ St Georges",
            "type": [
                "skos:Concept"
            ],
            "uri": "http://iconclass.org/11H%28GEORGE%294",
            "vocab": "ico"
        },
        {
            "exvocab": "???",
            "lang": "fr",
            "prefLabel": "la famille royale de Libye est baptisée par St Georges",
            "type": [
                "skos:Concept"
            ],
            "uri": "http://iconclass.org/11H%28GEORGE%29412",
            "vocab": "ico"
        }

[etc.. ] 
 
Any idea why?
Thanks
Nicola

Osma Suominen

unread,
Jan 18, 2017, 7:10:50 AM1/18/17
to skosmo...@googlegroups.com
Hi Nicola!

How did you load AAT? I guess you didn't do it via the Fuseki UI or
APIs, because that would have taken ages...

My guess is that you have loaded the AAT data into TDB, but not updated
the jena-text index. When you upload via Fuseki it will take care of
both, but if you use the command line tools such as tdbloader or
tdbloader2 then they won't update the jena-text index. You will need to
run jena.textindexer separately. See here:
https://jena.apache.org/documentation/query/text-query.html#step-2-build-the-text-index

Do the other REST methods work for AAT? Only "search" and "lookup" rely
on the text index, other methods should work if you have the data in TDB.

Hope this helps!

-Osma
> --
> You received this message because you are subscribed to the Google
> Groups "Skosmos Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to skosmos-user...@googlegroups.com
> <mailto:skosmos-user...@googlegroups.com>.
> To post to this group, send email to skosmo...@googlegroups.com
> <mailto:skosmo...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/skosmos-users/f903402b-bcbd-4d6d-ad99-ffc5e2908b7d%40googlegroups.com
> <https://groups.google.com/d/msgid/skosmos-users/f903402b-bcbd-4d6d-ad99-ffc5e2908b7d%40googlegroups.com?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.


--
Osma Suominen
D.Sc. (Tech), Information Systems Specialist
National Library of Finland
P.O. Box 26 (Kaikukatu 4)
00014 HELSINGIN YLIOPISTO
Tel. +358 50 3199529
osma.s...@helsinki.fi
http://www.nationallibrary.fi

Nicola Carboni

unread,
Jan 20, 2017, 11:21:15 AM1/20/17
to Skosmos Users
Hi Osma

Thanks for the suggestion! I have to say, I updated the jena-text index but nothing changed (0 updated). At the end I just re-did the process using the interface (it took quite some time, that is true) and re-set everything and it seems working now. For the record I had to increase the HTTP timeout in config.inc.
So it was probably a setting problem!
Thank you for the help! I will also need some aid with the interface (right now, I cannot visualise the terms or mostly anything) but it will probably be more appropriate to open another thread after I put my hands on it! :)

Osma Suominen

unread,
Jan 24, 2017, 11:06:58 AM1/24/17
to skosmo...@googlegroups.com
Hi Nicola!

I'm glad you got it working. The default timeout is indeed quite short
and needs to be increased if your endpoint is slow, for example when you
have a large dataset like this.

-Osma
> <https://github.com/NatLibFi/Skosmos/wiki/InstallTutorial>) and I got a
> > an email to skosmos-user...@googlegroups.com <javascript:>
> > <mailto:skosmos-user...@googlegroups.com <javascript:>>.
> > To post to this group, send email to skosmo...@googlegroups.com
> <javascript:>
> > <mailto:skosmo...@googlegroups.com <javascript:>>.
> <https://groups.google.com/d/msgid/skosmos-users/f903402b-bcbd-4d6d-ad99-ffc5e2908b7d%40googlegroups.com?utm_medium=email&utm_source=footer
> <https://groups.google.com/d/optout>.
>
>
> --
> Osma Suominen
> D.Sc. (Tech), Information Systems Specialist
> National Library of Finland
> P.O. Box 26 (Kaikukatu 4)
> 00014 HELSINGIN YLIOPISTO
> Tel. +358 50 3199529
> osma.s...@helsinki.fi <javascript:>
> http://www.nationallibrary.fi
>
> --
> You received this message because you are subscribed to the Google
> Groups "Skosmos Users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to skosmos-user...@googlegroups.com
> <mailto:skosmos-user...@googlegroups.com>.
> To post to this group, send email to skosmo...@googlegroups.com
> <mailto:skosmo...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/skosmos-users/d728e8e0-516d-4f5c-9dbb-a2e491850016%40googlegroups.com
> <https://groups.google.com/d/msgid/skosmos-users/d728e8e0-516d-4f5c-9dbb-a2e491850016%40googlegroups.com?utm_medium=email&utm_source=footer>.
Reply all
Reply to author
Forward
0 new messages