SKOS template/example for importing Places, Subjects, etc? Or some troubleshooting help?

[ty...@lre-tech.com]

Hi all,

I am less familiar with SKOS XML and while there is a depth of very detailed material that I have perused on the specification, I am having trouble coming up with valid XML import files for the simple purpose of importing a set of very basic terms into a taxonomy.

My goal is to import a batch of named Subjects, as well as a batch of named Places.  It also would be nice to be able to import information into Scope note(s), Source note(s), Display note(s), Use for.  But I'm having trouble even just importing any SKOS, attributed to my lack of familiarity with the standard.

Basing SKOS import files on single SKOS exports, I came up with this sort of thing, replacing the real url with (url) and a named item with (x) for the sake of demonstrating the concepts.  It does not import, nor do versions with various tag sections removed.  If anyone has any sort of template for importing a batch of Subjects and Places, it would be very helpful, or even just some direction as to where I'm going wrong. 

Also, do the URLs in "<skos:Concept rdf:about="(url)/(x)">" get automatically created when being imported?  And am I correct in assuming that importing an SKOS with multiple <skos:Concept> tags will import multiple Places (or Subjects).

===========

<?xml version="1.0" encoding="utf-8" ?>
<rdf:RDF
  xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
  xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"
  xmlns:skos="http://www.w3.org/2004/02/skos/core#"
  xmlns:dc="http://purl.org/dc/elements/1.1/">

  <skos:ConceptScheme rdf:about="(url)/places">

                  <dc:title xml:lang="ca">Llocs</dc:title>
                        <dc:title xml:lang="de">Orte</dc:title>
                        <dc:title xml:lang="en">Places</dc:title>
                        <dc:title xml:lang="es">Lugares</dc:title>
                        <dc:title xml:lang="fa">مكان ها</dc:title>
                        <dc:title xml:lang="fr">Lieux</dc:title>
                        <dc:title xml:lang="gl">Lugares</dc:title>
                        <dc:title xml:lang="id">Tempat</dc:title>
                        <dc:title xml:lang="it">Luoghi</dc:title>
                        <dc:title xml:lang="ja">場所</dc:title>
                        <dc:title xml:lang="ka">ადგილები</dc:title>
                        <dc:title xml:lang="ko">장소</dc:title>
                        <dc:title xml:lang="nl">Plaatsen</dc:title>
                        <dc:title xml:lang="pl">Miejsca</dc:title>
                        <dc:title xml:lang="pt">locais</dc:title>
                        <dc:title xml:lang="pt_BR">locais</dc:title>
                        <dc:title xml:lang="sl">Kraji</dc:title>
                        <dc:title xml:lang="th">สถานที</dc:title>
         
          <skos:hasTopConcept rdf:resource="(url)"/>
   
  </skos:ConceptScheme>

    <skos:Concept rdf:about="(url)/(x)">

                        <skos:prefLabel xml:lang="en">(x)</skos:prefLabel>
             
     
      <skos:inScheme rdf:resource="(url)/places"/>

============

Alternatively, any simple example of a valid SKOS that can be imported into Atom would be extremely valuable.

Thank you very much.

[Dan Gillean]

Hi Tyler,

The AtoM SKOS implementation is fairly basic - I'm sure there is plenty more RDF complexity you could have in a SKOS file that is not currently supported in AtoM. For reference, I am attaching a SKOS file of Places I created in AtoM and managed to roundtrip (export, delete in AtoM, reimport successfully) using AtoM 2.0.1.

It's some silly test data based on the Canadian province of Alberta, but I have tried in some of the top-level terms to include related terms, alternate labels, scope notes, etc.

As you can see in the attached example, you are correct - multiple <skos:Concept> elements will import multiple terms.

I have discovered that the Source notes will not roundtrip - they are not exported with the description. Upon re-import, the URL of the source of the export is automatically added to the Source notes field - in this case, the same URL that the resource appeared at after being deleted and reimported. Our source field in the template is a free-text multi-value field, so this appears to be a bug. I forgot to add Display notes in the test set to test the behavior of those, but I'll try to look into it further soon.

We have a "code" field in the template as well, which does not export -  this is a feature that was added in an early version of 1.x and not maintained or developed further, but if you add lat/long coordinates to the field, a static Google map will be generated when the record is saved. Unfortunately this data can't be roundtripped at the moment.

Information on working with terms in AtoM can be found here: https://www.accesstomemory.org/docs/2.0/user-manual/add-edit-content/terms/#terms

I haven't yet had a chance to add new documentation for imports (I'm getting there!).

I think the idea of having a CSV template for importing Places/Subjects is a very good one, which I would love to see developed for AtoM. If you are a developer, or have access to one, and intend to tackle this, feel free to ask for further help in the User Forum! Alternatively, if your institution is interested in sponsoring the development of such a template, please feel free to contact me off-list, and Artefactual can always prepare a quote for you.

In the meantime, my hope is that using the attached sample as a template, you'll be able to create a SKOS xml file that you can successfully import into your AtoM instance.

Hope that helps!

Regards,

Dan Gillean, MAS, MLIS
AtoM Product Manager / Systems Analyst,
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

--
You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at http://groups.google.com/group/ica-atom-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/4cf2581e-1780-4656-bc9a-1c707310f4e1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[ty...@lre-tech.com]

Thanks Dan!

I appreciate this very much.  Right off the bat, do you know what would cause this error?

===
Fatal error: Call to a member function __get() on a non-object in /mnt/atom-hosting/rbcm/atom-de7b13ac31a82e2492aa7e060ea1bcc9a2f7871b/lib/model/om/BaseObject.php on line 483
===

What modifications would be needed on this XML file to be imported on any Atom instance?  Changing the root of the address (http://2x.test.artefactual.com/) to match the instance it's being imported to?  I tried that which yielded the same error.  I am using the SKOS Import page.

[Dan Gillean]

Hello again Tyler,

You got that error from attempting to import the sample SKOS file I sent? The 2x URL shouldn't be the cause - this is just meant to point back to the original source of the file. I will have to ask a developer to take a look - but in the meantime, have you tried performing the import in Debug mode, to see if you can get a more verbose error report? Debug mode still works the same in AtoM 2.

To my untrained eyes, it appears to be a PHP error, so you might also try using a phpinfo() - see here.

On Monday I will try to ping a developer to take a look. If you discover anything more in the meantime, let us know!

Dan Gillean, MAS, MLIS
AtoM Product Manager / Systems Analyst,
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

--

You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at http://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/295f4256-fc8e-40e7-875c-28df9d69f3ed%40googlegroups.com.

[ty...@lre-tech.com]

Yes, that is correct, I get that error using the file you sent. 

This is possibly a separate issue, but I am not able to enable debug mode using the second option in that link (which it would appear is my only option since I am accessing the server remotely).  I am able to change the "false" to "true" but for some reason when it is "true", index.php will not load and is just perpetually loading in my browser.  When reverting back to index.php with "false" it loads fine. 

Let me know if you have any ideas and thank you as always for the help, I appreciate it very much.

Tyler

[Hutchinson, Tim]

Hi Tyler,

 

In terms of debug mode, you can also edit the qubit_dev.php file to add your IP address to the $allowedIPs list. After doing that you’ll need to clear the cache:

php symfony cc

 

(No, helpful Outlook autocorrect, I really do mean symfony)

 

Tim

--

You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at http://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/74b6fa0d-01b4-4241-ab4b-580c02b69a62%40googlegroups.com.

[ty...@lre-tech.com]

Thank you Tim,

I was able to access domain/qubit_dev.php using the information that you provided in modifying the file.  This "front controller" remained in the URL as I navigated to upload an XML file, selected SKOS, etc. 

However, importing the file resulted in the same error as before, completely identical and with no additional information.  I can see the debug mode toolbar, is there anything in the log that would help identify the issue?

Tyler

[Hutchinson, Tim]

Hi Tyler,

 

If you didn’t get a stack trace, I’m afraid I don’t know my way around the debug interface. Hopefully someone can assist further.

 

Tim

 

From: ica-ato...@googlegroups.com [mailto:ica-ato...@googlegroups.com] On Behalf Of ty...@lre-tech.com
Sent: April-07-14 4:44 PM
To: ica-ato...@googlegroups.com
Subject: Re: [ica-atom-users] SKOS template/example for importing Places, Subjects, etc? Or some troubleshooting help?

 

Thank you Tim,

--

You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at http://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/84b028b8-34f4-4fcb-9f34-26740dbf897f%40googlegroups.com.

[Mike G]

( ! ) Fatal error: Call to a member function __get() on a non-object in /home/mikeg/workspace/atom2.0.1/lib/model/om/BaseObject.php on line 483
Call Stack
#	Time	Memory	Function	Location
1	0.0000	644344	{main}( )	../qubit_dev.php:0
2	0.1257	8101272	sfContext->dispatch( )	../qubit_dev.php:21
3	0.1257	8101352	sfFrontWebController->dispatch( )	../sfContext.class.php:170
4	0.1258	8114744	sfController->forward( )	../sfFrontWebController.class.php:48
5	0.1331	8370480	sfFilterChain->execute( )	../sfController.class.php:238
6	0.1333	8372568	QubitTransactionFilter->execute( )	../sfFilterChain.class.php:53
7	0.1333	8372568	sfFilterChain->execute( )	../QubitTransactionFilter.class.php:40
8	0.1335	8374576	sfHistoryPluginFilter->execute( )	../sfFilterChain.class.php:53
9	0.1336	8374576	sfFilterChain->execute( )	../sfHistoryPluginFilter.class.php:18
10	0.1338	8376576	sfRenderingFilter->execute( )	../sfFilterChain.class.php:53
11	0.1338	8376576	sfFilterChain->execute( )	../sfRenderingFilter.class.php:33
12	0.1340	8378640	QubitSettingsFilter->execute( )	../sfFilterChain.class.php:53
13	0.1344	8445408	sfFilterChain->execute( )	../QubitSettingsFilter.class.php:43
14	0.1346	8447408	QubitLimitIpFilter->execute( )	../sfFilterChain.class.php:53
15	0.1347	8448312	sfFilterChain->execute( )	../QubitLimitIp.class.php:39
16	0.1349	8450320	QubitSslRequirementFilter->execute( )	../sfFilterChain.class.php:53
17	0.1350	8450400	sfFilterChain->execute( )	../QubitSslRequirementFilter.class.php:35
18	0.1352	8452392	QubitMeta->execute( )	../sfFilterChain.class.php:53
19	0.1353	8453480	sfFilterChain->execute( )	../QubitMeta.class.php:29
20	0.1355	8455480	QubitLimitResults->execute( )	../sfFilterChain.class.php:53
21	0.1356	8456112	sfFilterChain->execute( )	../QubitLimitResults.class.php:34
22	0.1358	8458112	sfExecutionFilter->execute( )	../sfFilterChain.class.php:53
23	0.1359	8459624	sfExecutionFilter->handleAction( )	../sfExecutionFilter.class.php:42
24	0.1359	8459624	sfExecutionFilter->executeAction( )	../sfExecutionFilter.class.php:78
25	0.1360	8459704	sfSkosPluginImportAction->execute( )	../sfExecutionFilter.class.php:92
26	0.2843	10756264	sfSkosPlugin::parse( )	../importAction.class.php:92
27	0.3033	10805952	sfSkosPlugin->addTerm( )	../sfSkosPlugin.class.php:81
28	0.3034	10809464	BaseTerm->__set( )	../BaseTerm.php:0
29	0.3034	10811392	call_user_func_array ( )	../BaseTerm.php:948
30	0.3034	10812008	QubitObject->__set( )	../BaseTerm.php:0
31	0.3034	10813624	call_user_func_array ( )	../QubitObject.php:93
32	0.3034	10814240	BaseObject->__set( )	../QubitObject.php:0

Hi guys, here's a stack trace of the issue. This is a bug in AtoM 2.0.1 I believe, but has since been fixed in 2.x (Dan has confirmed it works in 2.x). I unfortunately don't have time to debug this right now, but you may be able to see where it was fixed in the 2.x github repository history. Either way, we highly recommend if you're doing custom AtoM development to start from the latest (2.x).

Cheers

On Monday, April 7, 2014 3:55:43 PM UTC-7, Tim Hutchinson wrote:

Hi Tyler,

 

If you didn’t get a stack trace, I’m afraid I don’t know my way around the debug interface. Hopefully someone can assist further.

 

Tim

 

From: ica-ato...@googlegroups.com [mailto:ica-ato...@googlegroups.com] On Behalf Of ty...@lre-tech.com
Sent: April-07-14 4:44 PM
To: ica-ato...@googlegroups.com
Subject: Re: [ica-atom-users] SKOS template/example for importing Places, Subjects, etc? Or some troubleshooting help?

 

Thank you Tim,

I was able to access domain/qubit_dev.php using the information that you provided in modifying the file.  This "front controller" remained in the URL as I navigated to upload an XML file, selected SKOS, etc. 

However, importing the file resulted in the same error as before, completely identical and with no additional information.  I can see the debug mode toolbar, is there anything in the log that would help identify the issue?

Tyler

--
You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.

To post to this group, send email to ica-at...@googlegroups.com.

[ty...@lre-tech.com]

Thanks Mike!

It's nice to confirm that all my issues were not stemming from improper SKOS XML but rather AtoM itself.  I am concerned with switching AtoM versions since the one that has been tested and demoed was 2.0.1 (trying to avoid "I don't like this new feature, this isn't what we were shown" type comments).  If it's as easy as swapping in a couple of files from 2.x, that would be ideal.  I poked around the commits page and don't see anything.  Searching the issues page for "line 483" doesn't seem to bring anything up either.  I believe this is the last "outstanding issue" on our list thanks to the help on this group and email correspondence with David.  I will continue to see if I can find when/how it was solved but I must humbly admit that a tiny bit of help would be extremely useful.  If my approach in this is incorrect, please let me know.

Tyler

[Mike G]

Hey Tyler,

For what it's worth, I tried the SKOS file against on 2.0.1 last night on a different system and it worked. The main difference I could see is the system that failed was running PHP 5.3.10 vs. the one that worked, running PHP 5.4.6. It might be worth a shot upgrading your PHP if it's an older version.

Cheers

[David Juhasz]

Hi Mike,

I merged a fix (made by you) to the stable/2.0.x branch of AtoM on Wednesday, which I believe resolved the import error for Tyler:
https://github.com/artefactual/atom/commit/e393fc8a6e977a8b554112b644a1e3b92c9886bc

Sorry, I should have posted this back to the discussion sooner.

Regards,
David

--



David Juhasz
Director, AtoM Technical Services

Artefactual Systems Inc.
www.artefactual.com

--

You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.

To post to this group, send email to ica-ato...@googlegroups.com.

Visit this group at http://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/8bfea6f4-2a19-40ce-a4ac-e2088390201f%40googlegroups.com.

[ty...@lre-tech.com]

Hi all,

So I have been able to get Dan's Alberta information in.  I am continuing this thread because I would like to follow up with questions relating to the original topic as posted.

So I'm revisiting the SKOS import and I've identified the following tags result in the following fields (this does not include the correct order or hierarchy but is otherwise clear):
<skos:Concept rdf:about="Source Notes"> - Source Notes
<skos:prefLabel xml:lang="en">Name</skos:prefLabel> - Name
<skos:altLabel xml:lang="en">Use for</skos:altLabel> - Use for
<skos:scopeNote xml:lang="en">Scope Note</skos:scopeNote> - Scope Note

What about Code or Display note(s)?  Does anyone know the tags for these?  And one last question, is it possible to import a Places or Subjects XML file from the command line?  If so, what is the syntax? 

I have seen this:
https://www.qubit-toolkit.org/wiki/XML_import/export#Command-line_import_of_XML_files
And this:
https://groups.google.com/forum/#!topic/ica-atom-users/UJK83-w1B98

But both seem to refer to older versions and I am unclear of how to specify Places or Subjects based on this.

Thanks in advance!

Tyler

[Sarah Romkey]

Hi Tyler,

First an apology for the delay replying to your question!

I am just learning more about SKOS myself, but from what I understand, there are no SKOS classes for Code or Display note (see: http://www.w3.org/TR/skos-reference/#L7130) which is why you will not see them when you export an SKOS file from AtoM, and unfortunately I do not believe there would be no method of importing these fields either.

Regarding the bulk XML imports, I'm just waiting on word from our developers about whether that information is still valid- I'll get back to you soon.

Cheers,

Sarah

[Dan Gillean]

Hi Tyler,

You'll find a more complete explanation of the current use of the code field here: https://www.accesstomemory.org/docs/2.0/user-manual/add-edit-content/terms/#term-data-entry

As Sarah has pointed out, it's not something covered by SKOS. At the moment, neither is display note - in fact, this field in AtoM is apprarently particular to to the Events taxonomy - see the note below the field in the above link.

Regards,

Dan Gillean, MAS, MLIS
AtoM Product Manager / Systems Analyst,
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

--

You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at http://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/43cd872b-4af4-455a-bf04-f332227d9067%40googlegroups.com.

[ty...@lre-tech.com]

Thank you Sarah and Dan.  This is a helpful answer that provides me with the certainty I needed when pondering this.  It is not immediately apparent which fields may be imported and which may not without a template or documentation, but I understand this is being worked on and I think that until then, I think this forum thread will provide AtoM users with the answers they're looking for, as it has helped me.  Thanks again.

[Dan Gillean]

Hi Tyler,

Belatedly following up on the bulk XML import instructions:

I have double-checked with the developers, and the instructions you referenced on the Qubit wiki are the same in 2x - though 2.0.1 actually includes a new option parameter that may be of use to you for Places imports:

you can use same commands to import SKOS files, and the new option --taxonomy to specify the taxonomy into which you would like your terms to import (if no taxonomy is specified, then Subjects is the default).

Note that the taxonomy must be specified not by name, but by ID - you can find a list of the taxonomy IDs here:
https://github.com/artefactual/atom/blob/2.x/lib/model/QubitTaxonomy.php#L22

So for example, the places taxonomy ID is 42 - so to run a SKOS import that would target the Places taxonomy, you might express it like so:

$ php symfony import:bulk --taxonomy=42

... followed by the path to your SKOS file or folder of SKOS files, as per the instructions on the wiki.

Regards (and sorry for the delay),

Dan Gillean, MAS, MLIS
AtoM Product Manager / Systems Analyst,
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

On Wed, May 21, 2014 at 1:58 PM, <ty...@lre-tech.com> wrote:

Thank you Sarah and Dan.  This is a helpful answer that provides me with the certainty I needed when pondering this.  It is not immediately apparent which fields may be imported and which may not without a template or documentation, but I understand this is being worked on and I think that until then, I think this forum thread will provide AtoM users with the answers they're looking for, as it has helped me.  Thanks again.

--

You received this message because you are subscribed to the Google Groups "ICA-AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at http://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/dcf9b0d6-4c80-49ed-b7ed-45b13f6b9e6b%40googlegroups.com.