Taxonomy question

[L Snider]

If one has an existing Subjects taxonomy, and we want to add a whole bunch of terms to it, I use the SKOS import. I looked on the site and couldn't find a template, is there one on there?

We have 2.3, so does the browser timeout apply to this upload like the csv ones?

Anything else to know about taxonomy updating (other than having to change Places to Subjects)?

Cheers

Lisa

[Dan Gillean]

Hi Lisa, 

SKOS in 2.3 and earlier expects SKOS RDF XML as the input so there is no template. If you wanted to try to create it manually, I'd suggest exporting some hierarchical terms, and examining the output as a reference. 

In 2.3, SKOS import is still managed synchronously, so yes, unfortunately browser timeout limits do still apply. In 2.4, however, you can use almost any format that SKOS data has been serialized into (e.g. N3, Turtle, etc), and you can use a remote URL instead of a local file upload if desired. The SKOS import in 2.4 is managed by the job scheduler. Initial 2.4 documentation has been added here: 

• https://www.accesstomemory.org/en/docs/2.4/user-manual/import-export/import-export-skos/#import-export-skos
  

In both 2.3 and 2.4, SKOS export is still synchronous - we'll need to do more work to add job scheduler support for the export of terms! It would also be great to see a CSV format supported for taxonomy terms, but again, that will require further development. 

Good luck! 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/CA%2BmtHwb65cCpzG2FUpx6xXA7avt0ctJrjoopQafwEktcK%3D_PSg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[L Snider]

Hi Dan,

Thanks so much.

Cheers

Lisa

On Tue, Aug 8, 2017 at 10:28 AM, Dan Gillean <d...@artefactual.com> wrote:

Hi Lisa, 

SKOS in 2.3 and earlier expects SKOS RDF XML as the input so there is no template. If you wanted to try to create it manually, I'd suggest exporting some hierarchical terms, and examining the output as a reference. 

In 2.3, SKOS import is still managed synchronously, so yes, unfortunately browser timeout limits do still apply. In 2.4, however, you can use almost any format that SKOS data has been serialized into (e.g. N3, Turtle, etc), and you can use a remote URL instead of a local file upload if desired. The SKOS import in 2.4 is managed by the job scheduler. Initial 2.4 documentation has been added here: 

• https://www.accesstomemory.org/en/docs/2.4/user-manual/import-export/import-export-skos/#import-export-skos
  

In both 2.3 and 2.4, SKOS export is still synchronous - we'll need to do more work to add job scheduler support for the export of terms! It would also be great to see a CSV format supported for taxonomy terms, but again, that will require further development. 

Good luck! 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

On Tue, Aug 8, 2017 at 11:21 AM, L Snider <lsn...@gmail.com> wrote:

If one has an existing Subjects taxonomy, and we want to add a whole bunch of terms to it, I use the SKOS import. I looked on the site and couldn't find a template, is there one on there?

We have 2.3, so does the browser timeout apply to this upload like the csv ones?

Anything else to know about taxonomy updating (other than having to change Places to Subjects)?

Cheers

Lisa

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.

To post to this group, send email to ica-ato...@googlegroups.com.

Visit this group at https://groups.google.com/group/ica-atom-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/CA%2BmtHwb65cCpzG2FUpx6xXA7avt0ctJrjoopQafwEktcK%3D_PSg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/CAC1FhZ%2Bhw3FgydkMS_f%3DLXMifBMt3%2BhBqVa2KG4YPgbM6LceLQ%40mail.gmail.com.

[arquivo.a...@gmail.com]

Hello Dan,

I just want to report a problem when trying to import SKOS files on version 2.4.

php symfony import:bulk --taxonomy="42" /path/to/places

php symfony import:bulk --taxonomy="35" /path/to/subjects

This only happens through command-line (CLI) only. I am able to import through web interface.

I'm also having trouble importing archival institutions csv file through CLI. There's no error message, it just tells it imports but it doesn't. I found no issue importing from web interface.

I'm using Ubuntu16.04, installed everything according to the official instructions (using culture: pt). I'm not the only one to have this problem.

Thank you for your support!

To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.

To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/CA%2BmtHwb65cCpzG2FUpx6xXA7avt0ctJrjoopQafwEktcK%3D_PSg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.

To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

[Dan Gillean]

Hi there, 

What is the error that happens when you try to import SKOS files from the command-line?

Regarding the repository CSV import, there could be 2 factors at play. 

The first is that with command-line imports, indexing is disabled by default - so you may need to run the search:populate command before you will see your recent imports. The second issue is that a number of fields were apparently missing in the 2.4.0 repository CSV import. These have been corrected in 2.4.1 - see the related ticket here: 

• https://projects.artefactual.com/issues/10853
  

Cheers, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.

Visit this group at https://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/b754b349-6cde-4bcd-8feb-173ca9982f05%40googlegroups.com.

[arquivo.a...@gmail.com]

The funny thing is that there are no issues importing SKOS from the user interface.

However when using CLI it tells:

Importing 1 files from /home/icaatom/XML/british-columbia;skos.xml (indexing is DISABLED) ...

PHP Fatal error:  Uncaught Error: Call to undefined method sfSkosPlugin::parse() in /usr/share/nginx/atom/lib/QubitXmlImport.class.php:249
Stack trace:
#0 /usr/share/nginx/atom/lib/task/import/importBulkTask.class.php(126): QubitXmlImport->import('/home/icaatom/X...', Array)
#1 /usr/share/nginx/atom/vendor/symfony/lib/task/sfBaseTask.class.php(68): importBulkTask->execute(Array, Array)
#2 /usr/share/nginx/atom/vendor/symfony/lib/task/sfTask.class.php(97): sfBaseTask->doRun(Object(sfCommandManager), NULL)
#3 /usr/share/nginx/atom/vendor/symfony/lib/command/sfSymfonyCommandApplication.class.php(76): sfTask->runFromCLI(Object(sfCommandManager), NULL)
#4 /usr/share/nginx/atom/vendor/symfony/lib/command/cli.php(20): sfSymfonyCommandApplication->run()
#5 /usr/share/nginx/atom/symfony(14): include('/usr/share/ngin...')
#6 {main}
  thrown in /usr/share/nginx/atom/lib/QubitXmlImport.class.php on line 249

Using this SKOS xml file: https://groups.google.com/d/msg/ica-atom-users/aCUFjgYaItA/b8NCfM0OAgAJ

Importing repository CSV through web interface shows no issue. Only through CLI.

[Dan Gillean]

Thank you for sharing these details - it does sound like there could be a bug. I will test to reproduce when I have time, and file an issue accordingly. 

I'll update this thread when I have had an opportunity to test further. 

Regards, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056

@accesstomemory

To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-users+unsubscribe@googlegroups.com.
To post to this group, send email to ica-atom-users@googlegroups.com.

Visit this group at https://groups.google.com/group/ica-atom-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/992c98c0-f0f3-4c07-a249-af81f318a53a%40googlegroups.com.

[Dan Gillean]

Hello again! 

I've done some local testing and I've managed to reproduce the issue you've reported with CLI import for SKOS files. I've opened a ticket here: 

• https://projects.artefactual.com/issues/12364
  

However, I had no issues importing the repository CSV, using the following command, as well as with some variations using some of the available options: 

• php symfony csv:repository-import --index lib/task/import/example/example_repositories.csv
  

This could be something that was fixed between 2.4.0 and 2.4.1. We discovered just after the 2.4.0 release that a number of repository CSV fields were not importing properly in 2.4.0, and the changes and discussion are documented at length on the following ticket: 

• https://projects.artefactual.com/issues/10853
  

You will note that there are a number of pull requests linked on this ticket, as our developers got feedback and implemented changes to ensure everything is working. I think it's possible that the issue you are encountering has been resolved in the upcoming 2.4.1 release?

Thank you again for the reports. 

Regards, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056

@accesstomemory