Digital object load

165 views
Skip to first unread message

brzic...@gmail.com

unread,
Nov 23, 2018, 4:01:25 PM11/23/18
to AtoM Users
I get this when using the CLI :


innopac@atom:/usr/share/nginx/atom$ sudo php symfony digitalobject:load /home/innopac/Desktop/CSV.csv
[sudo] password for innopac:
>> Load digital objects from /home/innopac/Desktop/CSV.csv...
(Nov 23, 01:00:08 PM) Loading 'V-000035-Dealing With Dobis.mp4' (1 of 1)

  Couldn't find related information object for digital object

I have attached the .csv file

Thanks

CSV.csv

Dan Gillean

unread,
Nov 26, 2018, 11:51:55 AM11/26/18
to ica-ato...@googlegroups.com
Hi there, 

Is this the identifier, or the information object ID for your description? Can you search in the user interface for the identifier and find the description? 

The tricky thing about using the identifier is that it's possible it's not unique in AtoM. I'd *really* like this task to support a slug column instead, since that is always unique and doesn't require accessing the database to find the object ID, but that will require further development and so far no one in our community has prioritized its sponsorship. 

In the meantime, I do recommend using the information_object_id column instead, as you are more likely to get better results. The docs include a brief tutorial on how to use SQL to find the object ID for your description. I would recommend trying that and seeing if it helps?

Cheers, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory


--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/6ff71724-21c4-4632-8e3f-f3799744e03b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

brzic...@gmail.com

unread,
Nov 26, 2018, 12:20:43 PM11/26/18
to AtoM Users
That did it . Using information_object_id had the object load....

It says I should update the search index manually....could I have done :

php symfony digitalobject:load /path/to/your/loadfile.csv search:populate

or is it better to just update the search index later ?

Thanks

Dan Gillean

unread,
Nov 26, 2018, 12:54:11 PM11/26/18
to ica-ato...@googlegroups.com
Glad it worked out! 

You can't combine the index command in that specific way that you mentioned, but you could do 2 things. 

The first would be to use the --index option built into the task itself. For one-off loads like this, it's a great option, because it will update the index in real-time for the parts of the data affected, so you don't have to reindex the entire site. You can do so by running the command like this: 
  • php symfony digitalobject:load --index /path/to/your/upload-file.csv
If you are loading a lot of objects at once, however, I would recommending indexing at the very end as a separate command. Indexing as the task progresses slows the task considerably, and can consume more memory - for a very big load, this could  in the best case just make everything take a lot longer, and in the worst case exhaust your available system resources and crash the task mid-import. 

Note that you can chain commands together in the command-line using && to separate the commands. So you could also do the following: 
  • php symfony digitalobject:load  /path/to/your/upload-file.csv && php symfony search:populate
However, this will jump immediately to the index repopulation after the load task completes, which - if the load fails for some reason, could be run unnecessarily. Generally for larger loads, I'd recommend just waiting for the load task to complete, making sure everything went well, and then running the index task separately. 

Regards, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory
--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

brzic...@gmail.com

unread,
Nov 26, 2018, 1:30:54 PM11/26/18
to AtoM Users
Thanks for that. Is there a way to attach more than one digital object ?


Dan Gillean

unread,
Nov 26, 2018, 1:41:06 PM11/26/18
to ica-ato...@googlegroups.com
Hi again, 

Not to the same description. Instead, we recommend creating sub-item levels of description, and attaching them there. 

In AtoM, there is a 1:1 relationship between a digital object (e.g. a digital file, like an image, PDF, sound or video file, etc. that you upload), and an information object (a generic word for an archival description in AtoM). This means that only 1 digital object can ever be attached to a description at a time.

We maintain this 1:1 relationship because in the database, we only associate technical metadata with the digital object itself - information such as original filename, size in MB, date uploaded, type of file, etc. All descriptive metadata (such as a title, a description, an extent statement, etc) is always kept with the descriptive record - AKA the information object. All this to say, there is no way to attach 2 or more images to the same description. 

What you CAN do instead is create lower levels of description - AtoM places no restrictions on how deep a hierarchy you arrange, and the levels of description are maintained in a user-editable taxonomy of terms, so you can edit them, delete ones you don't need, or add new ones as you need. If you need to associate multiple files (say, images) with a single item-level description (let's say photos of different sides of a single physical object), you can create lower-level descriptions below the item, and give them a custom level of description. We include "Part" as an example level of description you can use as a sub-item level (for example, individually scanned pages of a book), but you could create others - for example, you might use "View" if you are showing off images showing different sides of a single physical object, or "Component," "Page," etc. 

AtoM will also display a carousel of lower-level digital objects at the parent level (unless you've turned off the carousel in the settings), so if you added an item-level description, then created a bunch of sub-item levels with individual digital objects, users browsing the item would be able to quickly scroll through the lower-level parts using the carousel. 

Regards, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

On Mon, Nov 26, 2018 at 1:30 PM <brzic...@gmail.com> wrote:
Thanks for that. Is there a way to attach more than one digital object ?


--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To post to this group, send email to ica-ato...@googlegroups.com.
Visit this group at https://groups.google.com/group/ica-atom-users.

colle...@cumberlandmuseum.ca

unread,
Jun 27, 2019, 7:33:30 PM6/27/19
to AtoM Users
Hi Dan, 

When creating a "view" level in the hierarchy as you mention - would you suggest that the "view" record have an identifier and other fields filled out? or is it sufficient to just include title proper: "side view of___" for example and leave it at that? Not sure if it is ideal to have descriptions without identifiers if they are just lower levels of another record? 

I hope that makes sense. 

Thanks!

-Melissa


On Monday, November 26, 2018 at 10:41:06 AM UTC-8, Dan Gillean wrote:
Hi again, 

Not to the same description. Instead, we recommend creating sub-item levels of description, and attaching them there. 

In AtoM, there is a 1:1 relationship between a digital object (e.g. a digital file, like an image, PDF, sound or video file, etc. that you upload), and an information object (a generic word for an archival description in AtoM). This means that only 1 digital object can ever be attached to a description at a time.

We maintain this 1:1 relationship because in the database, we only associate technical metadata with the digital object itself - information such as original filename, size in MB, date uploaded, type of file, etc. All descriptive metadata (such as a title, a description, an extent statement, etc) is always kept with the descriptive record - AKA the information object. All this to say, there is no way to attach 2 or more images to the same description. 

What you CAN do instead is create lower levels of description - AtoM places no restrictions on how deep a hierarchy you arrange, and the levels of description are maintained in a user-editable taxonomy of terms, so you can edit them, delete ones you don't need, or add new ones as you need. If you need to associate multiple files (say, images) with a single item-level description (let's say photos of different sides of a single physical object), you can create lower-level descriptions below the item, and give them a custom level of description. We include "Part" as an example level of description you can use as a sub-item level (for example, individually scanned pages of a book), but you could create others - for example, you might use "View" if you are showing off images showing different sides of a single physical object, or "Component," "Page," etc. 

AtoM will also display a carousel of lower-level digital objects at the parent level (unless you've turned off the carousel in the settings), so if you added an item-level description, then created a bunch of sub-item levels with individual digital objects, users browsing the item would be able to quickly scroll through the lower-level parts using the carousel. 

Regards, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory


On Mon, Nov 26, 2018 at 1:30 PM <brzic...@gmail.com> wrote:
Thanks for that. Is there a way to attach more than one digital object ?


--
You received this message because you are subscribed to the Google Groups "AtoM Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ica-ato...@googlegroups.com.

Dan Gillean

unread,
Jul 8, 2019, 5:50:37 PM7/8/19
to ICA-AtoM Users
Hi Melissa, 

Sorry for the delay, I've been out of office. I think this is entirely up to you! AtoM is extremely permissive - you can create a description with no title, no identifier, etc - so if you don't want to add anything, it won't break anything or prevent you from exporting your data in the future. 

If you're using reference code inheritance, you could just add something like v1, v2, etc to each view as the identifier - when this setting is used, AtoM will display the whole inherited reference code, so you would probably end up with a full code like COLLECTIONID-SERIESID-FILEID-ITEMID-v1, etc. 

If you're not using reference code inheritance, you could choose to do the same thing manually - i.e. you could potentially just reapply the parent item-level reference code, but with a v1 or -v1 appended to it. 

The best way to approach this will be to determine a consistent internal practice, and then document this as a policy for any staff / volunteers doing description work, so that your approach remains consistent over time. 

Cheers, 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/6773d54f-282e-401c-9d95-f0126c517a9d%40googlegroups.com.

colle...@cumberlandmuseum.ca

unread,
Jul 9, 2019, 1:49:32 PM7/9/19
to AtoM Users
Thanks for getting back to me Dan! I am not sure if we have reference code inheritance enabled- how can i tell if this is enabled?  If it is will each "view" record need an identifier added?

 I think for ease of use and searching we probably won't add an identifier to each "view" record. We find that method confusing as when you search an accession number the results will show the view record and the item record separately - if someone only clicks on the "view" record they may wonder if it is a duplicate or an incomplete record without the full information about the item which would be in the item record. 

My main concern was that if we didn't add some kind of identifier to the "view" record that it may become an issue within the database but if it can still be exported/ imported i suppose it isn't an issue. would the view and item records remain "Linked" if the data was to be exported and re imported? 
To unsubscribe from this group and stop receiving emails from it, send an email to ica-ato...@googlegroups.com.

Dan Gillean

unread,
Jul 9, 2019, 2:18:25 PM7/9/19
to ICA-AtoM Users
Hi Melissa, 

You can check if reference code inheritance is enabled in Admin > settings. If you are using 2.4 or earlier, I believe this is in the Global settings; in 2.5 it's been moved into the Identifier settings section. See the link included in my last message for more info! 

The hierarchical relations will remain in place whether or not an identifier is present. In the CSV file, these are managed by the legacyID and parentID values; in the EAD XML exports, the entire export is organized hierarchically with nested sections per description. 

Dan Gillean, MAS, MLIS
AtoM Program Manager
Artefactual Systems, Inc.
604-527-2056
@accesstomemory

To unsubscribe from this group and stop receiving emails from it, send an email to ica-atom-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ica-atom-users/d1998e26-7acd-4a84-850f-9cafef43a445%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages