Rebuilding indexes

[McGranahan, Jamen (VU)]

We noticed in our Archivematica -> Archival storage area that all of our files are missing. I thought it would be a simple rebuild of the index, so I ran the rebuild command, but it finishes with this:

 

Command ran as Archivematica user on Archivematica server:

bash -c " \

    set -a -e -x

    source /etc/default/archivematica-dashboard || \

    source /etc/sysconfig/archivematica-dashboard || \

(echo 'Environment file not found'; exit 1)

    cd /usr/share/archivematica/dashboard

    /usr/share/archivematica/virtualenvs/archivematica/bin/python manage.py rebuild_aip_index_from_storage_service";

 

Results in:

Rebuilding 'aips' and 'aipfiles' indices

Error indexing package 01303fff-28da-4292-ab19-258a70f73f8b. Details: Start tag expected, '<' not found, line 1, column 1 (METS.01303fff-28da-4292-ab19-258a70f73f8b.xml, line 1)

Error indexing package 4d25a560-3fe5-4739-857e-d7275c2449d2. Details: Start tag expected, '<' not found, line 1, column 1 (METS.4d25a560-3fe5-4739-857e-d7275c2449d2.xml, line 1)

Error indexing package 1387590b-684f-428a-b081-56f02f1194aa. Details: Start tag expected, '<' not found, line 1, column 1 (METS.1387590b-684f-428a-b081-56f02f1194aa.xml, line 1)

Error indexing package e433bb68-387f-4be8-95f9-318d21fc5484. Details: Start tag expected, '<' not found, line 1, column 1 (METS.e433bb68-387f-4be8-95f9-318d21fc5484.xml, line 1)

Error indexing package 8f1073bd-63f9-4e00-b6ee-1546cee94792. Details: Start tag expected, '<' not found, line 1, column 1 (METS.8f1073bd-63f9-4e00-b6ee-1546cee94792.xml, line 1)

Error indexing package ec108fba-2c68-4f35-a2be-2b012db57326. Details: Start tag expected, '<' not found, line 1, column 1 (METS.ec108fba-2c68-4f35-a2be-2b012db57326.xml, line 1)

Error indexing package e266f1f0-7c87-4b31-8b70-08905fad986c. Details: Start tag expected, '<' not found, line 1, column 1 (METS.e266f1f0-7c87-4b31-8b70-08905fad986c.xml, line 1)

Error indexing package 80403541-17c8-4966-bfcd-f96107e7ae80. Details: Start tag expected, '<' not found, line 1, column 1 (METS.80403541-17c8-4966-bfcd-f96107e7ae80.xml, line 1)

Error indexing package 3fd02792-52eb-40a1-b244-7c6f9ebb81b4. Details: Start tag expected, '<' not found, line 1, column 1 (METS.3fd02792-52eb-40a1-b244-7c6f9ebb81b4.xml, line 1)

Error indexing package 2182d1e9-9d71-4137-892d-c91cf7098769. Details: Start tag expected, '<' not found, line 1, column 1 (METS.2182d1e9-9d71-4137-892d-c91cf7098769.xml, line 1)

Error indexing package 503ab9d9-66e3-40c8-87ab-49402267680c. Details: Start tag expected, '<' not found, line 1, column 1 (METS.503ab9d9-66e3-40c8-87ab-49402267680c.xml, line 1)

Error indexing package d99d85af-6c2b-4d97-954b-67a77816169a. Details: Start tag expected, '<' not found, line 1, column 1 (METS.d99d85af-6c2b-4d97-954b-67a77816169a.xml, line 1)

Error indexing package aaccdd0e-83aa-4f37-a98f-ade71dc4d936. Details: Start tag expected, '<' not found, line 1, column 1 (METS.aaccdd0e-83aa-4f37-a98f-ade71dc4d936.xml, line 1)

Error indexing package 349353c9-581c-4d03-8cb5-d95ecf5af662. Details: Start tag expected, '<' not found, line 1, column 1 (METS.349353c9-581c-4d03-8cb5-d95ecf5af662.xml, line 1)

Error indexing package bfb0ec31-0fac-4ecb-ae28-5a5a33fb8b1b. Details: Start tag expected, '<' not found, line 1, column 1 (METS.bfb0ec31-0fac-4ecb-ae28-5a5a33fb8b1b.xml, line 1)

Error indexing package 0482e1f4-f233-4256-9b5f-6698195f5371. Details: Start tag expected, '<' not found, line 1, column 1 (METS.0482e1f4-f233-4256-9b5f-6698195f5371.xml, line 1)

Error indexing package 3bad0124-cc21-46d7-84d7-dad453f1d1dd. Details: Start tag expected, '<' not found, line 1, column 1 (METS.3bad0124-cc21-46d7-84d7-dad453f1d1dd.xml, line 1)

Error indexing package 46f37a5b-3164-4cc2-ab3e-57718bca9372. Details: Start tag expected, '<' not found, line 1, column 1 (METS.46f37a5b-3164-4cc2-ab3e-57718bca9372.xml, line 1)

Error indexing package ab963d22-d670-4973-8a7d-220eb4164957. Details: Start tag expected, '<' not found, line 1, column 1 (METS.ab963d22-d670-4973-8a7d-220eb4164957.xml, line 1)

Cleaning up

Indexing complete. Indexed 0 of 19 AIPs/AICs. Packages not indexed: 01303fff-28da-4292-ab19-258a70f73f8b, 4d25a560-3fe5-4739-857e-d7275c2449d2, 1387590b-684f-428a-b081-56f02f1194aa, e433bb68-387f-4be8-95f9-318d21fc5484, 8f1073bd-63f9-4e00-b6ee-1546cee94792, ec108fba-2c68-4f35-a2be-2b012db57326, e266f1f0-7c87-4b31-8b70-08905fad986c, 80403541-17c8-4966-bfcd-f96107e7ae80, 3fd02792-52eb-40a1-b244-7c6f9ebb81b4, 2182d1e9-9d71-4137-892d-c91cf7098769, 503ab9d9-66e3-40c8-87ab-49402267680c, d99d85af-6c2b-4d97-954b-67a77816169a, aaccdd0e-83aa-4f37-a98f-ade71dc4d936, 349353c9-581c-4d03-8cb5-d95ecf5af662, bfb0ec31-0fac-4ecb-ae28-5a5a33fb8b1b, 0482e1f4-f233-4256-9b5f-6698195f5371, 3bad0124-cc21-46d7-84d7-dad453f1d1dd, 46f37a5b-3164-4cc2-ab3e-57718bca9372, ab963d22-d670-4973-8a7d-220eb4164957.

 

 

 

Jamen McGranahan Associate Director of Library Technology & Digital Services, Vanderbilt Library Vanderbilt University 615.343.1614 | jamen.mc...@vanderbilt.edu | https://www.library.vanderbilt.edu/ Central Library, 419 21st Avenue South Nashville, TN 37203 Pronouns: he/him/his

 

 

[McGranahan, Jamen (VU)]

Disregard – I figured it out. I needed to run the other rebuild command:

 

bash -c " \

    set -a -e -x

    source /etc/default/archivematica-dashboard || \

    source /etc/sysconfig/archivematica-dashboard || \

(echo 'Environment file not found'; exit 1)

    cd /usr/share/archivematica/dashboard

    /usr/share/archivematica/virtualenvs/archivematica/bin/python manage.py rebuild_elasticsearch_aip_index_from_files /apps/ArchivematicaData/sharedDirectory/www/AIPsStore";

 

That worked and now our Archival storage has been repopulated.

--
You received this message because you are subscribed to the Google Groups "archivematica" group.
To unsubscribe from this group and stop receiving emails from it, send an email to archivematic...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/BN7PR08MB5235516E2244F04993186182E8C59%40BN7PR08MB5235.namprd08.prod.outlook.com.

[Sarah Romkey]

Well that must be a relief ;) Thanks for reporting back on the solution Jamen.

-S.

Sarah Romkey, MAS,MLIS

Archivematica Program Manager

She/her
Artefactual Systems
604-527-2056

@archivematica / @accesstomemory

To view this discussion on the web visit https://groups.google.com/d/msgid/archivematica/BN7PR08MB5235C543C619245D22EDD432E8C59%40BN7PR08MB5235.namprd08.prod.outlook.com.

[Tatiana Canelhas]

Hi,

what happend if you cant use the  build_elasticsearch_aip_index_from_files, because your aip_store is not on localfilesystem? Best way is to use rebuild_aip_index_from_storage_service.
Does anyone know?

Thanks,

Tatiana Canelhas