Fedora backup and restore
60 views
Skip to first unread message
Rebecca Ciota
Apr 21, 2021, 2:29:44 PM4/21/21
to Fedora Community
How are people backing up (and restoring) their repositories? We're
looking for a new way of doing it. I'm exploring BagIt, but it doesn't
look like anyone has tried a restore with BagIt. What are other ways to
backup and restore objects in a Fedora repository?
Scott Prater
Apr 21, 2021, 5:22:18 PM4/21/21
to fedora-c...@googlegroups.com
Hello, Rebecca —
What version of Fedora are you using? The past three versions all store their data is different ways.
— Scott
Scott Prater
Digital Library Architect
UW Digital Collections Center
University of Wisconsin - Madison
On Apr 21, 2021, at 1:29 PM, Rebecca Ciota <reci...@colorado.edu> wrote:
How are people backing up (and restoring) their repositories? We're looking for a new way of doing it. I'm exploring BagIt, but it doesn't look like anyone has tried a restore with BagIt. What are other ways to backup and restore objects in a Fedora repository? --
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com.
Rebecca Ciota
Apr 21, 2021, 5:48:19 PM4/21/21
to fedora-c...@googlegroups.com
We're in FEDORA 3.
From: 'Scott Prater' via Fedora Community <fedora-c...@googlegroups.com>
Sent: Wednesday, April 21, 2021 3:22 PM
To: fedora-c...@googlegroups.com <fedora-c...@googlegroups.com>
Subject: Re: [fedora-community] Fedora backup and restore
Sent: Wednesday, April 21, 2021 3:22 PM
To: fedora-c...@googlegroups.com <fedora-c...@googlegroups.com>
Subject: Re: [fedora-community] Fedora backup and restore
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu.
Rebecca Ciota
Apr 21, 2021, 5:55:55 PM4/21/21
to fedora-c...@googlegroups.com
FEDORA 3.8.1, to be exact.
From: fedora-c...@googlegroups.com <fedora-c...@googlegroups.com> on behalf of Rebecca Ciota <Rebecc...@colorado.edu>
Sent: Wednesday, April 21, 2021 3:48 PM
Sent: Wednesday, April 21, 2021 3:48 PM
To view this discussion on the web visit
https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com.
Scott Prater
Apr 22, 2021, 10:25:51 AM4/22/21
to fedora-c...@googlegroups.com
Fedora 3 stores all its data as plain old files on disk; for backup, you can simply backup the objects/ and datastreams/ directories, and you'll have everything (one of the nice features of Fedora 3, that has been carried forward to Fedora 6, is the ability to rebuild your repository entirely from data on disk).
Are you considering organizing the files in a BagIt structure for preservation purposes? Are you looking for something a little more human-friendly than the Fedora 3 directory structure? FWIW, Fedora file storage is based on OCFL, which is very similar to BagIt, but with versioning included.
-- Scott
--
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com <https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> .
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu <https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> .
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
Are you considering organizing the files in a BagIt structure for preservation purposes? Are you looking for something a little more human-friendly than the Fedora 3 directory structure? FWIW, Fedora file storage is based on OCFL, which is very similar to BagIt, but with versioning included.
-- Scott
--
Scott Prater
Digital Library Architect
UW Digital Collections Center
University of Wisconsin - Madison
Digital Library Architect
UW Digital Collections Center
University of Wisconsin - Madison
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com <https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu <https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
Rebecca Ciota
Apr 22, 2021, 11:02:27 AM4/22/21
to fedora-c...@googlegroups.com
Hello Scott,
We have been backing up the objects/ and datastores/ - but as you've mentioned they aren't human-friendly.
We recently had an issue where objects were deleted, and we wanted to restore
only those files. However, since the Fedora files aren't really human-readable we couldn't do it. We also learned that if we are backing up the entire objects/ and datastores/ for restoring they need to be in hot storage, because we learned that it would
take AWS Glacier about a year to deliver our 1.2T repository backup. If we had the individual objects in a more human-readable format, it would be faster to pull those from storage. (The human-readable part is why I was looking at BagIt.)
Regards,
Rebecca
From: 'Scott Prater' via Fedora Community
Sent: Thursday, April 22, 2021 8:25 AM
To: fedora-c...@googlegroups.com
Subject: RE: [fedora-community] Fedora backup and restore
To: fedora-c...@googlegroups.com
Subject: RE: [fedora-community] Fedora backup and restore
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR06MB32220442A7E3605F70DB294EFF469%40CY4PR06MB3222.namprd06.prod.outlook.com.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR06MB32220442A7E3605F70DB294EFF469%40CY4PR06MB3222.namprd06.prod.outlook.com.
Gerhard Gonter
Apr 22, 2021, 11:15:49 AM4/22/21
to fedora-c...@googlegroups.com
On Wed, Apr 21, 2021 at 11:55 PM Rebecca Ciota
<Rebecc...@colorado.edu> wrote:
> FEDORA 3.8.1, to be exact.
We are at the same version of Fedora and are using IBM's TSM (or
<Rebecc...@colorado.edu> wrote:
> FEDORA 3.8.1, to be exact.
whatever it is currently called), but I'm looking into restic [1] for
additional (off-site) replicas to replace rsync. I have nothing to
report about restic yet. The rsync replicas were used in several
cases to restore Fedora instances after changing Linux distributions.
I assume, restic will also do this trick too and we may try that when
the next instance is to be migrated to another distribution.
* [1] https://restic.net/
regards, Gerhard Gonter
Scott Prater
Apr 22, 2021, 12:02:38 PM4/22/21
to fedora-c...@googlegroups.com
You might want to check out migration-utils: https://github.com/fcrepo-exts/migration-utils
It can take your Fedora 3 repository and export it to an OCFL structure, which you can then store as you like, use it elsewhere, etc. However, there's no backwards crosswalking -- there currently isn't any tool to take an OCFL object and import into Fedora 3. You would have to do that manually.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com <https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com> <https://groups.google.com/d/msgid/fedora-community/7a2312a9-b5f3-435d-b2dc-34934ab6a4f9n%40googlegroups.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> .
--
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com> <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32723324D2B860BBAEC0341998479%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
--
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB3272E29E09853D89D9E96AAF98469%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB3272E29E09853D89D9E96AAF98469%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
It can take your Fedora 3 repository and export it to an OCFL structure, which you can then store as you like, use it elsewhere, etc. However, there's no backwards crosswalking -- there currently isn't any tool to take an OCFL object and import into Fedora 3. You would have to do that manually.
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu <https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu> <https://groups.google.com/d/msgid/fedora-community/92F7E739-28C1-4345-9A64-AD03386BB1D9%40wisc.edu?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com> <https://groups.google.com/d/msgid/fedora-community/CY4PR03MB32720F2A7F9263286E122B2098479%40CY4PR03MB3272.namprd03.prod.outlook.com?utm_medium=email&utm_source=footer> .
--
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
--
You received this message because you are subscribed to a topic in the Google Groups "Fedora Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe <https://groups.google.com/d/topic/fedora-community/HNBxzv2qHso/unsubscribe> .
To unsubscribe from this group and all its topics, send an email to fedora-communi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fedora-community/CY4PR06MB32220442A7E3605F70DB294EFF469%40CY4PR06MB3222.namprd06.prod.outlook.com <https://groups.google.com/d/msgid/fedora-community/CY4PR06MB32220442A7E3605F70DB294EFF469%40CY4PR06MB3222.namprd06.prod.outlook.com> .
--
You received this message because you are subscribed to the Google Groups "Fedora Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fedora-communi...@googlegroups.com <mailto:fedora-communi...@googlegroups.com> .
Reply all
Reply to author
Forward
0 new messages