Backup software that uses s3ql

[Jeffrey Chan]

Hi guys,

I currently use Backupninja + duplicity to backup my web server VMs to S3. Backupninja makes it easy to do scheduling and define backup sets. Is there any backup software that uses s3ql that does the same thing (mount the s3 filesystem, create snapshots and perform scheduled backup, all automated and runs off of a config file)?

[Nikolaus Rath]

Why do you need one program that does all this?

I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
to update them. The configuration is contained in the script that calls
s3qlcp and rsync.


Best,

-Nikolaus

--
�Time flies like an arrow, fruit flies like a Banana.�

PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6 02CF A9AD B7F8 AE4E 425C

[David Gasaway]

On Mon, Sep 17, 2012 at 2:35 PM, Nikolaus Rath <Niko...@rath.org> wrote:
> Why do you need one program that does all this?
>
> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
> to update them. The configuration is contained in the script that calls
> s3qlcp and rsync.

Well, if someone wanted, they could take s3ql_backup.sh and make it an
action in a backupninja job, as well. That would still get you an
easier way to sequence other actions in the job, and unified reporting
(I think). Or you could break up s3ql_backup.sh into actions, but let
backupninja handle the rsync setup. Backupninja makes it easier to
define backup sets with lots of include/exclude patterns, IMO.

--
-:-:- David K. Gasaway
-:-:- Email: da...@gasaway.org

[David Gasaway]

[BAH! I just realized I sent this earlier reply to OP instead of the list...]

With backupninja, you can add shell script steps to mount/unmount
s3ql. Then you just need to copy the files to the s3ql filesystem.
Any of backupninja's backup back-ends, including duplicity, should
work fine.

[Nikolaus Rath]

Have you checked the rsync manpage (starting with "FILTER RULES")? rsync
can use separate rule files, and the syntax allows pretty complicated
rules as well (if one so desires). I'd be surprised if Backupninja can
do a better job here.

[Dave Holland]

On Mon, Sep 17, 2012 at 05:35:16PM -0400, Nikolaus Rath wrote:
> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
> to update them. The configuration is contained in the script that calls
> s3qlcp and rsync.

Would you be willing to share your script please?

I have a (fairly crufty) script which serves my specific purposes it
so isn't suitable as a drop-in without modification, but I'd be happy
to share it if it might help anyone else. Equally if I can learn a
trick from someone else's solution, or they can point out a bug in my
script, that sounds good to me.

Cheers,
Dave

[Nikolaus Rath]

On 09/18/2012 05:26 AM, Dave Holland wrote:
> On Mon, Sep 17, 2012 at 05:35:16PM -0400, Nikolaus Rath wrote:
>> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
>> to update them. The configuration is contained in the script that calls
>> s3qlcp and rsync.
>
> Would you be willing to share your script please?

Sure, it's at
https://code.google.com/p/s3ql/source/browse/contrib/s3ql_backup.sh

[David Gasaway]

On Tue, Sep 18, 2012 at 2:13 AM, Nikolaus Rath <Niko...@rath.org> wrote:

> Have you checked the rsync manpage (starting with "FILTER RULES")? rsync
> can use separate rule files, and the syntax allows pretty complicated
> rules as well (if one so desires). I'd be surprised if Backupninja can
> do a better job here.

Actually, I prefer rdiff-backup. Anyway, I'm not trying to say that
backupninja does it "better". If a person would rather roll custom
rsync rules and commands, there's shell actions. The rest of the
backupninja framework is still there. Or not. :)