Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Backup software that uses s3ql
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  8 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Jeffrey Chan  
View profile  
 More options Sep 17 2012, 1:21 pm
From: Jeffrey Chan <goofri...@gmail.com>
Date: Mon, 17 Sep 2012 10:21:13 -0700 (PDT)
Local: Mon, Sep 17 2012 1:21 pm
Subject: Backup software that uses s3ql

Hi guys,

I currently use Backupninja + duplicity to backup my web server VMs to S3.
Backupninja makes it easy to do scheduling and define backup sets. Is there
any backup software that uses s3ql that does the same thing (mount the s3
filesystem, create snapshots and perform scheduled backup, all automated
and runs off of a config file)?


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Nikolaus Rath  
View profile  
 More options Sep 17 2012, 5:35 pm
From: Nikolaus Rath <Nikol...@rath.org>
Date: Mon, 17 Sep 2012 17:35:16 -0400
Local: Mon, Sep 17 2012 5:35 pm
Subject: Re: [s3ql] Backup software that uses s3ql
On 09/17/2012 01:21 PM, Jeffrey Chan wrote:

> I currently use Backupninja + duplicity to backup my web server VMs to
> S3. Backupninja makes it easy to do scheduling and define backup sets.
> Is there any backup software that uses s3ql that does the same thing
> (mount the s3 filesystem, create snapshots and perform scheduled backup,
> all automated and runs off of a config file)?

Why do you need one program that does all this?

I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
to update them. The configuration is contained in the script that calls
s3qlcp and rsync.

Best,

   -Nikolaus

--
  Time flies like an arrow, fruit flies like a Banana.

  PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6  02CF A9AD B7F8 AE4E 425C


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
David Gasaway  
View profile  
 More options Sep 17 2012, 7:44 pm
From: David Gasaway <d...@gasaway.org>
Date: Mon, 17 Sep 2012 16:43:38 -0700
Local: Mon, Sep 17 2012 7:43 pm
Subject: Re: [s3ql] Backup software that uses s3ql

On Mon, Sep 17, 2012 at 2:35 PM, Nikolaus Rath <Nikol...@rath.org> wrote:
> Why do you need one program that does all this?

> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
> to update them. The configuration is contained in the script that calls
> s3qlcp and rsync.

Well, if someone wanted, they could take s3ql_backup.sh and make it an
action in a backupninja job, as well.  That would still get you an
easier way to sequence other actions in the job, and unified reporting
(I think).  Or you could break up s3ql_backup.sh into actions, but let
backupninja handle the rsync setup.  Backupninja makes it easier to
define backup sets with lots of include/exclude patterns, IMO.

--
-:-:- David K. Gasaway
-:-:- Email: d...@gasaway.org


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
David Gasaway  
View profile  
 More options Sep 17 2012, 7:48 pm
From: David Gasaway <d...@gasaway.org>
Date: Mon, 17 Sep 2012 16:48:05 -0700
Local: Mon, Sep 17 2012 7:48 pm
Subject: Re: [s3ql] Backup software that uses s3ql

On Mon, Sep 17, 2012 at 10:21 AM, Jeffrey Chan <goofri...@gmail.com> wrote:
> Hi guys,

> I currently use Backupninja + duplicity to backup my web server VMs to S3.
> Backupninja makes it easy to do scheduling and define backup sets. Is there
> any backup software that uses s3ql that does the same thing (mount the s3
> filesystem, create snapshots and perform scheduled backup, all automated and
> runs off of a config file)?

[BAH!  I just realized I sent this earlier reply to OP instead of the list...]

With backupninja, you can add shell script steps to mount/unmount
s3ql.  Then you just need to copy the files to the s3ql filesystem.
Any of backupninja's backup back-ends, including duplicity, should
work fine.

--
-:-:- David K. Gasaway
-:-:- Email: d...@gasaway.org


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Nikolaus Rath  
View profile  
 More options Sep 18 2012, 5:13 am
From: Nikolaus Rath <Nikol...@rath.org>
Date: Tue, 18 Sep 2012 05:13:22 -0400
Local: Tues, Sep 18 2012 5:13 am
Subject: Re: [s3ql] Backup software that uses s3ql
On 09/17/2012 07:43 PM, David Gasaway wrote:

> On Mon, Sep 17, 2012 at 2:35 PM, Nikolaus Rath <Nikol...@rath.org> wrote:
>> Why do you need one program that does all this?

>> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
>> to update them. The configuration is contained in the script that calls
>> s3qlcp and rsync.

> Well, if someone wanted, they could take s3ql_backup.sh and make it an
> action in a backupninja job, as well.  That would still get you an
> easier way to sequence other actions in the job, and unified reporting
> (I think).  Or you could break up s3ql_backup.sh into actions, but let
> backupninja handle the rsync setup.  Backupninja makes it easier to
> define backup sets with lots of include/exclude patterns, IMO.

Have you checked the rsync manpage (starting with "FILTER RULES")? rsync
can use separate rule files, and the syntax allows pretty complicated
rules as well (if one so desires). I'd be surprised if Backupninja can
do a better job here.

Best,

   -Nikolaus

--
  Time flies like an arrow, fruit flies like a Banana.

  PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6  02CF A9AD B7F8 AE4E 425C


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Dave Holland  
View profile  
 More options Sep 18 2012, 5:26 am
From: Dave Holland <d...@biff.org.uk>
Date: Tue, 18 Sep 2012 10:26:09 +0100
Local: Tues, Sep 18 2012 5:26 am
Subject: Re: [s3ql] Backup software that uses s3ql

On Mon, Sep 17, 2012 at 05:35:16PM -0400, Nikolaus Rath wrote:
> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
> to update them. The configuration is contained in the script that calls
> s3qlcp and rsync.

Would you be willing to share your script please?

I have a (fairly crufty) script which serves my specific purposes it
so isn't suitable as a drop-in without modification, but I'd be happy
to share it if it might help anyone else. Equally if I can learn a
trick from someone else's solution, or they can point out a bug in my
script, that sounds good to me.

Cheers,
Dave


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Nikolaus Rath  
View profile  
 More options Sep 18 2012, 7:51 am
From: Nikolaus Rath <Nikol...@rath.org>
Date: Tue, 18 Sep 2012 07:51:23 -0400
Local: Tues, Sep 18 2012 7:51 am
Subject: Re: [s3ql] Backup software that uses s3ql
On 09/18/2012 05:26 AM, Dave Holland wrote:

> On Mon, Sep 17, 2012 at 05:35:16PM -0400, Nikolaus Rath wrote:
>> I use cron/anacron to schedule the backup, s3qlcp to snapshots and rsync
>> to update them. The configuration is contained in the script that calls
>> s3qlcp and rsync.

> Would you be willing to share your script please?

Sure, it's at
https://code.google.com/p/s3ql/source/browse/contrib/s3ql_backup.sh

Best,

   -Nikolaus

--
  Time flies like an arrow, fruit flies like a Banana.

  PGP fingerprint: 5B93 61F8 4EA2 E279 ABF6  02CF A9AD B7F8 AE4E 425C


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
David Gasaway  
View profile  
 More options Sep 18 2012, 4:15 pm
From: David Gasaway <d...@gasaway.org>
Date: Tue, 18 Sep 2012 13:15:04 -0700
Local: Tues, Sep 18 2012 4:15 pm
Subject: Re: [s3ql] Backup software that uses s3ql

On Tue, Sep 18, 2012 at 2:13 AM, Nikolaus Rath <Nikol...@rath.org> wrote:
> Have you checked the rsync manpage (starting with "FILTER RULES")? rsync
> can use separate rule files, and the syntax allows pretty complicated
> rules as well (if one so desires). I'd be surprised if Backupninja can
> do a better job here.

Actually, I prefer rdiff-backup.  Anyway, I'm not trying to say that
backupninja does it "better".  If a person would rather roll custom
rsync rules and commands, there's shell actions.  The rest of the
backupninja framework is still there.  Or not. :)

--
-:-:- David K. Gasaway
-:-:- Email: d...@gasaway.org


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »