A Few Updates
Joshua Pinter
I've modified the script (awesome by the way) to do a few extra things
that I think most people will find useful:
1) Automatically backup all domains in /domain/ directory instead of
having the user manually add domains to the script with each new
domain addition.
2) Merged in Christina's database backup code to do SQL dumps of all
databases and then tar them to the database backup directory, using a
similar daily backup rotation as you're using for the domains. (Also,
it checks to see if the database backup directory exists, and if not,
creates it).
3) Allow for splitting of files up into smaller pieces before being
sent off to Amazon S3. This is setup to allow the user to turn this on
or off as well as set the maximum piece size. I was having trouble
with sending large files so I needed this.
Let me know if you're interested in grabbing any of this.
Cheers, and thanks hugely for the script. It's making me very
happy :)
Josh
Brett Wilcox
Sorry not to write back sooner, I was moving and did not have my computer setup.
I am happy to hear that the script is working out for you! I would
love to see the changes that you have made to the script. I have a
few ideas of my own to improving the script and this would be a good
way to get started.
Cheers,
Brett Wilcox
br...@brettwilcox.com
Joshua Pinter
No worries. Hope the move was successful.
Let me clean it up and I'll send it over to you tonight.
I'm keen to hear your ideas as well.
Best
/ JP
Joshua Pinter
Check out the latest script. I modified it to allow me to customize the script so I can split the backup into different cron jobs (as Grid Server restricts each cron job to 15 minutes). Added some additional features, as mentioned.
I made some notes in the versions documentation. Have a look at that. Also, I'm not familiar with RackSpace Cloud so I've only made the online backup mods to the S3 side of things. I'll lean on you for expanding that to the RackSpace cloud since you seem to really know what you're doing there.
Let me know what you think. I'm eager to hear your thoughts.
Best,
/ JP
Joshua Pinter
Still working on that script. These things have a tendency of pulling you in - I'm sure you know what I mean.
Anyway, should be good for tomorrow.
Chat then,
/ JP
On 2010-06-08, at 1:55 PM, Brett Wilcox wrote:
Joshua Pinter
Have you had a chance to look at the zipline modifications. I've made a few updates in the interim as well.
Keen to hear your thoughts.
/ JP
On 2010-06-08, at 1:55 PM, Brett Wilcox wrote:
Brett Wilcox
I have not had a chance to go over the script in detail yet, but it
looks like there have been a LOT of changes to the way it was written
originally and some functions added.
From what I see it looks great! I will have to have to decode what
you have written and see what needs to be added from my own version
that I was working on.
Let me know when you can get the newer version to me. I would like to
see what other changes you have made.
Also, I am currently working on a way to transfer the files without
any dependence on S3Sync software. It will allow you to enter your
key and what bucket you want it to go into.
Cheers,
Brett Wilcox
br...@brettwilcox.com
Joshua Pinter
One of the changes I made was changing from using the S3Sync, which syncs two folders, to just using the S3cmd, which allows you to transfer individual files. I found that the S3Sync wasn't just syncing updated files and instead was syncing all the files in the folder (slowing everything down and increasing the cost on your S3 bill).
Anyway, I've attached the latest version. It's working great on my end.
After you merge the changes, can we get this going on an SVN repo so we don't have to keep transferring files like this?
Look forward to fine tuning it with you Brett! Great work so far. This has provided a huge piece of mind for me.
/ JP