I’m running my own hand-crafted remote backup (rsync++) script to back up data from one machine to another. But, it has some serious drawbacks, and I’m still looking for something better. Here are my requirements:
- Runs on Ubuntu
- Is either:
- Available in the standard distro (i.e. via apt-get)
- A simple self-contained script (Python, Perl, Bash, etc.)
- Uses ssh/scp/rsync to transport files
- Is incremental (i.e. does “what’s changed from last time”, and only backs up that much)
- Handles file renames & moves without re-transmitting the underlying data.
- Puts files in a simple “directory by date” format. No fancy databases, no fancy metadata required for restoring.
- Preserves file permissions & modification dates.
- Correctly handles both hard & soft symbolic links.
- Is client-side only. In other words, I don’t want to have to maintain 2 copies of this script, one for the server, and one for the client.
Is there anything out there that meets these requirements?
http://www.scottlu.com/Content/Link-Backup.html
I mount an s3 bucket locally with fuse and rsync. http://code.google.com/p/s3fs/wiki/FuseOverAmazon
It doesn’t handle renames/moves the way you want and can get pricey but meets the rest of your requirements.
Yeah, I’m basically doing that, but without S3. I’ve got ~500GB of backed up data, and handling moves & renames properly is my biggest feature request at this point…
The issue is that when I upload photos, I like to move them from a “To be uploaded” directory, then into an “I’m done with this” directory. But, doing this move means re-backing up the photos when they move, which can take weeks.