Amanda versus Bacula and (modern as of 2017) large backup jobs
I use Bacula since about 13 years, and Quantum Superloader LT6 Tape Library since about 3-4 years.
- Is Amanda used for jobs of this magnitude? Is it superseded at this point by Bacula? Is there a compelling reason to use one of the other?
Our backup volume is one 25TB storage, and a few TB other smaller folders. Changes are not big, so incrementals are fast. The biggest problem I have is that one full job with 25TB would take a few days to complete, blocking the other jobs. That means you need to split the job to more manageable junk sizes. LTO-7 is faster but your amount of data is also bigger.
We had Bacula working before and integration of the tape library was not that difficult so we stick with it. I am quite happy with the stability and features, restores are not difficult once you get it. No experience with Amanda, though.
- It almost seems simpler and less risky to just write my own tape-changing logic and tar/dump/dd/rsync invocation script than to rely on massive configuration files with dozens of parameters? Foolhardy or advisable long-term? Do people do this?
Sure you can do it, but Amanda and Bacula have the kinks worked out mostly. Some write a list of files and their checksums in the first blocks, the tar archive after that. Tar can do multi-volume archives out-of-the-box (checked with GNU tar 1.29).
- I want to be able to rotate a subset of tapes out of the autoloader for offsite backup. Will this totally flummox Amanda or Bacula or cause administration headaches?
Yes that certainly works, Bacula has an "update slots" command to update which tapes are in the library. It will tell you at backup time which tape you need to load in case it is missing. We do that for a small backup job and need to change a tape every month out of a pool of 7 tapes. The other 6 are always offsite (offsite and more space in the library). For a restore we bring what we need, but luckily we seldom need a restore.
- Can these systems take advantage of the bar codes I have on the tapes given that the hardware reads the bar codes?
Yes, using "label barcodes storage=LTO6" will use the barcodes to label the tapes. There are websites around to print your own labels.
What I never tried is LTFS, i.e. a file system on tape, maybe combined with rsnapshot could be a feasible alternative.
I strongly suggest to try out all the solutions, and do not be afraid to look at old documentation, a lot is still valid. And do restores!
I've used Amanda for many years now, Bacula more recently. They'll both get the job done. They both have somewhat of a learning curve. Both are very reliable.
I'd say overall, Bacula is a bit easier to configure. Bacula uses MTX for all its tape interface so you can have it do just about anything you want. I use it with Amazon VTL primarily.
Amanda can definitely handle your workload, and I'd argue is a bit more flexible once you've got the hang of it.