I have a fair bit of data that I don’t need to access with any real frequency, but it must be available, and available reasonably quickly (within an hour or two) when I need it. Lots of backup archives for client files, etc.
My default MO back in the day was to burn a CD/DVD for each client and put them in a binder. Lately I’ve switched to just buying either internal or external hard drives, and disconnecting them as necessary.
I almost have to believe that a hard drive sitting in a box, only connected for a few hours a month, will probably last until the technology moves on and the drive interface is obsolete.
But is there a better way? Or am I already about as efficient as it gets, price-for-value wise?
Maybe 4 or 5 terabytes, periodically rotating as new data gets added and old snapshots get thinned.
There’s also an equivalent amount of personal data (old video files, etc.) that’s not nearly as critical. In that case I really do just want something that’s more of a “treat this like a burned DVD and put the disk in when necessary” sort of thing.
Secondary copy on Backblaze (I connect the drives enough to be “verified”), with the upgraded 1-year retention. And this is data the customers are also responsible for having their own copies of, so consequence of loss would be less than if I had some sort of agreement with them to warehouse their data.
I’ve heard ZFS is sketchy over USB. Do you have any experience with it?
A Diskstation would be ideal for this use. Load up the seldom used data and have it sit there ready to go wherever/whenever you need it. Set up it in RAID to help reduce worry of bit rot and gain some redundancy. Also it makes a great Time Machine destination.
Three drawbacks though. The first is backing it up can be difficult. BackBlaze won’t do it unless you pay for a business plan I believe, but there are other options to look into. It’s usually too big just to back it up to another drive.
Time is the next big obstacle. Once it’s set up, you don’t need to think about it, but there is a learning curve to it. You need to learn the software and the correct way to set up everything. It’s going to take several hours to get everything set up.
Lastly, they aren’t cheap. You probably want a 4 drive system, and that’s going to run you $600-1,000 (I have not looked at prices recently though). It should last you years. You might lose a drive occasionally, but if it’s set up in RAID, just swap out the drive.
I believe it is still susceptible to bit rot. The drive needs to read/write every so often or you could lose it.
Sorry for the confusion, I quoted you because you mentioned Diskstations, but I was saying it would be a good fit for @webwalrus. It sounds like you already got things down @JohnAtl.
As for Time Machine, I am same, I don’t rely on it, everything is backed up elsewhere, but it’s nice for the “what happened to that file?” cases. Not that I needed that very often over the years. It’s a just in case.
I wouldn’t trust a single drive for anything. The infrequent data needs the same sort of backup strategy of any other data. I use multiple rotating backups, physical and cloud, with at least one of the physical copies always offsite. I’ve got files going back nearly 40 years.
This situation sounds like our requirements for some files at work. Hard drives in a good, heavy fire safe plus a copy on Glacier serve us well. Glacier’s egress costs are significant but would be paid by insurance in the event of loss of the safe. Glacier’s durability claims are also much stronger than B2’s. Glacier retrieval times tend to take about as long as someone going to the safe. Since these are archives of wrapped up projects, we don’t require any continuous sync solution.
What I switched to recently was using an old Mac mini as a server holding backups for all our computers as well as our archive and media files. That Mini is backed up locally and to BackBlaze. About 3tb of data. Changing my drive enclosure to raid would provide additional fault tolerance but not something that I need right now. Total cost was negligible, few hundred for used Mini, hundred for enclosure, already had 4tb drives, monitor, keyboard, etc.
I haven’t used them. I only saw them yesterday as a passing comment on reddit. I currently don’t have anything that would burn them either, as I have no computers with a disc drive! However, I’m investigating, as it could prove a way of getting rid of a number of items, and could be a good way of archiving some family photos.
I have my original media so I quit backing up my ripped movies and music. That leaves less than 1TB of critical data which gets backed up hourly to Backblaze B2 and nightly to a external USB drive. An addition copy of everything older than 12 months is kept on AWS Glacier. My yearly cost is less than I spend on 2 months of entertainment and I don’t have to worry about ‘bit rot’, drive failures, etc.
I figure if JPL and NASA trusts AWS, my stuff is safer with them than me.