Long storage life curiosity
Long storage life curiosity
Hey guys, I just had a curiosity on the multiple ways of storaging stuff and how long would that hold, take backing it up to a newer storage after some years out of the table.
So how did this come in my mind, I was just reminiscing about how I used to play games with inserting a CD or Cartridge onto the device and how I miss that flavour.
I would like to do it again, I already like having my games dependancy free (praise mr goldmountain), and I am saving up some money to spend on hoarding possibilities. I would like to know what would have the longest storage life, would burning games into bluray discs be too unhinged or is something I am missing?
Thanks in advance in helping me out witht his brainstorm.
Discs aren't very suitable for long term storage. Really the only thing truly suited for long term storage of digital media is archival tape. Which isn't cheap or accessible. The only accessible solution is to keep it alive in a raid and keep rebuilding as disks fail over the years.
Discs aren’t very suitable for long term storage.
M-DISC may well be a good option for long term storage.
Contrary to what people suggested, I would advise against optical discs or tapes and would go with HDDs you check every few months. They don't rot like optical media, the only thing you have to worry about are the motor spindles getting stuck and other mechanical failures.
It will also be the cheapest option. With tapes you need expensive drives and they change the version every few years. Tapes only are better if you store hundreds or thousands of TiB of data.
Which data so you want to save? Mostly games and media? If so, consider giving them to your friends and family to copy and enjoy, which some people call a 'friend backup'.
Most recent iteration of optical media (Blu Ray) doesn't rot. Actually older media didn't rot either if stored properly. I still have 20yr old CDs and DVDs that are usable. And if you're going to let something sit in moisture or dust or whatever, a HDD wont fair that well either.
All form of storage rot, just at varying rates and likelihood of failure after X years. Keeping the data active and checked is the only way to guarantee it will survive over time. But multiple copies across formats will probably be good enough for 99% of cases.
The storage medium you choose really isn't as critical as making multiple copies, storing them in separate physical locations, and testing that you can recover the data when you need it. Diversity in the physical medium you choose is probably a good thing too long term. Archival discs aren't really that long lived though. You could try, but unless you are regularly checking the discs and making additional copies, you're going to loose data eventually. I gave up using discs as any kind of backup because it was too much hassle. Copying hard drives was much more straightforward and reliable.
Optical discs are the least likely medium to degrade by just sitting in a drawer for long periods of time. HDDs have lots of moving parts and SSD data degrades over time. If you find a disc and an HDD in a box after 20 years and wonder which will still work, my money's on the disc.
Well, I've tried both (yes over twenty years) and writable optical discs have been pretty flaky in comparison to HDDs. I never suggested SSD was good for anything but temporary storage. But you're totally missing the point about medium mattering much less than consistently making copies.
Bluray would likely provide the greatest cost-benefit as of today. If stored correctly they should last for decades.
Otherwise, if money is of no concern, cloud service providers. Data is replicated across multiple drives and their filesystems have bitrot protection. Unless you stop paying, it's likely your data would remain intact and accessible for just as long as a bluray. If it's good enough for critical government and corporate data, it's good enough for your data.
I would like to add. Don't use drive/dropbox/etc unless you encrypt your data. Those providers have been node to re-encode/compress/delete content to save space or because of DMCA.
Adding to this, what would be the best way to store videos, pictures and music over a long period of time?
get a nas for you primary storage... SSDs raided for that sweet redundancy. . replicate that to another identical, stand alone nas. replicated that to a cloud provider. problem solved. kinda pricey.
LTO most probably... but the tapes are expensive, so are the devices.
EDIT: We use them at work. They're enterprise grade, so long term storage is not a problem, the price is though.
Depends what you consider “long term”. My suggestion would be a NAS unit with dual drive redundancy. And additional backup device as well. For consumer level stuff, Synology units with hyper backup are a good solution.
There’s a rule I was always told in A+. Either a hard drive is going to last you less than a year or it’s gonna last you five. Usually any problems with a hard drive you’ll see right away. However after the third year is when I’d start checking the drive. There are tools out there that can let you know when a drive is in the caution level and that’s when you should think about replacement. I’ve had hard drives like one I have to replace soon last me eight years with constant use as a Plex drive.
I didn't know that was a thing. I just upgraded to a new pc but before my old hhd was nearly 14 years old. I'm still using it as a back up but wasn't aware they could fail so quickly. I should get a new one for backups.
Thanks for all the input everyone! I got really interested in that M-Disc!
Don’t bother with M-discs. They only provided a meaningful advantage in the DVD era. I’ve researched this a bit myself and consensus at least in the data hoarding community is use 2 Blu-ray Discs from two different batches (bought 6 months apart). Which still comes out cheaper or the same as branded M-Discs. (Though that may be overkill and truth be told as long as you test the disc and it’s data done months after writing you’ll tend to catch any rare bad ones)
Truth is, quality Blu-ray Discs have all the features that would engender M-disc type longevity in the design spec. Just make sure they’re not low to high (LTH) discs which are inferior but always marked as such at least.
Don’t get no-name cheap ones either, get Verbatim, Sony, some other good Japanese brand. For Verbatim specifically their discs marked MABL on the package are better.
Always burn data at lower speeds too, less errors.
Always burn data at lower speeds too, less errors.
I haven't kept up with BR but with DVD, that wasn't true. For a particular burner and media you could find a sweet spot of minimal PI/PO errors. For my 16x dvd burner with verbatim media, that was 4x speed.
Something like Amazon Glacier is your best bet if you don't access data often and are okay with paying a (per-GB) monthly fee. Otherwise, you may want to build a NAS PC with high levels of disk redundancy (RAID5 or RAIDZ2)
Always use ZFS if you want to use software RAID arrays. And never rely on RAID alone, also use some form of offline backup alongside them, and ideally you should also keep a spare ready to be used automatically in case of failure.
Which is why RAID doesn't really make sense for small number of disks, only starts working out around 6-8 disks and up. If you only have 2-5 disks you're much better off setting them up as backup rather than RAID, and only make small arrays if you absolutely must.
Some examples:
- You have 2 disks: use 1 live + 1 backup.
- 3 disks: 1 live + 1 backup + 1 another backup, or 2 in ZFS mirror + 1 backup.
- 4 disks: 2 mirrored + 1 backup + 1 another backup, or 2 mirrored + 1 standby spare + 1 backup. Do not do RAID with 3 or 4 disks without a standby spare, it makes no sense, and even if you do RAID5 + 1 spare or RAID10 you don't have backups, the RAID won't protect against accidental deletions.
- 5 disks: this is where you can do 3 in parity RAID + 1 spare + 1 backup, or triple RAID1 + 2 backups for ultra safety, or RAID6 without spare + 1 backup (provided you buy another disk as soon as one fails in the RAID6).