10
submitted 2 months ago by Dave@lemmy.nz to c/selfhosted@lemmy.world

I have backups on a backup hard drive and also synced to B2, but I am thinking about backing up to some format to put in the cupboard.

The issue I see is that if I don't have a catastrophic failure and instead just accidentally delete some files one day while organising and don't realise, at some point the oldest backup state is removed and the files are gone.

The other thing is if I get hit by a bus and no one can work out how to decrypt a backup or whatever.

So I'm thinking of a plain old unencrypted copy of photos etc that anyone could find and use. Bonus points if I can just do a new CD or whatever each year with additions.

I have about 700GB of photos and videos which is the main content I'm concerned about. Do people use DVDs for this or is there something bigger? I am adding 60GB or more each year, would be nice to do one annual addition or something like that.

top 36 comments
sorted by: hot top controversial new old
[-] philpo@feddit.org 2 points 2 months ago* (last edited 2 months ago)

Currently the only solution for a consumer are M-Disc Blue rays. They are currently the only "write once read many" media available that are preferable in these types of situations.

The media is comparable cheap - you can safe your amount of data for around 80-90USD/€ initially(or less for more but smaller discs) and then pay around 10$/€ per year for the new amount of data.

The chances that in 20 years someone is still able to read them are fairly high - there are numerous businesses that are using these disc as WORM media to backup important data on a medium that a opposing lawyer later cannot claim "was manipulated". In 50 years it is very likely to be readable at least by professionals. The discs itself are rated for much longer storage.

If you write on them unencrypted there should be no problem of writing on them. Additionally they do not have issues with byte rot,etc.

[-] Dave@lemmy.nz 2 points 2 months ago

Yeah it's an interesting thought. They seem to come up to 100GB capacity, but the wikipedia page claims (with a [dubious] qualifier) that you need some sort of special higher power burning device to write to M-Disc.

I don't have an optical drive at the moment. Would I just pick any rated for BDXL?

[-] fmstrat@lemmy.nowsci.com 2 points 1 month ago

Don't use them, but these seem right for you: https://lemm.ee/post/55012343

[-] Dave@lemmy.nz 2 points 1 month ago

Thanks, I missed that post! Looks like the comment section would have answered a lot of my question.

In the end I have pulled the trigger and bought an M-Disc capable burner and a stack of M-Discs, so I'm gonna give that a go and see how it works out.

[-] fmstrat@lemmy.nowsci.com 2 points 1 month ago

Sounds good. They do make 100GB MDisc but they are a shorter life span: https://a.co/d/dTOLvW8

[-] Dave@lemmy.nz 1 points 1 month ago

What makes you say they are shorter life span? The 25GB and 100GB both have the same "several hundred years" claim.

[-] killabeezio@lemm.ee 1 points 2 months ago* (last edited 2 months ago)

I decided instead to use ZFS. Better protection than just letting something sit there. Your backups are only as good as your restores. So, if you are not testing your restores, those backups may be useless anyway.

ZFS with snapshots, replicated to another ZFS box. The replicated data also stores the snapshots and they are read-only. I have snapshots running every hour.

I have full confidence that my data is safe and recoverable.

With that said, you could always use M-disk.

[-] Dave@lemmy.nz 1 points 2 months ago

I have automated backups including to cloud, but I want a separated manual system that cannot get erased if I mess something up (accidentally sync a delete, lose encryption key, forget to pay cloud bill). I have 3 2 1 but it's all automated and backups are eventually replaced, if it's not a critical failure I won't necessarily know I've lost something.

Basically, I specifically want cold storage, and not cloud. I will only add, not delete from it. And I don't want it encrypted.

Based on other conversations I'm planning on using duel disks mirrored, zfs, annual updates and disk checks with disks rotated out every 5 years (unless failing/failed). Handling the need for layman retrival of data by including instructions with the hard drives.

[-] bluGill@fedia.io 1 points 2 months ago

ZFS even if only one server is much better than most people have. If your ZFS replication is to a different building you have done pretty good. However as others have pointed out there are limits. Those servers costs you a couple bucks/month in electric (where I live my electric is 100% wind, but most of you should read CO2). You have to buy both servers, and hard drives will crash regularly.

There are a lot of trade offs, but cold storage backups are often much cheaper in the long run than the backup zfs server. And those cold backups are a lot easier to put into multiple different locations.

[-] Krik@lemmy.dbzer0.com 1 points 2 months ago

For local backups it depends on what you want to have:

  • The cheapest option is a usb or thumb drive. But you have to regularly plug it in and copy your backup on it.
  • The lazy option is to buy a NAS and configure a backup job that regularly creates a backup. Versioned, incremental, differentials and full backups are possible as is WORM to add a bit of extra security. You can configure a NAS to only turn on specified times, do a backup and then turn off again. This will increase protection against encrypting malware. WORM also helps in this case.
    Or just let it run 24/7, create backups every hour and install extra services on it like AI powered image analysis to identify people and objects and let it automatically tag your photos. Cool stuff! Check out QNAP and Synology or build a NAS yourself.
    A NAS can also be configured to present its content in a LAN by itself. Any computer will automatically connect to it if the access isn't secured by user/password or certificate.

I recommend buying a NAS.

[-] schizo@forum.uncomfortable.business 1 points 2 months ago* (last edited 2 months ago)

I'm using blu-ray disks for the 3rd copy, but I'm not backing up nearly as much data as you are.

The only problem with optical media is that you should only expect it to be readable for a couple of years, best case, at this point and probably not even that as the tier 1 guys all stop making it and you're left with the dregs.

You almost certainly want some sort of tape option, assuming you want long retention periods and are only likely to add incremental changes to a large dataset.

Edit: I know there's longer-life archival optical media, but for what that costs, uh, you want tape if at all possible.

[-] Dave@lemmy.nz 0 points 2 months ago

Hmm I am keen for something that could be left in the cupboard for 50 years and still works when brought out.

What does it take me to do home tape storage? Do the tapes needs to be stored with climate control or are they pretty stable? Is it feasible for the average person to load the contents?

I'm thinking of pulling a suitcase out of the cupboard of all the baby photos, but digital files or photo and video.

[-] Moonrise2473@feddit.it 0 points 2 months ago

Tape isn't readable by normal people even if they found it tomorrow with a drive already configured to be used.

In 50 years good luck finding a working drive compatible with LTO4 when LTO32 is out (it's backwards compatible only with previous gen).

Unless you write on the box "here there are the keys for 100k bitcoins" they'll just trash the tape

[-] Dave@lemmy.nz 0 points 2 months ago

Yeah from some other comments I think my initial plan (that I'll research some more) will be:

  • buy a new HDD, format with ZFS or btrfs for error correction
  • copy data onto drive
  • store in cupboard with sata-> USB cable and instructions about what it is, how to access .
  • every year, load the previous year's data onto the drive
  • about every 5 years, replace the drive by copying onto a brand new one (timeframe will likely depend on when my other HDD drives die)

This way I should get a chance to update storage medium as technology changes as well.

[-] philpo@feddit.org 0 points 2 months ago

That is not gonna work - read up on byte rot.

[-] Dave@lemmy.nz 0 points 2 months ago

Yeah since then I've been convinced I need two drives mirrored under zfs, which should handle that scenario.

[-] philpo@feddit.org 0 points 2 months ago

Hard drives loose their data fast if not powered (within a few years),so do SSD based media. Furthermore the former are very suspectable to mechanical destruction, electromagnetic interference,etc. And even if for some reason your drives last that long there will be nothing to connect them to - you know how we connected hard drives 25 years ago? Via SCSI/IDE. Good luck finding a converter to these now. If you go back further you need ISA controllers for the drives.

This is a really bad idea. Really really bad, especially with the goal you want to achieve. Your data will be gone within 5 to 10 years.

[-] Dave@lemmy.nz 0 points 2 months ago

The idea is that I'd swap out drives every 5 years or so. If USB A is no longer in use I'd swap out at that point for something newer. Plus the drives would be powered on every year for the update, it's just the point that I stop doing it (too old/hit by bus/etc) that the clock would start ticking.

I do like the M-Disc idea though. Probably a similar price, and more in line with the shelf-stable solution I was looking for.

[-] philpo@feddit.org 2 points 2 months ago

There are still problems with the hard drive solutions:

  • Powering up the drives for a short period does not help with error correction when sectors get compromised

  • As said before it is relatively risky as mechanical parts of HDs do not like to be moved only occasionally. While this problem has become less severe over the last years it still exists.

  • The updating will include copying from one drive to another - this process is highly suspectable to errors that might be correct with the right file systems - but it's not a guarantee.

  • And the main problem: You want to achieve a long shelf life - which means you must consider periods of time when you might not be able to maintain the data. What happens when you are not able to do so? And your next of kin are not quite ready to go through your things? To give you an example: You copy your data on the HDs today, maintain the disk's for four years and want to change disk's in 5, which means in 2030. Sadly a weeks before you are able to do so, John,your neighbourhood's stupid school bus driver hits you and you suffer a major traumatic brain injury. Even worse,you don't die right away but suffer for another 5 years in a nursing home before a infection gets you. Your family meanwhile is not quite ready to get through your things as you are still alive, aren't you? (For real,this is the case a lot) After your funeral it takes them another year to finally get through all your things. Now your drives haven't been used for 7 years. Even worse,one of them slips through your next of kind hand and hits the ground hard. How big do you think the chances are the data is still available? I think we both know the answer. While M-Disks are also suspectable to damage there are hardened multi-disk cases that make them pretty much indestructible - nothing any HD case can ever achieve.

[-] TheHolm@aussie.zone 1 points 2 months ago

Just a hdd in usb caddy? IMHO good enough for 4 tier backup.

[-] Dave@lemmy.nz 1 points 2 months ago

Yes this seems to be the general theme. Main issue is sorting out a file system. I can use a self-repairing one, to recover from long term storage issues, but then it likely won't work in Windows which it may need to if I want a layman to be able to access it. So still some refinement of the plan but it's coming together.

I've also decided to print some physical photos, aiming for 100 per year, and will put everything in a container together. The physical photos are for in case the container is lost for decades and the drives die, then there will at least be something.

[-] jqubed@lemmy.world 0 points 2 months ago

I have not used them myself, but M-DISC sounds like what you’re looking for. There are a few other alternatives listed on that Wikipedia article, too.

[-] Dave@lemmy.nz 0 points 2 months ago

Thanks, I think the risk here is that there may not be hardware to read it.

From the suggestions here I'm thinking a hard drive with USB connection would be best. It won't last 50 years but instead I'd replace it every 5 years or so. I'd use an error resistant file system and plug it in each year to add the new files.

This way I also get the chance to move it to newer technology in future instead of a new hard drive. It would then only need to survive for some period of time after I last replaced it, so there's a good chance of it remaining readable for most of my life.

[-] 486@lemmy.world 0 points 2 months ago

Thanks, I think the risk here is that there may not be hardware to read it.

M-Disc DVDs are readable by ordinary DVD drives. So you could simply put a USB DVD drive alongside those backup M-Discs on the shelf.

[-] Dave@lemmy.nz 0 points 2 months ago

Yeah that's an idea. It does seem like I'd need a lot of disks though. And I don't actually have a disk reader or writer at all at the moment.

[-] philpo@feddit.org 0 points 2 months ago* (last edited 2 months ago)
[-] Dave@lemmy.nz 0 points 2 months ago

Like this? https://www.pbtech.co.nz/product/DVWVER4618789/Verbatim-43888-External-Slim-Bluray-Writer-Ultra-H

That's NZD by the way, conversion rates are terrible at the moment so about halve it for USD, seems in the price range you said.

[-] philpo@feddit.org 2 points 2 months ago

Ah, a Kiwi. Say hello to your sheep's from me. (Sorry,former WA resident here, couldn't resist)

But yeah, we are using exactly that model - and it's currently only 20 NZD less from what I pay wholesale in Europe for it. So it seems like a pretty decent price.

The drive itself is solid. We currently have around 10, maybe 15, at our clients and it works without any hassle.

I personally recommend to store the disk's offsite(I store them in a locked box in a bank vault) and some of my clients choose to store another drive there to be extra safe,but I personally don't see the point.

[-] Dave@lemmy.nz 1 points 2 months ago

🐑

Sweet, thanks, I think that's a good plan. I am thinking duplicate disks, one on site one off site. I do have a cloud backup, but if I die in a house fire then having the offsite disks is a much better solution than the random B2 bucket.

Thanks for the help 🙂

[-] philpo@feddit.org 2 points 2 months ago

Yeah, that's sounds solid. Just make sure your next of kin know where to look and that there is something to look for.

[-] tvcvt@lemmy.ml 0 points 2 months ago

This was a recent point of discussion on the 2.5 Admins podcast (https://2.5admins.com/2-5-admins-228/). Some good discussion on there.

My own thought is the best way to handle your family-member-finding-your-old-photos problem is the analog way: make some prints. It’s absolutely idiot proof, the methodology of keeping paper goods is well understood, and the technology is platform independent.

[-] Dave@lemmy.nz 0 points 2 months ago

Yeah I really want a digital copy, but for redundancy physical photos sounds like a good idea. Maybe I should do the hard drive rotation thing mentioned in other comments, but each year when I'm updating I could print 100 photos as well. Have a suitcase or container where I keep the hard drives and the physical photos. Then I'd have a decent chance of all photos making it in digital form, plus a bunch of photos just in case the hard drives fail. The hardest part will be going back through the previous years finding an printing 100 photos from each year, but after that I don't have to get through too many each year.

[-] tvcvt@lemmy.ml 2 points 2 months ago

A hybrid is probably a good way forward. I had a career as a photographer for a while and I learned from that: going through 1000 photos takes very little time, but going through 10,000 takes an eternity. If you can star or mark your obviously important photos as you go along, it’ll take very little to print them at the end of the year.

[-] emuspawn@orbiting.observer 0 points 2 months ago* (last edited 2 months ago)

The other thing is if I get hit by a bus and no one can work out how to decrypt a backup or whatever.

Documentation, documentation, documentation. No matter what system you have, make sure your loved ones have a detailed, image-heavy, easy to follow guide on how restorations work - at the file level, at the VM level, at whatever level you are using.

That being said, DVDs actually have quite a short shelf life, all things considered. I'd be more inclined to use a pair of archival strength USB NVME drive, updated and tested routinely(quarterly, yearly, whatever makes sense). Or even an LTO tape, if you want to purchase the drive and some tapes.

You can put your backups in something like VeraCrypt. Set an insanely long password, encoded in a QR code, printed on paper. Store it in the same secured location you store your USB drives (or elsewhere, if you have a security posture).

You may also consider, if money is not a concern, a cloud VPS or other online file storage, similarly encrypted. This can provide an easy URL to access for the less tech-savvy, along with secured credentials for recovery efforts. Depending on what your successors might need to access, this could be a very straightforward way to log into a website and download what they need in an emergency.

[-] 486@lemmy.world 1 points 2 months ago* (last edited 2 months ago)

archival strength USB NVME drive,

Does such a thing exist? Ordinary flash storage is pretty bad at keeping its content when powered off for a long time, due to how flash memory works. I'd be curious about such drives.

[-] emuspawn@orbiting.observer 1 points 1 month ago

No, they don't, I pulled it out of my butt. I rewrote my original draft and that slipped in. NVME wouldn't make sense unless you were powering them up every few months for updates.

this post was submitted on 08 Feb 2025
10 points (100.0% liked)

Selfhosted

45329 readers
340 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS