109

I've been considering paying for a European provider, mounting their service with rclone, and thus being transparent to most anything I host.

How do y'all backup your data?

top 50 comments
sorted by: hot top controversial new old
[-] Strayce@lemmy.sdf.org 54 points 1 year ago

You don't have to worry about the backups. It the data recovery that will require divine intervention.

[-] TheYear2525@lemmy.world 11 points 1 year ago

Jesus is my ~~copilot~~ raid parity.

[-] metaStatic@kbin.social 17 points 1 year ago
[-] ErwinLottemann@feddit.de 10 points 1 year ago

of course /s

[-] Turun@feddit.de 4 points 1 year ago

It protects against drive failure. That is the threat I am most worried about, so it's fine for me.

load more comments (3 replies)
[-] mypasswordis1234@lemmy.world 13 points 1 year ago* (last edited 1 year ago)

That's the thing. I don't.

[-] dan1101@lemm.ee 11 points 1 year ago

Two hard drives of the same size, one on site and one off site.

[-] dandroid@dandroid.app 4 points 1 year ago

Where do you keep your off-site one? Like a friend or family member's house?

[-] tburkhol@lemmy.world 5 points 1 year ago

I keep one in a bank deposit box. It costs like $10/year, fireproof, climate controlled, and exactly the right size for a 3.5" disk. Rotate every couple of months, because it is like 10-15 minute process to get into the vault.

[-] dandroid@dandroid.app 7 points 1 year ago

So your backed up data can be as old as a couple of months and requires manual interaction? I guess that's better than nothing, but I'm looking for something more automated. I'm not sure what my options are for cloud storage or if they are safe from deletion. Or if having it in a closet in a friends house is really the best option.

[-] tburkhol@lemmy.world 9 points 1 year ago

I have a live local backup to guard against hardware/system failure. I figure the only reason I'd have to go to the off-site backup is destruction of my home, and if that ever happens then recreating a couple of months worth of critical data will not be an undue burden.

If I had work or consulting product on my home systems, I'd probably keep a cloud backup by daily rsync, but I'm not going to spend the bandwidth to remote backup the whole system off site. It's bad enough bringing down a few tens of gigabytes - sending up several terabytes, even in the background, just isn't practical for me.

[-] dan1101@lemm.ee 3 points 1 year ago* (last edited 1 year ago)

At home and at the shop where I work. At work the drives are actually stored in a Faraday cage.

load more comments (1 replies)
[-] danhab99@programming.dev 10 points 1 year ago

I wrote my own thing. I didn't understand how the standard options worked so I gave up.

https://github.com/danhab99/backup-brute

[-] badbytes@lemmy.world 8 points 1 year ago

Tape is the best medium for archiving data.

[-] vector_zero@lemmy.world 7 points 1 year ago

I really want to use tape for backups, but holy expensive. Those tape drives are thousands of dollars.

load more comments (3 replies)
[-] peter@feddit.uk 2 points 1 year ago

I bought an incredibly overkill tape system a few years ago and then the power supply exploded in it and I never bothered to replace it. Still, definitely worth it

load more comments (1 replies)
load more comments (1 replies)
[-] Rootiest@lemm.ee 7 points 1 year ago
[-] PieMePlenty@lemmy.world 6 points 1 year ago

Manually plug in a few disks every once in a while and copy the important stuff. Disks are offline for the most part.

[-] grayman@lemmy.world 6 points 1 year ago

Local to synology. Synology to AWS with synology's backup app. It costs me pennies per day.

load more comments (7 replies)
[-] dan@upvote.au 6 points 1 year ago* (last edited 1 year ago)

I keep important files on my NAS, and use Borgbackup with Borgmagic for backups. I've got a storage VPS with HostHatch that's $10/month for 10TB space (was a special Black Friday deal a few years ago).

Make sure you don't just have one backup copy. If you discover that a file was corrupted three weeks ago, you should be able to restore the file from a three week old backup. rsync and rclone will only give you a single backup. Borg dedupes files across backups so storing months of daily backups often isn't a problem, especially if the files rarely change.

Also make sure that ransomware or an attacker can't mess up your backup. This means it should NOT be mounted as a file system on the client, and ideally the backup system has some way of allowing new backups while disallowing deleting old ones from the client side. Borg's "append only" mode is perfect for this. Even if an attacker were to get onto your client system and try to delete the backups, Borg's append-only mode just marks them as deleted until you run a compact on the server side, so you can easily recover.

[-] BlueBockser@programming.dev 5 points 1 year ago* (last edited 1 year ago)

I do an automated nightly backup via restic to Backblaze B2. Every month, I manually run a script to copy the latest backup from B2 to two local HDDs that I keep offline. Every half a year I recover the latest backup on my PC to make sure everything works in case I need it. For peace of mind, my automated backup includes a health check through healthchecks.io, so if anything goes wrong, I get a notification.

It's pretty low-maintenance and gives a high degree of resilience:

  • A ransomware attack won't affect my local HDDs, so at most I'll lose a month's worth of data.
  • A house fire or server failure won't affect B2, so at most I'll lose a day's worth of data.

 

restic has been very solid, includes encryption out of the box, and I like the simplicity of it. Easily automated with cron etc. Backblaze B2 is one of the cheapest cloud storage providers I could find, an alternative might be Wasabi if you have >1TB of data.

[-] BigNerdAlert@lemmy.dbzer0.com 5 points 1 year ago

How much are you backing up? Admittedly backblaze looks cheap but at $6 Tb leaves me with $84 pcm or just over $1000 per year.

I'm seriously considering a rpi3 with a couple of external disk in an outbuilding instead of cloud

load more comments (4 replies)
load more comments (1 replies)
[-] GregoryTheGreat@programming.dev 5 points 1 year ago

The only type of data I care about is photos and video I’ve taken. Everything else is replaceable.

My phone —> immich —> backblaze b2, and some Google drive.

Linux isos I can always redownload.

[-] vegetaaaaaaa@lemmy.world 4 points 1 year ago
[-] AevumDecessus@lm.bittervets.org 4 points 1 year ago

rclone to dropbox and opendrive for things I care about like photo backups and RAW backups, and an encrypted rclone volume to both for things that need to be backed up, but also kept secure, such as scans of my tax returns, mortgage paperwork, etc. I maintain this script for the actual rclone automation via cron

[-] CatsGoMOW@lemmy.world 3 points 1 year ago

I have a Synology NAS that holds all my important data. Then it does nightly backups to Synology C2.

[-] ebits21@lemmy.ca 3 points 1 year ago* (last edited 1 year ago)

Synology NAS where all computers get backed up to locally. Restic for Linux, Time Machine for Mac, active backup for Windows.

NAS backs most of its data (that I trust enough to put on the cloud) encrypted to Google drive every night, occasionally I back the NAS up to an external 8tb hard-drive.

[-] nbailey@lemmy.ca 3 points 1 year ago

Device sync to nextcloud -> rsync data & db onto NAS -> nightly backup to rsync.net and quarterly offsite/offline HDD swaps.

I also copy Zoneminder recordings, configs, some server logs, and my main machine’s ~/ onto the NAS.

The offsite HDD is just a bog standard USB 4TB drive with one big LUKS2 volume on it.

It’s all relatively simple. It’s easy to complicate your backups to the point where you rely on Veeam checkpointing your ESXI disks and replicating incrementals to another device that puts them all back together… but it’s much better to have a system that’s simple and just works.

[-] Decronym@lemmy.decronym.xyz 3 points 1 year ago* (last edited 1 year ago)

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

Fewer Letters More Letters
ESXi VMWare virtual machine hypervisor
Git Popular version control system, primarily for code
NAS Network-Attached Storage
RAID Redundant Array of Independent Disks for mass storage
SSD Solid State Drive mass storage
VPS Virtual Private Server (opposed to shared hosting)

[Thread #188 for this sub, first seen 5th Oct 2023, 00:05] [FAQ] [Full list] [Contact] [Source code]

[-] PerogiBoi@lemmy.ca 3 points 1 year ago

I sync all my files across 4 different computers in my house (rsync and Nextcloud) and then backups on OneDrive and Google Drive.

load more comments (2 replies)

Proxmox backs up to pbs and pbs is synced to B2 with rclone.

Other stuff is restic to b2.

[-] TiphaineRupa@feddit.de 3 points 1 year ago* (last edited 1 year ago)

I have a cheap 2 bay synology NAS that acts solely as a backup server for my main NAS in an offsite location as well as a USB drive locally.

Backups run every night with duplicacy

I exclude media files (movies, TV shows,...) from my backup routine due to the sheer amounts of data accumulated over time and the fact that most of it can be re-aquired using public sources in case disaster recovery is needed

[-] Maximilious@kbin.social 2 points 1 year ago

I backup my ESXi VMs and NAS file shares to local server storage using an encrypted Veeam job and have a copy job to a local NAS with iSCSI storage presented.

From there I have another host VM accessing that same iSCSI share uploading the encrypted backup to Backblaze. Unlimited "local" storage for $70\y? Yes please! (iSCSI appears local to Backblaze. They know and have already started they don't care.)

I'm backing up about 4TB to them currently using this method.

load more comments (1 replies)
[-] fbmac@lemmy.fbmac.net 2 points 1 year ago
[-] Whippen@lemmy.world 2 points 1 year ago

Everything to Crashplan.

Critical data also goes to Tarsnap.

[-] TheLongPrice@lemmy.one 2 points 1 year ago

Right now just a spare hard drive on a pi that I rsync too, but I'm looking for better options as well.

[-] sgtgig@lemmy.world 2 points 1 year ago

Docker cp piped into restic, uploading to wasabi. Works well, I recently recovered from a hard drive failure and everything just worked.

[-] Father_Redbeard@lemmy.ml 2 points 1 year ago

I've finally settled on Duplicacy. I've tried several CLI tools, messed with and love rclone, tried the other GUI backup tools, circled back to Duplicacy.

I run a weekly app data backup of my unRAID docker containers, which is stored on an external SSD attacked via USB to the server. The day after that runs duplicacy does a backup of that folder to Backblaze B2. My Immich library is backed up nightly and also sent to B2 via Duplicacy. Currently, those are the only bits of critical data on the server. I will add more as I finalize a client backup for the Win10, Linux, and MacOS devices at home, but it will follow this trend.

[-] nomecks@lemmy.world 2 points 1 year ago

I do an s3 sync every five minutes of my important files to a versioned bucket in AWS, with S3-IA and glacier instant retrieval policies, depending on directory. This also doubles as my Dropbox replacement, and I use S3 explorer to view/sync from my phone.

[-] clavismil@lemmy.world 2 points 1 year ago

I perform a backup once a week from my main desktop to a HDD, then once a month I copy important data/files from all nodes (proxmox, rpi's and main desktop) to 2 "cold" unplugged HDD that's the only time I connect them. I do all of that using rsync with backup.sh and coldbackup.sh

I use syncthing for notes across mobile/desktop/notebook, for that and other important files the backup goes to Google Drive or MEGA (besides the offline backup).

I want to try S3 Glacier since is cheaper for cloud backup... has anyone tried?

load more comments (1 replies)
[-] Aloha_Alaska@lemmy.world 2 points 1 year ago

I use a combination of technologies.

I keep most of my documents in sync between all my computers with SyncThing. It’s not a true backup solution, but it protects me from a drive failing in my desktop or someone stealing my laptop.

My entire drive gets backed up locally to a external hard drive using Borg. That provides me with the ability to go back in time and backs up all of my large files such as family photos and home videos.

Important documents get cloud backup with Restic to BackBlaze B2. Unfortunately, I don’t want to pay for the storage capacity to save all of my photos and videos, so those are a little less protected than they should be, but B2 gives me the peace of mind that my documents will survive a regional disaster like flooding or fire.

I use both Borg and Restic because I started with Borg many years ago and didn’t want to lose all of my backup history, but can’t use it with B2. I used to use one of the unlimited cloud single-computer solutions like Mozy or Carbonite but have multiple computers and their software was buggy, then they increased the price significantly. When I switched to B2, I found Restic worked well with it. I think they’re both solid solutions, but the way Restic works and the commands make more sense to me.

I have a lot of photos that I take. Amazon Photos gives me unlimited storage to back them all up, but it’s terrible. When Amazon Drive existed, I could grab a folder and drop it in the Photos area of Drive. My folder structure was maintained and it was easy to see what I’d already backed up or what else needed to be sent. Then Drive was discontinued and the only way to manage my photos is through the terrible web interface. There is no folder structure, putting photos in albums is unwieldy, and I have no confidence in the systems ability to give me back my photos if I needed to recover from data loss. Uploading a bunch of photos through the web page is slow and fails more often than not, leaving me to painstakingly figure out what went and what failed or just upload the whole thing again, creating duplicates. Most of the time, I can’t even find a photo or album I’m searching for. I hate that it exists and would fill a specific need if it wouldn’t have such a terrible interface.

I wish I’d have a friend who would share a few TB of storage with me but I’m pretty happy with my system, even though it has some gaps.

[-] ThorrJo@lemmy.sdf.org 2 points 1 year ago

Syncthing's file versioning has got me out of many a jam

load more comments (1 replies)
[-] capital@lemmy.world 2 points 1 year ago

restic to Wasabi.

load more comments
view more: next ›
this post was submitted on 04 Oct 2023
109 points (95.0% liked)

Selfhosted

40359 readers
295 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS