Backing up across machines with low free space? (lemmy.nocturnal.garden)

submitted 2 days ago by tofu@lemmy.nocturnal.garden to c/selfhosting@slrpnk.net

17 comments fedilink hide all child comments

I run some services on machine A. I want to backup the data to machine B. It's around 40 gigabytes in thousands of small files. I would prefer to compress the data, but there's not enough space on machine A to keep the data twice (original + tar archive). I would like to avoid copying that many files via scp/rsync since it's taking forever and a bit fragile.

Any solutions on how to solve this? Is it possible to compress live on machine A and stream into the archive on machine B without the need to keep the big archive file on A?

Eventually, it's supposed to be automated and B has like the last 3 dailys, 1 weekly, 1 montly.

B can ssh into A.

you are viewing a single comment's thread
view the rest of the comments

[-] tofu@lemmy.nocturnal.garden 1 points 1 day ago

Seems like Borg Backup Pull Mode does what I need, using sshfs:

https://borgbackup.readthedocs.io/en/stable/deployment/pull-backup.html

[-] thelittleblackbird@lemmy.world 1 points 11 hours ago

Certainly it is a good way to go, but in my experience try the usual work flow, it is way more stable and the cpu burden is share between both nodes -> faster backups

[-] tofu@lemmy.nocturnal.garden 1 points 11 hours ago* (last edited 11 hours ago)

Machine B is not publicly reachable though.

[-] thelittleblackbird@lemmy.world 1 points 10 hours ago

Then nothing to say, good luck with your setup :)

[-] tofu@lemmy.nocturnal.garden 1 points 10 hours ago

Thanks! :)

this post was submitted on 23 May 2026

13 points (100.0% liked)

Self-hosting

4354 readers

53 users here now

Hosting your own services. Preferably at home and on low-power or shared hardware.

Also check out:

founded 4 years ago

MODERATORS

poVoq@slrpnk.net

sam_uk@slrpnk.net