13

I run some services on machine A. I want to backup the data to machine B. It's around 40 gigabytes in thousands of small files. I would prefer to compress the data, but there's not enough space on machine A to keep the data twice (original + tar archive). I would like to avoid copying that many files via scp/rsync since it's taking forever and a bit fragile.

Any solutions on how to solve this? Is it possible to compress live on machine A and stream into the archive on machine B without the need to keep the big archive file on A?

Eventually, it's supposed to be automated and B has like the last 3 dailys, 1 weekly, 1 montly.

B can ssh into A.

you are viewing a single comment's thread
view the rest of the comments
[-] tofu@lemmy.nocturnal.garden 1 points 1 day ago

That should work! I'll have to make sure it only syncs one direction but that's doable of course

this post was submitted on 23 May 2026
13 points (100.0% liked)

Self-hosting

4354 readers
61 users here now

Hosting your own services. Preferably at home and on low-power or shared hardware.

Also check out:

founded 4 years ago
MODERATORS