Transparent compression layer on Linux? (lemmy.world)

submitted 6 months ago* (last edited 6 months ago) by MigratingtoLemmy@lemmy.world to c/selfhosted@lemmy.world

29 comments fedilink hide all child comments

My use-case: streaming video to a Linux virtual mount and want compression of said video files on the fly.

Rclone has an experimental remote for compression but this stuff is important to me so that's no good. I know rsync can do it but will it work for video files, and how I get rsync to warch the virtual mount-point and automatically compress and move over each individual file to rclone for upload to the Cloud? This is mostly to save on upload bandwidth and storage costs.

Thanks!

Edit: I'm stupid for not mentioning this, but the problem I'm facing is that I don't have much local storage, which is why I wanted a transparent compression layer and directly push everything to the Cloud. This might not be worth it though since video files are already compressed. I will take a look at handbrake though, thanks!

you are viewing a single comment's thread
view the rest of the comments

[-] catloaf@lemm.ee 1 points 6 months ago

This sounds like an XY problem. I would first recommend not streaming to disk, but streaming to a program that does compression, and write that to disk.

If that's unavoidable, can you stream to a pipe or socket? A compressor should be able to read from there and do its work.

If you can't control the stream to disk, there are plenty of file watcher tools that can run arbitrary commands.

[-] MigratingtoLemmy@lemmy.world 1 points 6 months ago

Streaming to a socket sounds like a decent idea. I don't know how and which program I could stream to; is there a way for handbrake to transparently reencode video and send it to a virtual FUSE mount-point? The problem I have is no local storage to keep video.

[-] aBundleOfFerrets@sh.itjust.works 2 points 6 months ago* (last edited 6 months ago)

ffmpeg will be your friend

[-] MeanEYE@lemmy.world 1 points 6 months ago

VLC, it's in the name.

this post was submitted on 23 May 2024

14 points (88.9% liked)

Selfhosted

40445 readers

273 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago

MODERATORS

HybridSarcasm@lemmy.world

HybridSarcasm@lemmy.hybridsarcasm.xyz