41
submitted 1 year ago* (last edited 1 year ago) by TankieTanuki@hexbear.net to c/technology@hexbear.net

Your answer could potentially help me un-fuck my website!

Details here.


Edit: The total capacity is currently 160 GB, so no amount of pruning will free up 1 TB. I need to mount an external share or something.


Edit2: I'm trying this but the command isn't working despite zero exit status.

all 34 comments
sorted by: hot top controversial new old
[-] CyberSyndicalist@hexbear.net 10 points 1 year ago

Do you have your own physical server or are renting one?

[-] TankieTanuki@hexbear.net 9 points 1 year ago

Renting a VPS in the Netherlands.

[-] fox@hexbear.net 7 points 1 year ago

You may be able to just buy more capacity from the vendor by writing to their support. It's all containers

[-] TankieTanuki@hexbear.net 6 points 1 year ago* (last edited 1 year ago)

Storage isn't one of the things the sell on their business page but yeah, maybe their team can rig up something for a fee. It's worth a shot.

[-] Awoo@hexbear.net 6 points 1 year ago* (last edited 1 year ago)

Some of these companies can be really good, others can be like "no". InmotionHosting support were the primary reason I used them despite being slightly more expensive because their support would literally help with any issue even ones no other company would, and they would do stuff like give free storage for a problem like this. At one point I was using like 21TB of space on their service and really testing the limitations of "unlimited storage" they offered on their plan and they were totally cool with it even though I was clearly taking the piss a little. The only thing they held me to was that all things being stored on it had to be frontend accessible.

[-] TankieTanuki@hexbear.net 3 points 1 year ago

frontend accessible

What does that mean, not encrypted at rest?

[-] Awoo@hexbear.net 2 points 1 year ago* (last edited 1 year ago)

No like physically used as part of the website. Not just sitting on the server that the website was on without actually being in use on the website itself.

At the time what we were doing was archiving all pictures and video from a very very large and active discord. These were then searchable, you could see who posted what pictures and video, in what order historically, even sort by total number of reacts.

I don't like the fact that discords buries all media for guilds and communities behind a god awful chat. So many screenshots and videos and all kinds of media are just buried in discord, extracting JUST the media and making it viewable and searchable by user etc preserves genuinely emotionally sentimental content. Things like that time a group of friends defeated their first dungeon together and stuff like that deserves to not get forgotten about never to be found ever again somewhere in the depths of a discord server.

Also I am a hoarder.

[-] Findom_DeLuise@hexbear.net 3 points 1 year ago* (last edited 1 year ago)

You probably have some archival shit under /var/log that you can prune. I will usually go level-by-level running du -sh {PARENT_PATH}/* to narrow things down one level at a time until I find the offender. Check under /opt and user home dirs, too. Otherwise, you're probably stuck adding another disk or pushing data out to an S3 bucket.

[-] TankieTanuki@hexbear.net 3 points 1 year ago

Can I make a BackBlaze bucket and mount that on the filesystem?

[-] Findom_DeLuise@hexbear.net 3 points 1 year ago

Depends on if you can free up enough space on / to install any packages you may need for the filesystem drivers. I've never had to do it either way; if you have a local rig that you can test with, that might be a start.

[-] farting_weedman@hexbear.net 2 points 1 year ago

Stop the service that’s doing the thing causing you a problem.

Fix the thing you screwed up

Restart the fixed service that was causing the problem

What could possibly go wrong?

In this case, and I’m making wild assumptions because I don’t have a peertube instance to play with, stop peertube, connect your local system up to it with a vpn to traverse your nat, mount some volume in the local system as the remote systems target for the file system move, then start peertube back up and see if it starts filling your local drive with some data.

[-] TankieTanuki@hexbear.net 1 points 1 year ago* (last edited 1 year ago)

When I made the wrong command, the application registered hundreds of move jobs in its database. The developer said there is no way to cancel the jobs. If I restart peertube.service then it will notice the incomplete jobs and immediately resume them. I think I'm going to use btrfs next time so I can take a system snapshot before executing risky server commands.

connect your local system up to it with a vpn to traverse your nat

I need a little more detail on this. Here's my takeaway:

  1. Host an (e.g.) OpenVPN server on the webserver, after creating the proper certificate infrastructure.
  2. Connect as client from home PC.
  3. VPN Success. Now I can access each other on the local subnet that starts with a 10. or something.
  4. Mount home PC's NFS share on the webserver.
[-] farting_weedman@hexbear.net 3 points 1 year ago

Yeah that’s what I was thinking. Standing up openvpn especially is pretty well documented.

[-] farting_weedman@hexbear.net 2 points 1 year ago

Alternate solution: use atop sorting by fs access and kill the process doing it.

[-] Sickos@hexbear.net 1 points 1 year ago

So if I'm reading this right, the issue is going to be that when you revive peertube, it's going to resume trying to move stuff? Is it running in a container or directly on that machine?

[-] Sickos@hexbear.net 1 points 1 year ago* (last edited 1 year ago)

If I'm understanding this correctly, and keep in mind I know nothing of peertube, I'm just an old coder tearing through their source, you could break your config. Configure it not to use object storage and restart. If can't find the storage it's trying to move stuff from, it can't move that stuff.

OBJECT_STORAGE: { ENABLED: config.get<boolean>('object_storage.enabled'),

[-] Sickos@hexbear.net 1 points 1 year ago

Or make the target folder/file read only

this post was submitted on 15 Jun 2024
41 points (100.0% liked)

technology

23873 readers
223 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 5 years ago
MODERATORS