84
submitted 1 week ago* (last edited 1 week ago) by TankieTanuki@hexbear.net to c/technology@hexbear.net

Investing in a server with mass storage would "pay for itself" in less than a year, compared to what I'm currently renting (I'm low key scared to look up the prices of DDR5 RAM and NVMe drives though). Since I plan to maintain TankieTube "forever", it seems like the best option.

I'm so ready to ditch BackBlaze because their timeout errors are causing ~90% of the current problems with the website (external storage move failures and buffering problems). mario-finger

I have plenty of experience assembling computers and the thought of building a server is really fun, but I've never used colocation before.

Questions/Thoughts/Concerns:


  1. Do datacenters let you walk inside to maintain your own server? There is a datacenter in my home city, which would be convenient, but using it would effectively soft-doxx my location. Right now "Burgerland" is as specific as I publicly reveal.

  1. If I ship the server to a more remote location, how would I replace failed drives? Is that a commonly provided service? Would using a datacenter within ~2 hours driving distance be the best compromise between accessibility and location obfuscation?

  1. Is paying with Monero an option? Is it a good idea? Could I mail replacement drives directly to the datacenter without revealing my home return address?

It looks like I'll need NVMe drives in something called the U.2 form factor (instead of M.2) in order to enable hot swapping. TIL.

top 40 comments
sorted by: hot top controversial new old
[-] SuperZutsuki@hexbear.net 30 points 1 week ago

If you end up building your own, I would donate to the cause. We need tankie.tube more and more with every passing day.

[-] dastanktal@hexbear.net 24 points 1 week ago

I work in the industry and can talk a tiny bit about my experience with this. I actually don't have a lot of experience working directly with physical equipment. Most of what I do is in the cloud.

  1. As far as going into the data center, set up your server. That is something you can do. Data centers do allow that It's just going to depend on your specific data center.

  2. Typically they do have data center staff that's on site to do that type of thing, but it's normally an extra fee.Otherwise, I think you have to ship staff out there to do it yourself.

  3. I actually don't know about this, but I think there are legal requirements that a data center needs to know who you are in the US. So if you're trying to stay anonymous This is not a great route. Otherwise most data centers work directly with big business and they don't normally accept Monero so you're really gonna have to look around for a data center that'll take cryptocurrency.

Take everything here with a huge grain of salt. I've only been in a data center three times and have only had to give advice on what to do to move out of a data center into the Cloud. This knowledge could be old, it could be archaic, or it could flat be wrong But I wanted to see if I could offer any bit of advice that might be helpful.

[-] BountifulEggnog@hexbear.net 16 points 1 week ago

I would be shocked if there was a US provider that didn't have KYC

[-] TankieTanuki@hexbear.net 11 points 1 week ago

That's more experience than I have, so I appreciate the input, comrade fidel-salute-big

[-] JustSo@hexbear.net 19 points 1 week ago

Never stop proxying whatever you do.

[-] PorkrollPosadist@hexbear.net 16 points 1 week ago* (last edited 1 week ago)

I don't know fuck-all about colocation or running PeerTube, but in terms of anonymity it may be worth investigating what you can manage through a reverse-proxy and caching. If you need to colocate a server for the purposes of bulk data storage (and perhaps bulk video encoding), this does not need to be a public-facing system. You can run the public-facing Peertube instance on a relatively lighter server located in LA or New York (or anywhere along the backbone) and have it download media from the colocated server when it misses cache. The Feds would be able to find out where it is, but this doesn't change much from the status quo. This would just prevent casuals and chuds from finding the location of your colo (unless the PeerTube instance got hacked).

I kind of do this with my Mastodon instance. The public-facing VPS has limited storage space (which is quite expensive to expand), so about 1TB of user media lives in S3 storage at another host. The machine serving Mastodon reverse-proxies this media from the S3 host and keeps anything requested in a cache for 48 hours. The end users make no contact with the S3 host. In your case, the caching rules would probably need to be more sophisticated. This solution works great for Mastodon because everyone is generally looking at recent content, and scrolling several days back in the timeline is an exception. For a video website, the data access patterns are likely more random.

In your case, instead of a third-party S3 host, it would be your colocated server, but the principle would be the same. The colocated server can be located near you so you can service it personally, add / replace disks, make hardware improvements as needed, but the public website could be hosted anywhere (though it would help if it weren't sending requests across an ocean every time the cache misses) without physical maintenance being your responsibility. In my case, the Mastodon instance and bulk storage are located in different cities, but the connection between them is good enough for it not to be a problem.

[-] TankieTanuki@hexbear.net 6 points 1 week ago

That's a good idea and I'll probably do that to replace BackBlaze at the very least. I already have a 1 TB nginx cache like that on the TankieTube server.

I wouldn't be able to go too light on the front-facing server because it would still need a lot of bandwidth. Having storage and the front server in the same box is attractive because it cuts bandwidth requirements and latency.

[-] thefunkycomitatus@hexbear.net 15 points 1 week ago

Legit data centers will probably want personal info so I don't know how anonymous you can be. You might want to start also looking into legal protection, like placing the site and hardware under an LLC. You can pay extra to incorporate in places like NV. Nevada does not reveal owner information to the public. The down side is you need a registered agent in NV, which you can get for a simple monthly fee. Sell the site to the LLC, put the WHOIS as the company. Put donations into a company checking account plus your own startup cash. Pay for the domain renewal, hardware, services, etc with the company account. For tax purposes the profit/loss goes on your normal yearly taxes. Legally the company is the company and not you. If someone sues the site because they found copyrighted material, or defamation or anything like that, the company gets sued, not you. If the company is forced to sell its assets in a settlement, then that is separate from your personal finances. They can't take your car, house, or personal bank account away. This way, at the very worst, you can walk away without losing everything.

Right now you're renting cloud space/compute. The liability there is a little different than if you owned the hosting yourself. It's worth looking into how that works. You don't want to set up a server and get sued 6mo later and lose everything.

The down side is all this takes paperwork, research, and some ongoing fees. You also have to put profit and loss on your taxes. That can benefit you because losses can be written off and used to help you with your tax burden. But there may be limitations to how long you can take losses and how much. This means you may have to look at a similar but different legal entity like a non profit. You also need to handle the crypto exactly right as to not trigger audits or increase legal exposure. IANAL, so idk.

Really, check the contract for renting space in the data center. That will probably contain some indemnification liability info that lets you know how exposed you are.

[-] TankieTanuki@hexbear.net 15 points 1 week ago* (last edited 1 week ago)

I'm incorporated in Wyoming as Furry Varmint LLC. No joke. Wyoming is as private as it gets from what I could gather. The WHOIS stuff is done, I just need to do the bank account stuff.

[-] thefunkycomitatus@hexbear.net 9 points 1 week ago

Nice, you're already on it!

[-] TankieTanuki@hexbear.net 6 points 1 week ago* (last edited 1 week ago)

Do datacenters let you walk inside to maintain your own server?

Yes. Some are more strict than others. One of our datacenters I have a badge, a pin, and I can get in without alerting anyone. Others I have to schedule it, get greeted at the door, and have them check your ID. And some were really strict about giving them at least one hour heads up. Others you can say I'm OMW and they're cool. It really depends on their polices.

How would someone know it's in your city unless you explicitly say?

If I ship the server to a more remote location, how would I replace failed drives?

Pay like $50 an hour for an employee to replace it for you, and possibly connect a remote crash cart.

Is paying with Monero an option? Is it a good idea? Could I mail replacement drives directly to the datacenter without revealing my home return address?

They're almost 100% not going to let you be anonymous to them. If you're doing illegal stuff and getting DMCAs out the wazoo they're gonna shut your ass down almost immediately. They shouldn't doxx you (unless you get sued), but you cannot be anonymous to them.

Also FYI colo prices have gone up a lot because of the demand from AI datacenters. Either they want to be one, or people are getting priced out and moving to the cheaper ones. Also U.2 drives are still pretty expensive. I'd stick with spinning rust if you want mass storage. Unless you're planning on having a TON of users that the drives can't keep up. Some colos will let you plunk a tower down on a shelf. So one ATX tower with 8 3.5" drives aint bad.

[-] TankieTanuki@hexbear.net 8 points 1 week ago* (last edited 1 week ago)

The security makes sense. If they let you walk in, I was wondering how they would prevent someone from plugging some kind of sniffer on a competitor's server.

DMCA-ignored "bulletproof" hosting providers exist outside the US, but a problem is that their IP reputations suck which makes it impossible to send emails from them.

Is there anything AI hasn't ruined? meow-tableflip

I'm 100% using HDDs for video storage—probably a ZFS RAID 10 array of 36 TB drives. The U.2 SSDs would be only for the operating system, database, and possibly a small video cache and a ZFS SLOG if the hard drives have to do synchronous writes (probably not the case if they are on the same machine as the main server).

[-] SootySootySoot@hexbear.net 4 points 1 week ago

If they let you walk in, I was wondering how they would prevent someone from plugging some kind of sniffer on a competitor's server.

In my experience, a combination of security watching you, and all the cabinets but your own should be locked.

That being said, they tend to be pretty flimsy, pickable locks..

[-] TankieTanuki@hexbear.net 3 points 1 week ago

*Mr. Robot music plays*

[-] chgxvjh@hexbear.net 4 points 1 week ago

DMCA-ignored "bulletproof" hosting providers exist outside the US, but a problem is that their IP reputations suck which makes it impossible to send emails from them.

Put email on a different server?

[-] TankieTanuki@hexbear.net 3 points 1 week ago

I thought the DNS records required the mail server to be on the same IP, but it looks like I was wrong. I still don't know if I can configure the PeerTube application like that though.

[-] chgxvjh@hexbear.net 3 points 1 week ago* (last edited 1 week ago)

MX record doesn't conflict with anything and you can put the other stuff (DNS records for sending, including the anti spam signatures) on a subdomain while still being able to send emails with the main domain.

The service probably just needs SMTP settings I'd guess. Those can be on any server. You could also use some hosted mail for that, but I think most of privacy conserving providers put some pretty low limits on how much emails you can send because they don't want to ruin the standing of their IP addresses. Idk maybe there are more options when you can pay through the LLC.

[-] PorkrollPosadist@hexbear.net 2 points 6 days ago* (last edited 6 days ago)

MX record doesn't conflict with anything and you can put the other stuff (DNS records for sending, including the anti spam signatures) on a subdomain while still being able to send emails with the main domain.

FWIW, I also do this with matapacos.dog. The mail server is running on its own tiny VPS with it's own IP, a completely separate system (though hosted at the same company / datacenter). Its actual domain is mail.matapacos.dog, but the mail is sent with a @matapacos.dog address. This works in a similar way (but through a different mechanism - DNS records vs. Webfinger) to how the Mastodon instance is hosted at toots.matapacos.dog, but user handles are @matapacos.dog.

DMCA-ignored "bulletproof" hosting providers exist outside the US, but a problem is that their IP reputations suck which makes it impossible to send emails from them.

The reputation of public VPS hosts within reach of the US copyright regime isn't much better lmao. I have to imagine there is just a constant stream of abandoned Wordpress blogs and unmaintained websites for pizzarias and bicycle shops getting hacked and assimilated into botnets.

[-] Nopeace@hexbear.net 8 points 1 week ago

I don't know dick about shit when it comes to servers but I just wanted to thank you for hosting tankietube. You a real one for sure Care-Comrade

[-] tombruzzo@hexbear.net 5 points 1 week ago

I listened to a podcast a while ago on Archive Of Our Own and they actually develop their own CMS and host their own servers. It's all community run so that might be possible. It's a much taller order with video compared to text though

[-] shath@hexbear.net 4 points 1 week ago
[-] TankieTanuki@hexbear.net 4 points 1 week ago

That's owned by my cousin, TelevisionTanuki

[-] EdlritchEconomics@hexbear.net 4 points 1 week ago* (last edited 1 week ago)

First few questions have been answered adequately already, and I can't answer the third, but regarding uptime vs. distance; consider using more than one machine. Depending on your budget it might be worth it to have a couple or more lower-spec machines behind a load balancing / failover proxy. That would give you a fair bit of leeway to get out to the location while maintaining uptime. Also you can use one to troubleshoot the other remotely.

[-] TankieTanuki@hexbear.net 1 points 1 week ago

Are you talking about multiple servers in the same datacenter, or space across the globe?

[-] EdlritchEconomics@hexbear.net 2 points 1 week ago

Same datacenter. I don't expect tankietube to scale to a global CDN quite yet.

[-] TankieTanuki@hexbear.net 2 points 1 week ago

How do I keep the PostgreSQL databases in sync?

[-] edie@lemmy.encryptionin.space 3 points 1 week ago* (last edited 1 week ago)

I don't think PeerTube is made to run more than one of the same instance? If it were to work, for a low amount of servers you could maybe just connect them all to one database. But for more than one PostgreSQL server, this page might be an introduction:^[1]^ https://www.postgresql.org/docs/current/high-availability.html

1: I do not know about this, I just know it is possible and looked for it


This user is suspected of being a cat. Please report any suspicious behavior.

[-] TankieTanuki@hexbear.net 2 points 1 week ago* (last edited 1 week ago)

I don't think PeerTube is made to run more than one of the same instance?

I don't think so either. It has a native redundancy feature in which different instances mirror videos to distribute the demand.

https://docs.joinpeertube.org/admin/following-instances

I've thought about creating a "dummy" instance with user registration disabled which exists solely to mirror TankieTube videos.

[-] edie@lemmy.encryptionin.space 2 points 1 week ago* (last edited 1 week ago)

If what you want is to distribute the video delivery demand, then a CDN is more what you're looking for. Setting up another instance would be to help with everything else peertube does, showing lists of vids, channels, showing the vid page (but not the vid delivery), all of that stuff, and uploads (but of course not transcoding).


This user is suspected of being a cat. Please report any suspicious behavior.

[-] EdlritchEconomics@hexbear.net 2 points 1 week ago

I've never done it with postgres, and it's been a while since I've done this kind of thing in general. I'm also not familiar with your deployment, but postgres has options for all kinds of failover and load balancing scenarios.

[-] cream_provider@hexbear.net 1 points 1 week ago

Look into renting a dedicated server instead (bare metal, not cloud). Colocation is a headache and I’m not even sure how much money it would save you as you’re still paying the datacenter for bandwidth and remote hands to fix the server when something breaks.

Anonymity might be hard because you have to pay for the thing but i’m sure you can find a hosting provider that accepts crypto if you’re both in the US or US/Europe. Then just give the provider a bogus name and anonymous email. Just pick your contact info carefully as there is still a minimal fraud check for these type of things.

With dedicated hosting the provider maintains all the hardware, you handle everything from the OS up remotely. Unless there’s a specific reason you want to colocate (sorry didn’t read the whole post) that’s the way I would go.

[-] TankieTanuki@hexbear.net 2 points 1 week ago* (last edited 1 week ago)

I currently rent an AMD Ryzen 9 7950X3D dedicated server (with 128 GB DDR5 and a 2 TB NVMe) for $221.83/mo^[and 10 Gb/s with 100 TB of traffic for an additional $117.93/month]). How much would that cost to build?

Even if I stick with renting the primary server, I think I'll colocate a mass storage server to replace BackBlaze.

Edit: I just gandered at RAM prices meow-tableflip

[-] edie@lemmy.encryptionin.space 3 points 1 week ago

I don't know a whole lot about it. But do you really need 128 GB of ram?


This user is suspected of being a cat. Please report any suspicious behavior.

[-] TankieTanuki@hexbear.net 2 points 1 week ago

No. I just need the CPU. But most dedicated servers with powerful CPUs come with lots of RAM.

[-] edie@lemmy.encryptionin.space 3 points 1 week ago

Then if you were to make your own you could use less ram at least.


This user is suspected of being a cat. Please report any suspicious behavior.

[-] cream_provider@hexbear.net 3 points 1 week ago

Yeah everything is expensive right now. Hell of a time to rent or build your own. Maybe look on webhosttalk’s forums for some deals and advice.

I’m not sure on cost to build, but $220/month for a 128gb ryzen seems reasonable. Assuming the bandwidth is included.

[-] TankieTanuki@hexbear.net 2 points 1 week ago

35 TB of traffic at 1 Gb/s is included, but I bought more.

timmy-pray speech-side-l-1 Lord Beanis, please pop the AI bubble and make compute cheap speech-side-l-2

[-] cream_provider@hexbear.net 2 points 1 week ago* (last edited 1 week ago)

Hm so closer to $340/month then. You could probably do better if you shopped around honestly.

https://www.webhostingtalk.com/showthread.php?t=1956972

this post was submitted on 16 Apr 2026
84 points (100.0% liked)

technology

24341 readers
85 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 5 years ago
MODERATORS