292
top 50 comments
sorted by: hot top controversial new old
[-] anonproxy00@lemm.ee 33 points 1 month ago

i have like 10 tb of documented changes from just the us govnt websites. I log every. single. change. to a selection of both local and federal .gov sites. Ive got a pi, whos only job is to find and log this. I figure this kinda documentation could be historically significant if sombody tries to alter the past.

idk why I do this, I just like the info. I wanna build a website to display these changes.

ik the internet archives exist....but what if somthing happens?

48TB rust in raidz2 reporting in

[-] Saik0Shinigami@lemmy.saik0.com 20 points 1 month ago
[-] Sixtyforce@sh.itjust.works 17 points 1 month ago
[-] Saik0Shinigami@lemmy.saik0.com 7 points 1 month ago

Heh... I'm actually rewatching Dragon Ball right now.

[-] Sixtyforce@sh.itjust.works 4 points 1 month ago

Awesome! I like the original series best by a decent margin. Soooo good.

[-] SCmSTR@lemmy.blahaj.zone 3 points 1 month ago

Watched it for the first time last year. It was incredible. Absolutely holds up to modern stuff.... Except for some absolute creep moments around Bulma, various sexism... The overall purity culture weirdness.... Some really homophobic things... Some really racist things.... ...

Okay. It has issues. Lots of really big issues. But the music is amazingly fresh and the visuals top notch and it's always entertaining, minus the glaring problems. And that they did Lunch so dirty for some reason.

load more comments (2 replies)
[-] gravitas_deficiency@sh.itjust.works 6 points 1 month ago* (last edited 1 month ago)

Holy shit, you’ve nearly 20x’d me 🫡

[-] Saik0Shinigami@lemmy.saik0.com 12 points 1 month ago* (last edited 1 month ago)

Check again...

That's "free space". The 414 represents ~62% of my space (38% used). I'm at just under 700 for usable space. And 2 disks are out of the array at the moment because the backplane went stupid. Turns out that it's a pain in the ass to open server chassis to replace a backplane when you have to unmount 70 disks. And I'm pretty lazy.

6 x RAIDZ2 | 10 wide | 14.55 TiB
873TiB raw.
960TB raw.

This graph might be better...

[-] gravitas_deficiency@sh.itjust.works 5 points 1 month ago* (last edited 1 month ago)

lol yeah - I revised my comment from 10x to 20x after looking closer. You literally 20x’d me lol.

That is some thicc storage. Respect.

[-] Saik0Shinigami@lemmy.saik0.com 5 points 1 month ago

Let's just say that I do my part seeding Linux ISOs.

~72 TB uploaded the past 30 days.

I am unfortunately the epitome of a data hoarder. I still have files that I generated/created 30 years ago...

Damn, what sort of connection are you running? I feel like you’d be getting throttled, assuming throttling isn’t strictly illegal (side note: genuinely, thank you, People’s Republic of Massachusetts ❤️)

[-] Saik0Shinigami@lemmy.saik0.com 8 points 1 month ago* (last edited 1 month ago)

Fiber, 8gbps through Quantum Fiber (part of the Lumen/Centurylink family). No throttling here...

My bottleneck is the vpn that I have to have between me and the world... unfortunately. I only trust specific private trackers to not use it. I actually setup 4 seed boxes (VMs) in my garage to push more data out.

Proxmox cluster... and big storage truenas node.

And a dirty amount of networking... big cables on the right is QSFP, 40gbps 2x in lagg per server.

These pictures were just after a transplant to a new server rack. So everything is off... but the blinkin' lights are real.

Edit: Didn't turn off anything before I ran these...

[-] SCmSTR@lemmy.blahaj.zone 5 points 1 month ago

Jfc please make sure that's hazard proof and don't get raided. People like you legitimately make the world go round.

[-] Saik0Shinigami@lemmy.saik0.com 3 points 1 month ago

So about that... I actually got solar installed on my house and when the "electrician" (subbed out contractor with dubious credentials but was operating under a legit company) ran dedicated breakers for the servers... the junction box caught fire.

That was a fun 2am to wake up at.

But it's pretty safe now. Have had several master electricians come in and evaluate it all at this point and all of them are happy with it now.

load more comments (2 replies)
[-] Agent641@lemmy.world 4 points 1 month ago

How do you afford all this?

I’m gonna guess incremental increases over the years, and snapping up used enterprise stuff on fire sale. It’s actually pretty feasible to do if you know where to look for this stuff.

[-] Saik0Shinigami@lemmy.saik0.com 4 points 1 month ago* (last edited 1 month ago)

More or less exactly this. Most of my servers are company decommission (some companies have a strict upgrade cycle, and I even have like 3 more "spares" sitting around). I've found some government liquidation here and there as well which has been great for resale to recoup some of what I spend. I have something like 4TB of Ram sitting in a box somewhere that I should sell somewhere...

Some stuff was "decent" ebay buys. A few items I just had to pony up for. Battery backups was mostly paid at full msrp, but has been worth it. HDDs are mostly "refurb" and built up over time as well, which is why raidz2 and several spares in the zfs pool.

But yeah, about 10 years of building it up. I use it as my playground for professional development, and it's helped prove a lot of what I say on my resume.

When you have a functional setup like this, and can show that to potential employer. It's been the best sole investment I've ever made. It's netted me more money in contracts by many many times what I put into it.

Edit: and saved me from countless "cloud" privacy violations, data breaches, etc...

Edit2: Recurring costs is basically energy. The rack itself uses about 90kWh a day (about $5/day for me), cooling and all. My solar install creates just about that much per day as well so that's all offset (and if I ever move my equipment into a colo, my house will basically have no electric bill at all). Internet is $165 a month, which is fucking great IMO... VPN is paid every 3 years or whatever that cycle is on. If I was to just take the non-replaceable stuff (about 20tb worth of data at last check, and a bunch of lxc containers) and put that on a VPS somewhere I'd be paying at least 10x what I do now in someone else's datacenter, forget that that's a recurring monthly cost.

Edit3: Just because it is likely useful information for SOMEONE out there... If you know that your setup takes 10kWh a day, you need to account for another %50 for cooling, so you should actually expect 15kWh in that usecase. My actual rack uses ~60... 30 more is cooling. I actually have all my power usages broken out in a sankey graph... Even goes further to break it down on a per server usage as well, but I can't take a reasonable screenshot that doesn't show personal information. This is 24 hours of usage (specifically 04/30, yesterday) and "garage dedicated" is what the A/C unit I have in the bottom of my rack is plugged into.

I’m in an apartment currently; the footprint I’m willing to allocate to a server amounts to a full-size ATX case, and a bunch of small ebay’d lenovo thin clients (plus a handful of rPi’s and similar SBCs). When I finally am able to get a house with some actual project space, I aspire to build something approaching your setup over time.

[-] Saik0Shinigami@lemmy.saik0.com 4 points 1 month ago

I started on cluster (8) of rpi3b and a Synology NAS 10 years ago... prior to that was just storing it all on random hdd (harddrive toaster was alway present and loaded on my desk) and on my computer. these days you can get those little intel n100 or n150 boxes for pretty cheap too. There's a lot of options, and a lot of mature software tech to make it all work well together.

load more comments (3 replies)
[-] SCmSTR@lemmy.blahaj.zone 2 points 1 month ago

Probably years of passion. Possibly a career related to this stuff.

[-] gravitas_deficiency@sh.itjust.works 3 points 1 month ago* (last edited 1 month ago)

Ngl I am quite envious. That’s awesome.

[-] realitista@lemm.ee 8 points 1 month ago* (last edited 1 month ago)

20gb strewn across 3 RAIDS, no idea what file system type they use.

[-] Sixtyforce@sh.itjust.works 6 points 1 month ago
[-] OhVenus_Baby@lemmy.ml 5 points 1 month ago* (last edited 1 month ago)

8TB reporting for duty. 🫡😂

Seriously though. What's the best help to lend out say 2tb?

Edit:This is a serious question.

I think it was annas archive that has a page for what data they need mirrored the most based on your storage space available. After looking into it.

[-] DarkDarkHouse@lemmy.sdf.org 6 points 1 month ago* (last edited 1 month ago)

You can take a look at Interplanetary File System and see what data you want to mirror.

load more comments (1 replies)
[-] douglasg14b@lemmy.world 3 points 1 month ago

32TB right now.

Got +80TB coming in the mail!

And offside backup coming soon ™️

[-] Someonelol@lemmy.dbzer0.com 2 points 1 month ago

14TB RAID1 setup reporting in.

[-] ripcord@lemmy.world 2 points 1 month ago

324TB misc here for duty

load more comments (1 replies)
[-] pulido@lemmings.world 27 points 1 month ago

I agree. I recommend most people don't go overboard, but they can still do their part.

Save the things you like and are relevant to you. Movies, shows, games, music, books, etc. You don't have to be an archivist. Storing data should be something that reflects you, personally, and it should genuinely be more enjoyable as a result.

It should feel good to preserve and be responsible for another copy of the information you like.

[-] GreenKnight23@lemmy.world 10 points 1 month ago

3tb of porn and growing.

momma always said, "do what you like you thick sumbitch, yer gon do it anyway."

she was right. I did it anyway.

load more comments (1 replies)
[-] forgotaboutlaye@lemmy.world 8 points 1 month ago

Music is a no brainer for me since it's something that is infinitely re-enjoyable (if that's a word) and it doesn't have to take up much space, without reasonable compromises to quality.

I bought a digital audio player last year so that I could be offline and disconnected when I go out but still enjoy music. One of my favourite purchases the last few years.

load more comments (1 replies)
[-] frezik@midwest.social 2 points 1 month ago

Instructions unclear, setup personal Project Gutenberg mirror.

(Started months ago, actually. Their main archive server isn't very fast.)

[-] atomicbocks@sh.itjust.works 27 points 1 month ago

Lots of people hoard data. The problem is keeping it in a working state. Think about how many people have old towers or laptops in their garage or basement never to look at those downloads or vacation photos again.

[-] SCmSTR@lemmy.blahaj.zone 6 points 1 month ago

I'm a huge fan of the golden era of anime fansubs. I know a lot of people still have the files, but they're probably squirreled away on an offline hdd or a bunch of dvds, not being shared. It's quite sad and frustrating. It's completely lost culture in many instances.

[-] Nyticus@kbin.melroy.org 25 points 1 month ago

The day the Internet Archive was being attacked and sued, was the signal.

[-] Allero@lemmy.today 21 points 1 month ago

On an unrelated note: the site has the least invasive adblock banner I've ever seen. Made me wish to immediately turn it off.

1000073621

[-] yggstyle@lemmy.world 21 points 1 month ago
[-] Routhinator@startrek.website 7 points 1 month ago
[-] yggstyle@lemmy.world 5 points 1 month ago

Take what you can ... 🏴‍☠️

[-] Gradually_Adjusting@lemmy.world 3 points 1 month ago

And seed the hell out of it! 🦜

[-] ultrafastsloth@lemmy.world 13 points 1 month ago* (last edited 1 month ago)

I don’t know who here likes Horizon games, but I like how many parallels the writers put in the game that reflect the state of the world.

::: spoiler a bit of a game spoiler

Like the whole premise of the story is exactly what this article mentioned: a multi billionaire CEO with a god complex completely wiped out the entire human database to erase any information of how he destroyed the world to protect his ego and image. Also why the new world is basically just bronze age level tribes.

:::

[-] Imgonnatrythis@sh.itjust.works 7 points 1 month ago

They don't have to participate, but it's a good article to raise awareness for your non tech oriented friends and family.

This is a massive problem, but at the very least it's happening in an era of very cheap data storage.

[-] TriflingToad@sh.itjust.works 7 points 1 month ago

my coolest data hoard (im not insane, I only have like 3tb, mostly of games) was the doom 1993 files.

me at 2am tinkering with my computer had an emotional connection to another computer nerd back in 1995 at like 11:30 at night who was packaging doom files that through dozens of exchanges made it's hands to mine.

Wonder who it was and how they're doing now..

[-] SabinStargem@lemmy.today 3 points 1 month ago

Picked up a 24tb external drive. My video collection and stuff is going onto it, so that I can nuke my PC's drives and start fresh. The odds of Microsoft being a Trump Regime collaborator are high, so I want to be ready to hop out of the frypan when the time comes.

Aside from that, I have been ripping and converting my discs again. AV1 offers nice space savings. Patlabor, OG Dragonball, documentaries, all will be updated.

load more comments
view more: next ›
this post was submitted on 30 Apr 2025
292 points (99.0% liked)

Technology

71399 readers
2510 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS