866
muskrat's data eng expert's hard drive overheats while processing 60k rows
(lemmy.dbzer0.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 16 Mar 2025
866 points (98.8% liked)
Programmer Humor
21615 readers
2031 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 2 years ago
MODERATORS
60k is laughably, embarrassingly small. It's still sqlite-sized.
Sqlite can easily handle millions of rows. Don't sell it short
How about a 6.4TB sqlite database?
https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
Should be enough to hold 60k rows
I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
I'm not
i mean its even excel sized depending on how many columns. This is seriously sad and alarming
Hey now that's real close to the 65,535 16-bit limit (from 20 years ago)
Holy shit if this ids lm issue that’s too funny
60k is single json file