858
muskrat's data eng expert's hard drive overheats while processing 60k rows
(lemmy.dbzer0.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 16 Mar 2025
858 points (98.8% liked)
Programmer Humor
21615 readers
1893 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 2 years ago
MODERATORS
that's somehow worse.
a "data analyst" couldn't cut up the work into a parallel processes and run them synchronously? what the actual fuck?
"sorry, I can only do 60k at a time."
just fucking split them up into 6 parallel batch processes running 10k at a time. it's fucking math, not rocket science. I'm not even an analyst and I could fucking do that much.
I don't want to take away from the valid point of your comment, but rocket science is almost exclusively math