1365
How it started vs. How it's going
(lemmings.world)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 17 Mar 2025
1365 points (99.8% liked)
Programmer Humor
34491 readers
265 users here now
Post funny things about programming here! (Or just rant about your favourite programming language.)
Rules:
- Posts must be relevant to programming, programmers, or computer science.
- No NSFW content.
- Jokes must be in good taste. No hate speech, bigotry, etc.
founded 5 years ago
MODERATORS
Your example of catastrophic failure is... e-mail? Spam filters are wrong all the time, and they're still fantastic. Glancing in the folder for rare exceptions is cognitively easier than categorizing every single thing one-by-one.
If there's one false negative, you don't go "Holy shit, it's the actual prince of Nigeria!"
But sure, let's apply flawed models somewhere safe, like analyzing medical data. What?
Obviously fucking not.
Even in car safety, a literal life-and-death context, a camera that beeps when you're about to screw up can catch plenty of times where you might guess wrong. Yeah - if you straight-up do not look, and blindly trust the beepy camera, bad things will happen. That's why you have the camera and look.
If a single fuckup renders the whole thing worthless, I have terrible news about human programmers.
Okay, so you can’t conceive of the idea of an email that it’s important that you don’t miss.
Let’s go with what Apple sold Apple Intelligence on, shall we? You say to Siri “what time do I need to pick my mother up from the airport?” and Siri coombs through your messages for the flight time, checks the time of arrival from the airline’s website, accesses maps to get journey time accounting for local traffic, and tells you when you need to leave.
With LLMs, absolutely none of those steps can be trusted. You have to check each one yourself. Because if they’re wrong, then the output is wrong. And it’s important that the output is right. And if you have to check the input of every step, then what do you save by having Siri do it in the first place? It’s actually taking you more time than it would have to do everything yourself.
AI assistants are being sold as saving you time and taking meaningless busywork away from you. In some applications, like writing easy, boring code, or crunching more data than a human could in a very short time frame, they are. But for the applications they’re being sold on for phones? Not without being reliable. Which they can’t be, because of their architecture.
This absolutism is jarring against your suggestion of applying the same technology to medicine.
Siri predates this architecture by a decade. And you still want to write off the whole thing as literally useless if it's ever ever ever wrong... because god forbid you have to glance at whatever e-mail it points to. Like skimming one e-mail to confirm it's from your mom, about a flight, and mentions the time... is harder than combing through your inbox by hand.
Confirming an answer is a lot easier than finding it from scratch. And if you're late to the airport anyway, oh no, how terrible. Everything is ruined forever. Burn your computers and live in the woods, apparently, because one important e-mail was skipped. Your mother had to call you and then wait comfortably for an entire hour.
Perfect reliability does not exist. No technology provides it. Even with your prior example, phone alarms - I've told Android to re-use the last timer, when I said I wanted twenty minutes, and it didn't go off until 6:35 PM, because yesterday I said that at 6:15. I've had physical analog alarm clocks fail to go off in the morning. I did not abandon the concept of time, following that betrayal.
The world did not end because a machine fucked up.