213
LLMs are eroding my software engineering career and I don't know what to do
(human-in-the-loop.bearblog.dev)
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Follow the wormhole through a path of communities !webdev@programming.dev
Yes, you're right. However, for fear of coming off as an AI sycophant (I've yet to sacrifice my brain at the altar of our future AI overlords), LLMs aren't the whole picture. Plenty of research is dedicated to essentially combining the best of each class of AI algorithms into a composite model of intelligence. For instance, "Neuro-Symbolic AI" is really just the result of giving an LLM (good at translation, search, synthesis, bad at symbolic reasoning) a symbolic inference engine like Prolog (good at symbolic reasoning, no native ability for translation/search/synthesis). I've been coding for over 20 years, and I'm impressed at its results for software development.
This all is reminiscent of Moore's Law; even though we keep running into the physical limits of CPU clock speeds, transistor size, etc. we keep finding clever ways to work around those limits.
Of course I'm not saying we should; these models are, after all, models of intelligence, not wisdom.
Edit: fix apostrophe splice
Being reasonable about the tech is kind of a pain, here. At least we only got one flavor of campist, so anyone seeing outright "boosters" is jumping at shadows. I just think the chatbot that can code is neat. Maybe we can do stuff with it. Maybe it doesn't need to spy on everyone forever.
We accidentally invented p-zombies and they're already more intelligent than script kiddies. Once the grifters move on we can see what that's good for.
Agreed. The bubble has to pop eventually... Or not, and we really are marching towards our own obsolescence as a species.
I mean, AGI is inevitable, but it's never gonna come from these dinguses. They can't even look past LLMs far enough to pursue text diffusion.
To imagine we cannot possibly build a mind, or that it cannot possibly improve that same effort, is baffling. It changes the shape of the universe.
Just because it's possible does not mean it's inevitable. It's incredibly optimistic to think that we can get our shit together enough to pull it off before we destroy all our productive capacity through hubris.
Nothing's inevitable. And as for "building a mind", while it depends on precisely what you mean by "mind", it's totally possible that only a biological brain can produce minds as we understand the word "mind". Building AGI doesn't necessarily mean building a mind. And since thoughts seem to be properties of "matter", and there seem to be rules about which configurations of matter produce mind, we don't necessarily know that there are other configurations that can produce minds. We might produce something else equally interesting which still is not a mind.
Bollocks. Thought is a process, like math. Nothing meat does with signals is impossible in other substrates.
At the utmost extreme: surely we can simulate physics at whatever level is necessary for virtual brains to function. Physical neurons are not gonna rely on quantum chromodynamics. Mere chemistry will probably suffice.
And hand-waving things that are like-minds-but sounds like Chinese Room nonsense.
You say that, and GAs were used decades ago to design FPGAs to a spec. The evolved design worked perfectly on the test chip, so the design was copied onto a second chip and it failed. The logic gates were identical but the GA had utilised microscopic differences in the substrate and there were large areas of programmed chip totally unconnected to the main circuit. Without them, the first chip didn’t work any more.
There are likely quantum effects available at the size / scale of neurons, and it’s brave to say evolution wouldn’t exploit them if there was some benefit.
Yeah yeah yeah, probably exploiting capacitance instead of on-spec functionality, I'm well familiar with this example. It's not relevant - there's eight billion human brains in the world, and they generally still function despite the wild shit we put them through. They are not fragile.
A human mind is not balanced on a knife-edge, where one tiny difference breaks everything. They're complex enough that sometimes blowing a railroad spike clean through just alters functionality. It's still a mind. Subatomic interactions surely cannot be crucial here.
And again, this is only the extreme example. Y'think all known laws of the universe are mandatory? Great, simulate those too. Same answer: meat has no monopoly on thought because metal can fake the meat. There is no philosophical basis for even suggesting AGI is impossible, unless you start talking about souls.
The scale of neurons is too big for quantum effects, but that's contemporary understanding that may change in the future. We're really far from understanding both what mind is and how to make one