I generally agree with what the post is saying but this part
I think that we'll still be coding, but with some other layer, as LLMs are good with structured input, like programming languages. So we might need other programming languages than we have atm. Might we need different tools to evaluate LLMs' output to make it deterministic? Might we need a different approach for engineering to make it scalable? Might we need more?
I just don't see this happening to be honest. It's the same thing people keep claiming about "prompts replacing code"
Let's say you do make it deterministic. Then why do you need the LLM for it? You can just build a plain old compiler for it. Why add Anthropic or Open AI as an expensive middleman to your operations. There's already a lot of admin plugins that will set up entire routes and pages based off of a db model. The reason people don't purely work off of those is the world isn't modeled off of simple CRUD. There are so many edge cases and requirements that aren't easy to model in a sweeping generalization that you need some way of fine tuning that.
So if you scrap that you're back to "prompts as code". Which also sucks.
If you have a PR change that's breaking production and the only change is to a prompt
Make the popup background ~~red~~ blue
How the hell do you triage what went wrong? Do you revert and roll the dice that the LLM is gonna get it right? No one in their right mind would ever think this is okay in a production setting?
I don't want to say we'll never have a higher level extraction, but I don't think it'll be due to LLMs.
I feel ya. I've been told the same thing at my job as well.
I'd say "find a new gig" but honestly every place has been bitten by this hype train it seems like.
I've been doing a hybrid approach where I use the chatbot to do rudimentary things like label renames and then just do a lot of my work "the normal way". That way I log some token usage to say I use the tools and then bet that my output isn't going to be drastically different from my coworkers.
Then when the hype train dies we can all hopefully go back to doing what we do best. It's just a shitty period that I hope we can ride out.