I’ve tried chat prompt coding two ways. One, with a language I know well. It didn’t go well; it insisted that an api existed that had been deprecated since before and removed around 2020, but I didn’t know that and I lost a lot of time. I also lost a lot of time because the code was generally good, but it wasn’t mine so I didn’t have a great understanding of how it flowed. I’m not a professional dev so I’m not really used to reading and expanding on others’ code. However, the real problem is that it did some stuff that was just not real, and it wasn’t obvious. I got it to write tests (something I have been meaning to learn to do) and every test failed; I’m not sure if it’s the test or the code because the priority for me at the time was getting code out, not the tests. I know, I should be better.

I’ve also used it with a language I don’t know well to accomplish a simple task - basically vibe coding. That went OK as far as functionality but based on my other experience it is illegible, questionably written, and not very stable code.

The idea that it’ll replace coders in a meaningful way is not realistic in the current level. My understanding of how LLMs work is incomplete, but i don’t think the hallucinations are easily overcome.