361
AI coders think they’re 20% faster — but they’re actually 19% slower
(pivot-to-ai.com)
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Follow the wormhole through a path of communities !webdev@programming.dev
ok.. what are you trying to point out?
That the script could incorporate some checking mechanisms and implement an "i dont know" for when the LLMs answers fails some tests.
They already do some of that but for other purposes, like censoring, or as by recent news, grok looks up musks opinions before answering questions, or to make more accurate math calculations they actually call a normal calculator, and so on...
They could make the LLM produce an answer A, then look up the question on google and ask that LLM to "compare" answer A with the main google results looking for inconsistencies and then return "i dont know" if its too inconsistent. Its not a rigorous test, but its something, and im sure the actual devs of those chatbots could make something much better than my half baked idea.