Indeed. GPs have been doing this for a long time. It's nothing new, and expecting every GP to know every single ailment that humanity has ever experienced, to recall it quickly, and immediately know the course of action to take, is unreasonable. They are only human.

Like you say, if they're blindly following a generic ChatGPT instance trained on whatever crap it's scraped from the internet, then that's bad.

If they're aiding their search using an LLM that has been trained on a good medical dataset, then taking that and looking more into it, then there's no issue.

People have become so reactionary to LLMs and other AI stuff. It seems there's a "omg it's so cool everybody should use it to the max. Let's blindly trust it!" camp and a "it's awful and shouldn't exist, burn it all! No algorithms or machine learning anywhere. New tech is bad!"

Both camps are just as stupid. There's zero nuance in the discussion about this stuff, and it's tiring.