Using LLMs for that purpose is not very intelligent.

They tend to lack highly specialized logic and spatial reasoning as well as long-term consistency. Also dimwits are part of the training set.