Pretty much nailed it. My students that use chatGPT have done pretty well in the first few weeks, but fall apart as soon as I start asking questions that rely on a nuanced understanding of the concepts or to extrapolate ideas from the previous work.

ChatGPT is a very promising tool, but so many people don't understand LLMs at all and dumbass students try and get it to do all their thinking for them....