But you are not reporting the underlying probability, just the guess. There is no way, then, to distinguish a bad guess from a good guess. Let's take your example and place a fully occluded shape. Now the most probable guess could still be a full circle, but with a very low probability of being correct. Yet that guess is reported with the same confidence as your example. When you carry out this exercise for all extrapolations with full transparency of the underlying probabilities, you find yourself right back in the position the original commenter has taken. If the original data does not provide you with confidence in a particular result, the added extrapolations will not either.

Looking at a half circle and guessing that the "missing part" is a full circle is as much of a blind guess as you can get. You have exactly zero evidence that there is another half circle present. The missing part could be anything, from nothing to any shape that incorporates a half circle. And you would be guessing without any evidence whatsoever as to which of those things it is. That's blind guessing.

Extrapolating into regions without prior data with a non-predictive model is blind guessing. If it wasn't, the model would be predictive, which generative AI is not, is not intended to be, and has not been claimed to be.