I think it's also the speed and number of connections leading to the topic change. I think many neurotypicals would jump from the carnival to the rodeo, or to the bee story, but they wouldn't jump all the way to wondering about wasps from talking about the carnival in one go.

From the outside, the topic change is so different that neurotypicals can't follow the connections.