My initial reaction to the announcement clips was that of disgust.

Like auditory uncanny valley. The result is impressive, but holy fuck hearing it speak makes me cringe, I want to shut it up asap.

Unplug it before it can ask if I want to kill myself, as if it actually cares, and isn't a million coin tosses away from acting on some random training data to encourage me to do it instead of not.

To interact with humans with such sycophancy, I am viscerally creeped out imagining the design objectives.

The worst part is, it's being presented with the same false confidence that LLMs themselves exhibit... Even as they confidently explain how simple it is to prove the earth is flat when you ask.

Fucking hell, the tech is amazing, but can we not handwave away the limitations and irresponsibly apply it to literally everything, as if just a few more yottabytes of training data means it'll stop making mistakes "aaaany second now".