33
Supermarket AI meal planner app suggests recipe that would create chlorine gas
(www.theguardian.com)
For news articles which seem so much like satire that you're surprised they're not from The Onion.
An example of the misalignment problem. Humans and AI both agreed on the stated purpose (generate a recipe), AI just had some deeper goals in mind as well.
I doubt it had nefarious intentions. My money is on the bot just being stupid.
If I ask you to create a drink using Windex and Clorox would you do any different? Do you have alignment problem too?
Yes, I know better, but ask a kid that and perhaps they'd do it. A LLM isn't thinking though, it's repeating training through probabilities. And btw, yes, humans can be misaligned with each other, having self goals underneath common ones. Humans think though...well, most of them.