559
Supermarket AI meal planner app suggests recipe that would create chlorine gas
(www.theguardian.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 10 Aug 2023
559 points (98.1% liked)
World News
32365 readers
277 users here now
News from around the world!
Rules:
-
Please only post links to actual news sources, no tabloid sites, etc
-
No NSFW content
-
No hate speech, bigotry, propaganda, etc
founded 5 years ago
MODERATORS
Nothing to do with AI, Garbage in, Garbage out.
LLMs are tools that satisfies requests. The developer decided to allow people to put the ingredients for chlorine Gas into the input - LLM never stood a chance but to comply with the instructions to combine them into the end product.
Clear indication we are in the magical witch hunt phase of the hype cycle where people expect the technology to have magical induction capabilities.
We could discuss liability for the developer but somehow I don’t think a judge would react favorably to “So you put razor blades into your bread mixer and want to sue the developer because they allowed you to put razor blades into the bread mixer”
I think it was more poking fun at the fact that the developers, not the LLM, basically didn't do any checks for edible ingredients and just exported it straight to an LLM. What I find kind of funny is you could've probably exported the input validation to the LLM by asking a few specific questions about whether or not it was safe for human consumption and/or traditionally edible. Aside from that it seems like the devs would have access to a database of food items to check against since it was developed by a grocery store...
I do agree, people are trying to shoehorn LLMs into places they really don't belong. There also seems to be a lot of developers just straight piping input into a custom query to chatgpt and spitting out the output back to the user. It really does turn into a garbage in garbage out situation for a lot of those apps.
On the other hand, I think this might be a somewhat reasonable use for LLMs if you spent a lot of time training it and did even the most cursory of input validation. I'm pretty sure it wouldn't even take a ton of work to get some not completely horrendous results like the “aromatic water mix” or "rat poison sandwich" called out in the article.