1093

CEO of Google Says It Has No Solution for Its AI Providing Wildly Incorrect Information (futurism.com)

submitted 7 months ago by Stopthatgirl7@lemmy.world to c/technology@lemmy.world

426 comments fedilink hide all child comments

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments

[-] Metype@lemmy.world 25 points 7 months ago

So you have a product that you've made into a system for getting answers. And then you couldn't be bothered to try and sanitize training data enough to get your answer system's new headline feature from spreading blatantly incorrect information? If it doesn't work, maybe don't ship it.

[-] iAvicenna@lemmy.world 5 points 7 months ago

The worst part is they don't seem to realize their responsibility in this as the leading search engine that the majority of the world uses. They seem to have the mindset "our answers are potentially dangerous for users but it is ok we have an army of lawyers"

[-] xavier666@lemm.ee 5 points 7 months ago

I think the problem they are facing is data quantity. Sanitizing possibly terabytes of text data is a humongous task. They have probably used an AI to do the cleanup but the more suble errors have passed through the filter.

[-] bignate31@lemmy.world 1 points 7 months ago

Yeah, the problem is how to sanitise effectively. You've gotta be able to find a way to automatically strip out "bad" things from your training data (via an "oracle"). But if you already had that oracle, you could just slap it on your final product (e.g. Search) and make all the "bad" things disappear before they hit the user (via some sort of filter).

[-] xavier666@lemm.ee 2 points 7 months ago

I'm pretty sure google's final solution will be using mechanical turks

[-] Rivalarrival@lemmy.today 1 points 7 months ago

Reddit users were infamous trolls and shitposters leaning heavily on sarcasm. The problem they are in facing is Poe's law.

this post was submitted on 27 May 2024

1093 points (98.1% liked)

Technology

60076 readers

2177 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago

MODERATORS