You mean hallucinations like this one?

If its job is to write a fan fic on what may or may not be true on what you asked for, then it does a great job. But typically people search for information, and getting what is essentially a glorified auto complete isn't useful. It's like big tech has learned nothing about the massive issue of disinformation and just added fuel to the fire to an unsolved problem we're still very much trying to figure out.

I'd have to send you back in time.

Oh, come on, he has a solution, and it's “making money”.

The greatest scapegoat ever created. AI did it not us, oh no!

This is only a problem if you present the AI as an effective general-purpose tool. Which Google has.

So maybe we start suing google for harmful answers.