Right now, car AI has trouble both with kids and non-white persons. That said, when it comes to the things it is good at detecting, the cars respond much more quickly. This came up when an official asked about how it detects brake lights, and the project advisor (from Google, I think) explained that the car doesn't worry about break lights but instantly detects when a car ahead of it rapidly decelerates, and responds immediately.

I'm pretty sure we can get cars smart enough and sharp enough to drive better than humans. But the recent incident in San Francisco where Cruise driverless taxis blocked an ambulance with a patient in critical condition (resulting in their death), suggests to me we underestimated the layers of logistics necessary to make cars truly autonomous.

Randal Munroe listed a few more incidents we can expect (Obligatory XKCD).