Unfortunately this is one of those things that you can't significantly develop/test on closed private streets.

Even if we hold this to be true (and I disagree in large part), the point is that Tesla's systems aren't at that stage yet. Failing to recognize lights correctly during live demos and such are absolutely things you can test and develop on closed streets or in a lab. Tesla's shouldn't be allowed on roads until they're actually at a point where there are no glaring flaws. And then they should be allowed in smaller numbers.

That's true, but I think the issue people have with "AutoPilot" is about marketing.

Tesla brands their cars' solution as being a full replacement for human interaction and word from Musk, other Tesla employees, media personalities close to Tesla, and fanboys all make out like the car drives itself and the only reason you need a driver in place is to satisfy laws.

It's bullshit. They know exactly what they're doing when they do the above, when they call their system "AutoPilot", when Musk makes claims his cars can travel from one side of the US to the other without human interaction (only to never actually do it, of course!), and sells car upgrades as Full Self Driving support.

If they branded it as Assisted Driving, Advanced Cruise Control, Smart Cruise, or something along those lines, like all the other carmakers do with their similar systems, I'd be less inclined to blame Tesla when there's an unfortunate incident. I think most would agree with me, too.

But Tesla markets and encourages, both officially and unofficially, that their cars have the ability to drive themselves, look after themselves, and that you're safe when using the system. It's a lie and I'm absolutely astounded they've had little more than a series of slaps on the wrist for it in most markets.

Should a couple handfuls of deaths if as you said you can't test it any other way? Autopilot systems could already be saving thousands of lives if more widely deployed and a lack of good reliable autopilot systems has the opportunity cost of blood on our hands. Human drivers are well established to be dangerous. Testing and release of autopilot systems should be done as safely as possible, but to think the first decade or so of these systems will be flawless seems unreasonable.

The fact is that most technology that we take for granted today went through a similar evolutionary phase with public use before they became as safe as they are now, especially cars themselves. For well over a century, the automobile has made countless leaps and bounds in safety improvements due to data gathered from public use studies.

We learn by doing.