Tesla Autopilot drove into Wile E. Coyote-style fake road wall in the middle of the road in a camera versus lidar test.
While most companies developing self-driving technologies have been using a mix of sensors (cameras, radar, lidar, and ultrasonic), Tesla insists on only using cameras.
The automaker removed radars from its vehicle lineup and even deactivated radars already installed in existing vehicles.
The strategy has yet to pay off as Teslaβs systems are still stuck at level 2 driver assist systems.
CEO Elon Musk claims that Teslaβs advantage is that once it solves autonomy, it will be able to scale faster than competitors because its vision plus neural net system is designed to work like a human driver and, therefore, will be able to adapt to any road.
Critics have pushed back against those claims, especially since Musk mentioned Tesla achieving βlevel 5 autonomyβ, which means βin any conditions,β and cameras have limitations on that front that are fixed by lidar sensors.
A new video by engineering Youtuber Mark Rober has provided a very interesting demonstration of that very problem:
In the video, Rober puts a Tesla Model Y on Autopilot against a vehicle using a lidar system in a series of tests in different conditions.
The Tesla on Autopilot managed to stop for a kid mannequin in the middle of the road when statics, moving, and blinded by lights, but it couldnβt stop in fog or heavy rain:

Itβs not surprising that the lidar, a laser-based system, is capable of detecting better in heavy fog than a camera system.
The heavy rain was a bit more surprising, but to be fair, the level of rain was quite spectacular.
The last scenario of a Wile E. Coyote-style wall with a fake road painted on it was obviously not realistic, but it serves to illustrate the issue with cameras versus radar or lidar sensors: they rely on the perception of potential obstacles rather than hard data about potential obstacles.
In simple words, the lidar sensors didnβt care what was painted on the wall, they only cared that it was a wall, while cameras can be tricked.
Electrekβs Take
I think itβs clear that no Tesla vehicle currently available will be capable of level 5 autonomy as Elon claimed.
Level 4 is also questionable.
I think you can accomplish a lot with cameras, but I think itβs undeniable that adding radars and lidars can make systems safer.
In DMs with us during Teslaβs transition to vision only, Elon even admitted that βvery high-resolution radars would be better than pure visionβ, but he claimed that βsuch a radar does not existβ:
βA very high-resolution radar would be better than pure vision, but such a radar does not exist.β
When we pointed one out to him, he didnβt respond. Also, while they use light rather than radio waves, lidars are basically high-resolution radars, but the problem is that Musk has taken such a strong stance against them for so long that now that they have improved immensely and reduced in prices, he still canβt admit that he was wrong and use them.