Monday, April 22nd 2019
Tesla Dumps NVIDIA, Designs and Deploys its Own Self-driving AI Chip
Tesla Motors announced the development of its own self-driving car AI processor that runs the company's Autopilot feature across its product line. The company was relying on NVIDIA's DGX processors for Autopilot. Called the Tesla FSD Chip (full self-driving), the processor has been deployed on the latest batches of Model S and Model X since March 2019, and the company looks to expand it to its popular Model 3. Tesla FSD Chip is an FPGA of 250 million gates across 6 billion transistors crammed into a 260 mm² die built on the 14 nm FinFET process at a Samsung Electronics fab in Texas. The chip packs 32 MB of SRAM cache, a 96x96 mul/add array, and a cumulative performance metric per die of 72 TOPS at its rated clock-speed of 2.00 GHz.
A typical Autopilot logic board uses two of these chips. Tesla claims that the chip offers "21 times" the performance of the NVIDIA chip it's replacing. Elon Musk referred to the FSD Chip as "the best chip in the world," and not just on the basis of its huge performance uplift over the previous solution. "Any part of this could fail, and the car will keep driving. The probability of this computer failing is substantially lower than someone losing consciousness - at least an order of magnitude," he added.Slides with on-die details follow.
A typical Autopilot logic board uses two of these chips. Tesla claims that the chip offers "21 times" the performance of the NVIDIA chip it's replacing. Elon Musk referred to the FSD Chip as "the best chip in the world," and not just on the basis of its huge performance uplift over the previous solution. "Any part of this could fail, and the car will keep driving. The probability of this computer failing is substantially lower than someone losing consciousness - at least an order of magnitude," he added.Slides with on-die details follow.







39 Comments on Tesla Dumps NVIDIA, Designs and Deploys its Own Self-driving AI Chip
Nvidia is just slightly behind Intel, but they also target different cars (mostly premium brands).
But yeah... level 3 is the highest we can get without massive changes to law and infrastructure. Most companies hope to get there in 2020-2021.
Level 5 (cars without manual controls) is decades away even if the AI part will be ready in 5 years.Intel is a clear AI inference leader at the moment.
Nvidia is leading in learning thanks to the GPUs and Tensors. But this could change with Intel Xe - we'll see soon enough.Well, this is being researched at the moment by all sides (governments, police, insurance companies, carmakers).
Some part of the liability will always be with the car owner. Some will be moved to the manufacturer.
It's quite similar to what we have today. You could have a crash, initially evaluated to be your fault. But if it turns out that the brakes were badly made or assembled, the manufacturer or service will be held responsible.Infrastructure is paid with tax money. Gas tax is just a part of the budget.
Nvidia is focusing on AI and try to sell AI in the PC gaming market also. Well, everyone is doing that actually, promoting AI capabillities, but no one tries to charge twice the price for the product just because, well, you know, it comes with AI that does this and that (raytracing in Nvidia's case). Nvidia's focus is in AI the last couple of years. That's what I mean that they 'll have to come back to the PC market. I mean they have to make it a priority again.
2. Or just phase out taxes all together because they are the most useless invention. Taxes are the devil lol
Interesting note.
PX2 was originally quoted at 250w tdp, and pegasis at 500w tdp.
144 int8 tops is truly impressive for 72w .... that actually beats the t4 130tops/70w efficiency.*Bought several inference chip companies: Nervana, Movidius, Altera
Which stagnated for several years after purchase (Altera )
They finally announced the first new cards since acquisition.
I watched Intels presentation on some of the Altera cards, found it interesting that they kind of peaked performance at INT 11.
The flexibility and ability to adjust and rearrange is uniquely interesting... that said, nvidia dropped the T4 right after they almost caught up on inferencing performance with the P4.
Qualcomm's solution will be in the >100Tops range most likely int8 (based on some slide math, ai100 = >50x SD820, SD855 =3x SD820, SD855=7Tops)
Depending on TDP that will make the inferencing realm more cozy.
Intel's advantage is in mindshare and their One Api... training on Nervana/Xe, inference on Movidius, Altera and Xeon... trying to control the whole stack and make a vertical solution. They have a lot of different potent IP.
If only tesla was selling these chips to others, that would really stir the pot up.
So the victims will not be compensated?
2. So how will be roads maintained? Slave work?
2. One thing people forget is that plenty great nations in history were build without needing taxation(nor slavery). The USA was established without taxation and actually it was created in order to avoid british taxation(or one of the motives). The only time america began using taxes is first during the civil war and then more added around the world wars 1 and 2/great depression. Taxes fund wars and not roads lol. Anyways this is an extremely generalized view on this, but to be honest i was more sarcastic initially when i said it. Though sarcasm sure has some elements of truth.
The legislator decides who is responsible.
And it's not that simple.
Of course, the passengers can't be held responsible for AI driving errors. But a car is so much more than just driving. You, as the owner (not driver!), will still be expected to look after tires (state, pressure), brakes (disks, calipers, fluid), remove snow and so on.
You'll be required to clean all the cameras before every journey, i.e. the car shouldn't start at all even if there's a tiny piece of mud before the lens (because it can easily cover a pedestrian).
And what if something attaches in front of the camera while driving?
After a 200km of highway driving in summer, I have hundreds of insects splashed all over the front of the car. And I'm in central Europe - it has to be way worse in places like Brazil or India.
Will the car stop and force you to clean it? And what if it's on a highway and stopping isn't allowed?
There are so many questions and so many scenarios that we're not even close to finding a solution. Making an AI fast enough not to hit other objects is just a part of the problem.It's not that common globally, but sure - that's one of the possible outcomes.Tesla is a car-making branch of a technological "Musk Group". It's not a surprise that they've decided to make an in-house inference system. All Musk's companies are heavily invested into AI.
Other car makers will not go this path. AI chips (computers in general) are very far from what they focus on - which is designing cars.
There's no reason for BMW or Ford to invest billions in making their own AI chip, when they buy mechanical parts(like brakes or dampers) from specialized manufacturers.
Sure, they can be very rare, but what if it happens that YOU are the one killed? Or your loved one? Suddenly is personal.
And you can't have closure with a machine... You can't put it in jail, it's not even show remorse or regret. You'll be a "blip".
There will be no "insurance", I saw no believable suggestion for responsibility in case of a computer error.
Also, roads need to be build and maintained. It's only fair that whomever uses them to pay for them, there is no free lunch.
I understand the mentality that "others should pay for me", but that leads to society collapse. Like happend in Eastern Europe communism. Or Venezuela. You run out of "other people" money.
Someone pays for everything in the end, in general taxes and fees are supposed to make it "fair". Sure politicians will corrupt the system just because they promise free stuff to the idiots that are believing them. That's why they hate the ideea of a flat tax... they lose the power of dangling free stuff in front of voters.
PS: As for the fact that there were no taxes in US history - sure. That's why it was so great without them - dust bowl, depression, hunger, unemployment, horrid work conditions (no OSHA), weak military (we barely could fight pirates), roads of dirt.
Nobody wants to go back to that.