NVIDIA Blackwell a Focal Point in AI Factories; As Built by Dell Technologies

[T0@st]

Over a century ago, Henry Ford pioneered the mass production of cars and engines to provide transportation at an affordable price. Today, the technology industry manufactures the engines for a new kind of factory—those that produce intelligence. As companies and countries increasingly focus on AI, and move from experimentation to implementation, the demand for AI technologies continues to grow exponentially. Leading system builders are racing to ramp up production of the servers for AI factories—the engines of AI factories—to meet the world's exploding demand for intelligence and growth. Dell Technologies is a leader in this renaissance. Dell and NVIDIA have partnered for decades and continue to push the pace of innovation. In its last earnings call, Dell projected that its AI server business will grow at least $15 billion this year.

"We're on a mission to bring AI to millions of customers around the world," said Michael Dell, chairman and chief executive officer, Dell Technologies, in a recent announcement at Dell Technologies World. "With the Dell AI Factory with NVIDIA, enterprises can manage the entire AI lifecycle across use cases, from training to deployment, at any scale." The latest Dell AI servers, powered by NVIDIA Blackwell, offer up to 50x more AI reasoning inference output and 5x improvement in throughput compared with the Hopper platform. Customers use them to generate tokens for new AI applications that will help solve some of the world's biggest challenges, from disease prevention to advanced manufacturing.




Dell servers with NVIDIA GB200 are shipping at scale for a variety of customers, such as CoreWeave's new NVIDIA GB200 NVL72 system. One of Dell's U.S. factories can ship thousands of NVIDIA Blackwell GPUs to customers in a week. It's why they were chosen by one of their largest customers to deploy 100,000 NVIDIA GPUs in just six weeks. But how is an AI server made? We visited a facility to find out.

Building the Engines of Intelligence
We visited one of Dell's U.S. facilities that builds the most compute-dense NVIDIA Blackwell generation servers ever manufactured. Modern automobile engines have more than 200 major components and take three to seven years to roll out to market. NVIDIA GB200 NVL72 servers have 1.2 million parts and were designed just a year ago.

Amid a forest of racks, grouped by phases of assembly, Dell employees quickly slide in GB200 trays, NVLink Switch networking trays and then test the systems. The company said its ability to engineer the compute, network and storage assembly under one roof and fine tune, deploy and integrate complete systems is a powerful differentiator. Speed also matters. The Dell team can build, test, ship - test again on site at a customer location - and turn over a rack in 24 hours.

The servers are destined for state-of-the-art data centers that require a dizzying quantity of cables, pipes and hoses to operate. One data center can have 27,000 miles of network cable—enough to wrap around the Earth. It can pack about six miles of water pipes, 77 miles of rubber hoses, and is capable of circulating 100,000 gallons of water per minute for cooling.

With new AI factories being announced each week—the European Union has plans for seven AI factories, while India, Japan, Saudi Arabia, the UAE and Norway are also developing them—the demand for these engines of intelligence will only grow in the months and years ahead.

View at TechPowerUp Main Site | Source

 

[bonehead123]

Skynet = DellGreediya

 

[Why_Me]

Some outfit (forget who), just signed a deal with Nvidia for something like $60 billion dollars for gpu's.

 

[Hecate91]

"Over a century ago, Henry Ford pioneered the mass production of cars and engines to provide transportation at an affordable price."

Comparing Ford, who built affordable cars for the masses, to Nvidia focusing on AI while the market that built them up in the first place are left paying more for less. What a weird analogy,lol.

 

[Chaitanya]

Serve the Home has better video posted about this particular Dell assembly line about 12 days back.

 

[AGlezB]

Comparing Ford, who built affordable cars for the masses, to Nvidia focusing on AI while the market that built them up in the first place are left paying more for less. What a weird analogy,lol.

I agree it is a weird analogy but I have to point out that if Ford could do what nVidia is doing they'd do it without missing a beat, because that's just how capitalism works.
And if nVidia had access to enough manufacturing capacity they wouldn't drop any market segment, because that's also how capitalism works.

 

[Red Hood]

Dell servers with NVIDIA GB200 are shipping at scale for a variety of customers, such as CoreWeave's new NVIDIA GB200 NVL72 system. One of Dell's U.S. factories can ship thousands of NVIDIA Blackwell GPUs to customers in a week

Does that include Singapore and Malayasia?

 

[Hecate91]

I agree it is a weird analogy but I have to point out that if Ford could do what nVidia is doing they'd do it without missing a beat, because that's just how capitalism works.

Ford did do what Nvidia is doing, in car terms they ignored manufacturing cars the average buyer could afford, Ford and the entire car industry are panicking with a lot of unsold cars.

And if nVidia had access to enough manufacturing capacity they wouldn't drop any market segment, because that's also how capitalism works.

Nvidia has access to manufacturing older nodes with Samsung so they don't have to ignore the gaming market, because that's also how capitalism works.

 

[AGlezB]

Ford did do what Nvidia is doing, in car terms they ignored manufacturing cars the average buyer could afford, Ford and the entire car industry and panicking with a lot of unsold cars.

nVidia is in a very unique position where demand is far greater than supply and there isn't a lot a competition. Those are ideal market conditions for any product in any market. Cars, on the other hand, are the exact opposite: lot's of competition resulting in supply outpacing demand. One doesn't need to be a genius financial analyst to figure out that under those conditions if you let go of a market segment you'll never getting it back.

BTW, ASML is in the same position as nVidia. They can't produce their machines fast enough and they have even less competition.

Nvidia has access to manufacturing older nodes with Samsung so they don't have to ignore the gaming market, because that's also how capitalism works.

Chips are designed specifically for the node they are going to be manufactured in. Different node means different design for a bunch of reasons, most of which I understand only superficially.
And chip design is very expensive. At current transistor densities we're talking about anything from hundreds of millions to the low billions invested in every new GPU design before it is ready to hit the market.
Think about it: if it was cheap everyone and their mothers would be making high-end GPUs and AI-accelerators instead of letting nVidia own the market. Same with ASML.

EDIT: I'm still waiting for AMD to figure out how to bring the chiplet design to the GPU market. It'll be good for nVidia to get same "here's more power for cheaper" slap AMD gave to Intel.