Wednesday, November 5th 2025

Liquid Cooling for NVIDIA GB300 "Blackwell Ultra" NVL72 Costs Nearly $50,000

NVIDIA's "Blackwell Ultra" server racks are undoubtedly powerful, but they demand significant system cooling. NVIDIA promotes the GB300 NVL72 as the top configuration: these liquid-cooled racks, built with Grace Blackwell Ultra Superchips, achieve exascale-class dense FP4 performance and offer substantial improvements in throughput-per-megawatt compared to previous HGX platforms. However, this extreme performance mandates massive cooling systems, which can cost around $50,000. According to a valuation model from investment bank Morgan Stanley, NVIDIA is spending nearly $50,000 on cooling for the 72-GPU configuration within its Oberon rack. With each chip rated at 1,400 W TDP, traditional air-based cooling solutions are not feasible.

Considering that there are 72 GPUs rated up to 1,400 W, that is over 100 kW from GPUs alone. Add 32 "Grace" CPUs that are powering the system, and you have more than a 100 kW of heat at the peak load. Morgan Stanley models the rack as containing 18 compute trays (each consuming roughly 6.6 kW but needing cooling for about 6.2 kW) alongside nine switch trays. The firm values the cooling components for a single compute tray at about $2,260, which multiplies to roughly $40,680 across the rack. Switch-tray cooling adds about $1,020 per tray, or $9,180 total. High-performance cold plates are singled out as the most expensive parts in the BOM, with per-unit prices in the low hundreds.
Interestingly, the report also projects that the upcoming "Vera Rubin" NVL144 configuration will require even more thermal hardware as GPUs and interconnects increase power draw. Morgan Stanley estimates that cooling costs could rise by approximately 17% to about $55,710. This reflects a well-known pattern: as compute density and TDP increase, so do the expenses and engineering complexity of maintaining systems within thermal limits. With switches consuming more electricity, the cooling costs for this advanced system are expected to climb, adding to the challenge of managing heat dissipation in increasingly powerful AI infrastructure.
Sources: Jukan on X, via Tom's Hardware
Add your own comment

20 Comments on Liquid Cooling for NVIDIA GB300 "Blackwell Ultra" NVL72 Costs Nearly $50,000

#1
MentalAcetylide
With regards to cooling demands vs. increasing AI performance, I start to wonder when cost of cooling is going to make it prohibitively expensive to run. I start to wonder if this stuff should only be limited to research and military stuff. Its just silly how they want to use AI for everything and anything they can to make $$$. Do we make our way into a blunder? I start to wonder. :oops:
Posted on Reply
#2
Dr. Dro
MentalAcetylideWith regards to cooling demands vs. increasing AI performance, I start to wonder when cost of cooling is going to make it prohibitively expensive to run. I start to wonder if this stuff should only be limited to research and military stuff. Its just silly how they want to use AI for everything and anything they can to make $$$. Do we make our way into a blunder? I start to wonder. :oops:
It's clearly not cost prohibitive enough for these large corporations, but that wouldn't stop them. They'd simply use older generation tech, bumping the consumer space even further down the priority list.
Posted on Reply
#3
TumbleGeorge
MentalAcetylideWith regards to cooling demands vs. increasing AI performance, I start to wonder when cost of cooling is going to make it prohibitively expensive to run. I start to wonder if this stuff should only be limited to research and military stuff. Its just silly how they want to use AI for everything and anything they can to make $$$. Do we make our way into a blunder? I start to wonder. :oops:
When your "ai" freezer get your gun and shoot you.... /s
Posted on Reply
#4
john_
72 GPUs, $50000. That's less than $1000 per GPU. Considering that a water cooled gaming RTX 5090 offered by the usual suspects, like ASUS, MSI etc., could be selling for $1000 over MSRP if not even more, $50000 might be considered cheap for something like a GB300 NVL72 that costs, how much? 2 millions? More?
Posted on Reply
#5
outlw
Neat, they are using Belimo control valves in their system.

50k does not seem too terrible, all things consodered.
Remember, this 50k cooling system is covering 72 massively expensive GPUs, along with the rest of the server.
I would be very surprised if this 50k was more than 1% of the total cost for a fully kitted rack.

For larger data centers, it makes much more sense to have a centralized cooling system.
They are a bit more expensive, though...

Case in point, this 4MW CDU skid I put together for a customer.
Each of their data centers will need a minimum of 10 units, with each CDU costing at least 800k€.
And keep in mind, this does not include any of the equipment that actually cools the medium 😅

Posted on Reply
#6
AnnCore
Staff
Can't all that heat being generated be used for something useful like heating a few dozen homes or something?
Posted on Reply
#7
Noci
Well, all things considered I think I can get my wife to complain a little less when I spend some nickels on my watercooling/PC hobby :D.

When I tell/show her some watercooling solutions cost up to $ 50,000 and that what I spend on my PC is peanuts compared to that, she probably will mellow her opinion :roll:.
Of course I won't bother her with the facts & figures and obvious reality that my rig is not even a pocket calculator compared to that monsterous GB300 NVL72 :shadedshu::laugh:.
Might be worth a try, but if she doesn't fall for the decoy I might get :nutkick::kookoo::laugh:.

But seriously, over 100kW of heat, I hope that they give the heatreturn some good thoughts by not wasting much as I love Mother Earth and all this id adding to our abuse of her.
(by the way, I've no intention to turn this into a political/environmental discussion. There are other forums for that, thank you)
Posted on Reply
#8
outlw
AnnCoreCan't all that heat being generated be used for something useful like heating a few dozen homes or something?
Unfortunately not.
At least with the system I am working on, our target return temperature is 35°C.
It would be hot enough for in-floor heating, but not much else 🫤
Posted on Reply
#9
Dr. Dro
AnnCoreCan't all that heat being generated be used for something useful like heating a few dozen homes or something?
The deployment of heat pipes to transfer and recycle waste heat is a relatively new thing and still in the research stage. I'm unsure there is any consideration in regards to datacenters, but at the rate it's going, it'll become a necessity sooner rather than later.
Posted on Reply
#10
outlw
To expand, 35°C is the target return temp for our system.
Before you can use the heat energy somewhere else, it needs to pass through a minimum of two heat exchangers, each of which require a few °C of thermal spread to extract the energy.
Add to this the losses over your supply lines, and it ends up being too cold to heat much of anything.

If you really wanted, you could use it to pre-heat a district heating system 🤔
You would probably be better off trying to harvest the waste heat from the heat pumps, but this would also be challenging.

At the very least, though, the waste heat from the thermal power plant supplying the data center should be being used for district heating, so it is not a complete loss!
Posted on Reply
#11
Eliad Buchnik
AnnCoreCan't all that heat being generated be used for something useful like heating a few dozen homes or something?
Big part of how well you can produce useful work from heat engine depends on delta between heat source and cold sink. Since your main goal with cooling systems for electronics is to keep the coolant quite close to ambient temperature, it will be counter productive for generating work. I would say it will be the same for heating - the relative low coolant temperature and heat energy loss on the way means coolant will be to low of a temperature for effective heating homes.
Posted on Reply
#12
ymdhis
john_72 GPUs, $50000. That's less than $1000 per GPU. Considering that a water cooled gaming RTX 5090 offered by the usual suspects, like ASUS, MSI etc., could be selling for $1000 over MSRP if not even more, $50000 might be considered cheap for something like a GB300 NVL72 that costs, how much? 2 millions? More?
Oh no, no. That's "less than $1000" just for cooling the GPU. The GPU itself, I imagine it starts at five figures and that's a conservative estimate.
Posted on Reply
#13
TheinsanegamerN
MentalAcetylideWith regards to cooling demands vs. increasing AI performance, I start to wonder when cost of cooling is going to make it prohibitively expensive to run. I start to wonder if this stuff should only be limited to research and military stuff. Its just silly how they want to use AI for everything and anything they can to make $$$. Do we make our way into a blunder? I start to wonder. :oops:
Well that opens up a whole can of worms. Who gets to consider what is silly? How do you determine what power level can be used for purpose? Who gets to set limits on power use?

Then you have to ask how you would prevent such controls from being abused.
AnnCoreCan't all that heat being generated be used for something useful like heating a few dozen homes or something?
How are you going to move that heat? Shared heating systems were tried at the turn of the 20th century, and were abandoned largely because they proved to be very inefficient. Even if you insulate the pipes, the sheer losses from taking that heat and heating water, then bleeding that heat off in a home would make it unusable.

Hot air would be even worse. Once buildings get large enough you have to go with water heating.
Posted on Reply
#14
trsttte
john_72 GPUs, $50000. That's less than $1000 per GPU. Considering that a water cooled gaming RTX 5090 offered by the usual suspects, like ASUS, MSI etc., could be selling for $1000 over MSRP if not even more, $50000 might be considered cheap for something like a GB300 NVL72 that costs, how much? 2 millions? More?
This article from Barrons claims a single rack costs 3 million, pretty silly to even blink at 50000$, 1.67% of the cost of the rack, pretty much a rounding error lol

www.barrons.com/livecoverage/nvidia-earnings-stock-price-jensen-huang/card/nvidia-s-multi-million-dollar-ai-servers-are-getting-more-expensive-fQAv8OTMJhJU0Ql8VzWZ
Posted on Reply
#16
Lianna
TheinsanegamerNHow are you going to move that heat? Shared heating systems were tried at the turn of the 20th century, and were abandoned largely because they proved to be very inefficient. Even if you insulate the pipes, the sheer losses from taking that heat and heating water, then bleeding that heat off in a home would make it unusable.
In some parts of Europe "shared heating systems" are currently used on a city scale and are considered efficient.

I can agree that relatively low water temperature in some rack cooling systems could at least require a different approach.
Posted on Reply
#17
TheinsanegamerN
LiannaIn some parts of Europe "shared heating systems" are currently used on a city scale and are considered efficient.

I can agree that relatively low water temperature in some rack cooling systems could at least require a different approach.
In the densest cities, yes.

Not in the suburban or rural parts of the country, like where these data centers are being built. The systems in use are also more traditional sources: heating hot water with things like trash incineration and waste heat from industry. Datacenter heat is still experimental, and suffers from the issue that the coolant in said system isnt allowed to get hot enough to carry significant heat long distance. The newest deployments are playing around with 70C coolant, but watercooling typically tries to stay in the 30-40C range.

That means you'll need to collect that heat and concentrate it, which is going to be difficult and impose significant efficiency loss.
Posted on Reply
#18
trsttte
TheinsanegamerNIn the densest cities, yes.

Not in the suburban or rural parts of the country, like where these data centers are being built. The systems in use are also more traditional sources: heating hot water with things like trash incineration and waste heat from industry. Datacenter heat is still experimental, and suffers from the issue that the coolant in said system isnt allowed to get hot enough to carry significant heat long distance. The newest deployments are playing around with 70C coolant, but watercooling typically tries to stay in the 30-40C range.

That means you'll need to collect that heat and concentrate it, which is going to be difficult and impose significant efficiency loss.
There are solutions to the second problem: heat pumps, transfer the heat to a cold gas than compress it to get even hotter.

The issue is really transporting that heat from suburban/rural places efficiently, just the infrastructure necessary for it makes it not worth it, might as well install a vapor turbine to generate some electricity directly, but again the cost of it all will hardly break even.
Posted on Reply
#19
FoulOnWhite
So much power sucked up by these systems, no wonder electricity demands have sky rocketed.
Posted on Reply
#20
londiste
john_72 GPUs, $50000. That's less than $1000 per GPU.
Looking at the table on the image - 6 cold plates per compute tray, 18 trays per rack. 108 cold plates. 72 GPUs, 32 CPUs plus a couple to spare? Then 9 switch trays per rack with 2 cold plates each, 18 total. Plus other odds and ends. 126 cooled things. 400$ or so for each is not bad at all. I don't think this includes any actual cooling but even for cold plates, piping, QDs, mounting and fans that does not seem bad at all.
Posted on Reply
Add your own comment
Nov 20th, 2026 13:01 PST change timezone

New Forum Posts

Popular Reviews

TPU on YouTube

Controversial News Posts