• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

First Commercial IBM Hot-Water Cooled Supercomputer to Consume 40% Less Energy

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
46,343 (7.68/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
The Leibniz Supercomputing Centre (LRZ), in collaboration with IBM, today announced the world's first commercially available hot-water cooled supercomputer, a powerful, high-performance system designed to help researchers and industrial institutions across Europe investigate and solve some of the world's most daunting scientific challenges.

The new LRZ "SuperMUC" system was built with IBM System x iDataPlex Direct Water Cooled dx360 M4 servers with more than 150,000 cores to provide a peak performance of up to three petaflops, which is equivalent to the work of more than 110,000 personal computers. Put another way, three billion people using a pocket calculator would have to perform one million operations per second each to reach equivalent SuperMUC performance. Also, a revolutionary new form of hot-water cooling technology invented by IBM allows the system to be built 10 times more compact and substantially improve its peak performance while consuming 40 percent less energy than a comparable air-cooled machine.



"This year all the electricity consumed by state-funded institutions across Germany are required to purchase 100% sustainable energy," said Prof. Dr. Arndt Bode, Chairman of the Board, Leibniz Supercomputing Centre. "SuperMUC will help us keep our commitment, while giving the scientific community a best-in-class system to test theories, design experiments and predict outcomes as never before."

Pioneering Hot-Water Cooled Technology
Up to 50 percent of an average air-cooled data center's energy consumption and carbon footprint today is not caused by computing, but by powering the necessary cooling systems. IBM scientists and developers chose to address this challenge with an innovative concept of hot-water cooling, which eliminates the need for conventional data center air cooling systems. IBM's hot-water cooling technology directly cools active components in the system such as processors and memory modules with coolant temperatures that can reach as high as 113 degrees Fahrenheit, or 45 degrees Celsius.

"As we continue to deliver on our long-term vision of a zero emission data center we may eventually achieve a million fold reduction in the size of SuperMUC, so that it can be reduced to the size of a desktop computer with a much higher efficiency than today," said Dr. Bruno Michel, manager, Advanced Thermal Packaging, IBM Research.


SuperMUC combines its hot-water cooling capability, which removes heat 4,000 times more efficiently than air, with 18,000 energy-efficient Intel Xeon processors. In addition to helping with scientific discovery, the integration of hot-water cooling and IBM application-oriented, dynamic systems management software, allows energy to be captured and reused to heat the buildings during the Winter on the sprawling Leibniz Supercomputing Centre campus, for savings of one million Euros ($1.25 million USD) per year.

Europe's Most Powerful Supercomputer
The SuperMUC system is Europe's fastest computer, according to the TOP500 list of the world's fastest supercomputers announced today. This performance will be used to drive a wide spectrum of research -- from simulating the blood flow behind an artificial heart valve, to devise quieter airplanes to unearthing new insights in geophysics, including the understanding of earthquakes. The SuperMUC system is also connected to powerful visualization systems, including a large 4K stereoscopic power wall and a five-sided immersive artificial virtual-reality environment or CAVE for visualizing 3D data sets from fields, including Earth science, astronomy and medicine.

The LRZ is the computer center for Munich's universities and for the Bavarian Academy of Sciences and Humanities. It takes care of the scientific data network in Munich, offers a variety of data services, and provides high-end computing facilities for the scientific community across Europe.

The center's new SuperMUC system is the largest in Europe and one of the most powerful systems in the world. It is part of the Partnership for Advanced Computing in Europe (PRACE) high-performance computing infrastructure for researchers and industrial institutions throughout Europe. The supercomputer is jointly funded by the German federal government and the state of Bavaria. It will be officially inaugurated in July 2012 at Leibniz Supercomputing Centre in Garching, Germany.

View at TechPowerUp Main Site
 
Last edited by a moderator:
Joined
Mar 7, 2011
Messages
3,922 (0.82/day)
I am interested in seeing some performance charts of the machine with this new cooling system. :respect:
 
Joined
Apr 7, 2011
Messages
1,380 (0.29/day)
System Name Desktop
Processor Intel Xeon E5-1680v2
Motherboard ASUS Sabertooth X79
Cooling Intel AIO
Memory 8x4GB DDR3 1866MHz
Video Card(s) EVGA GTX 970 SC
Storage Crucial MX500 1TB + 2x WD RE 4TB HDD
Display(s) HP ZR24w
Case Fractal Define XL Black
Audio Device(s) Schiit Modi Uber/Sony CDP-XA20ES/Pioneer CT-656>Sony TA-F630ESD>Sennheiser HD600
Power Supply Corsair HX850
Mouse Logitech G603
Keyboard Logitech G613
Software Windows 10 Pro x64
Joined
Oct 30, 2008
Messages
1,758 (0.31/day)
System Name Lailalo
Processor Ryzen 9 5900X Boosts to 4.95Ghz
Motherboard Asus TUF Gaming X570-Plus (WIFI
Cooling Noctua
Memory 32GB DDR4 3200 Corsair Vengeance
Video Card(s) XFX 7900XT 20GB
Storage Samsung 970 Pro Plus 1TB, Crucial 1TB MX500 SSD, Segate 3TB
Display(s) LG Ultrawide 29in @ 2560x1080
Case Coolermaster Storm Sniper
Power Supply XPG 1000W
Mouse G602
Keyboard G510s
Software Windows 10 Pro / Windows 10 Home
But can it play Crysis? ;D
 
Joined
Jun 24, 2011
Messages
571 (0.12/day)
Location
Islamabad
System Name Hhumas-PC
Processor Intel(R) Core(TM)2 Extreme CPU X9650 @ 3.00GHz (4 CPUs), ~3.0GHz
Motherboard Asus P5W DH Deluxe
Cooling ZALMAN CNPS 9700 NT 110mm 2 Ball Ultra Quiet
Memory OCZ Platinium 2x2GB
Video Card(s) ZOTAC GeForce GTX 680 2GB 256-bit GDDR5
Storage WD Green 500 GB , WD 500 GB
Display(s) Dell U2410F
Case Casecom
Audio Device(s) Creative Sound Blaster X-Fi Titanium Fatal1ty Pro
Power Supply Corsair HX1000
Software Windows 7 Ultimate 32 Bit
strange ..............
 
Joined
Oct 10, 2009
Messages
868 (0.16/day)
Location
London, UK
System Name The one under the desk / Media Centre
Processor Xeon X3730@3.6GHZ / Phenom II X4 805E
Motherboard Gigabyte P55M-UD4 / Asus Crosshair III
Cooling Corsair H70 + 2*PWM fan / Arctic Alpine 11
Memory 16GB DRR3-1333 9-9-9-27 / 4GB Crucial DDR3-1333
Video Card(s) Asus DirectCU GTX 680 / Gigabyte 560TI
Storage Kingston V200 128GB, WD6400AAKS, 1TB Seagate 7.2kRPM SSHD / Kingston V200 128GB
Display(s) Samsung 2343BW + Dell Ultrasharp 1600*1200 / 32" TV
Case C'M' Silencio 550 / Some ancient SilverStone brushed aluminium media centre
Audio Device(s) No.
Power Supply Thermaltake Toughpower XT 675W / EVGA 430W
Mouse Mionix Naos 3200 / Generic PS2
Keyboard Roccat Ryos TKL Pro / Evoluent Mouse Friendly Keyboard (Logitech OEM)
Software Windows 7 Ult x64
Benchmark Scores Nah.
I am interested in seeing some performance charts of the machine with this new cooling system. :respect:

This isn't about getting components as cool as possible. It's about using the heat from the computers to heat radiators in offices.
 
Joined
Sep 15, 2011
Messages
6,465 (1.41/day)
Processor Intel® Core™ i7-13700K
Motherboard Gigabyte Z790 Aorus Elite AX
Cooling Noctua NH-D15
Memory 32GB(2x16) DDR5@6600MHz G-Skill Trident Z5
Video Card(s) ZOTAC GAMING GeForce RTX 3080 AMP Holo
Storage 2TB SK Platinum P41 SSD + 4TB SanDisk Ultra SSD + 500GB Samsung 840 EVO SSD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Logitech Hero G502 SE
Software Windows 11 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
The SuperMUC system is also connected to powerful visualization systems, including a large 4K stereoscopic power wall and a five-sided immersive artificial virtual-reality environment or CAVE for visualizing 3D data sets from fields, including Earth science, astronomy and medicine.

:rockout::toast:
 

Fourstaff

Moderator
Staff member
Joined
Nov 29, 2009
Messages
10,020 (1.91/day)
Location
Home
System Name Orange! // ItchyHands
Processor 3570K // 10400F
Motherboard ASRock z77 Extreme4 // TUF Gaming B460M-Plus
Cooling Stock // Stock
Memory 2x4Gb 1600Mhz CL9 Corsair XMS3 // 2x8Gb 3200 Mhz XPG D41
Video Card(s) Sapphire Nitro+ RX 570 // Asus TUF RTX 2070
Storage Samsung 840 250Gb // SX8200 480GB
Display(s) LG 22EA53VQ // Philips 275M QHD
Case NZXT Phantom 410 Black/Orange // Tecware Forge M
Power Supply Corsair CXM500w // CM MWE 600w
A leak will make the engineers cry
 
Joined
Aug 19, 2011
Messages
528 (0.11/day)
System Name As Himself
Processor 2700X
Motherboard Asrock 370X ThaiChi
Cooling Custom Liquid
Memory 4133MHz Team
Video Card(s) Radeon VII
Storage Samsung 512 SSD's
Display(s) Asus "24 144Hz
Case Tt P5
Audio Device(s) Asus Essence One Muses/Sparkos
Power Supply EVGA 1200
Mouse RAT ProX
Keyboard Drop CTRL
Software W10 steam futuremark
using regular water poses significant risk to a multi million dollar machine i suppose... how'd you like to be the dope who's solderjoint leaks???
 
Joined
May 21, 2008
Messages
4,113 (0.71/day)
Location
Iowa, USA
System Name THE CUBE 2.0
Processor Intel i5 13600k
Motherboard MSI MPG Z690 EDGE DDR4
Cooling Phanteks PH-TC14PE BK 2x T30-120 Fan mod mount
Memory G.Skill TridentZ 3200 MT/s C15 32GB 2x16GB
Video Card(s) Gigabyte Aorus 1080 Ti 11GB OC: Core 2GHz, Mem 5.7GHz
Storage WD SN770 250GB / 3x WD SN850X 2TB / Toshiba X300 4TB / 2x RAID1 Toshiba P300 3TB
Display(s) Samsung 49" Odyssey OLED G95SC 240Hz 5120 x 1440
Case "THE CUBE" Custom built, pure Red Alder wood
Audio Device(s) Beyerdynamic DT 880
Power Supply Corsair RM1000X
Mouse Logitech G700
Keyboard Logitech G910
Software Windows 11 Pro
Man that would be soooo much fun to build all of those servers! that would be my dream job.
 
Joined
May 1, 2012
Messages
1,027 (0.24/day)
Location
New Jersey, USA
System Name Current Rig
Processor AMD 7800X3D
Motherboard MSI x670e Tomahawk wifi
Cooling Artic Freezer II 360
Memory G.Skill 32gb ddr5 6000mhz
Video Card(s) AMD 7900XTX 24 GB
Storage Samsung SSD 980 PRO 2TB
Display(s) Alienware 3420DW 120 Freesync
Case LianLi Lancool III white non-rgb
Audio Device(s) Onboard ALC
Power Supply Corsair Shift 1000W
Mouse G502 Hero
Keyboard Ducky Shine 5
Software Win 11 64bit
Benchmark Scores The second best!
Pictures 3 and 4 just wow!

That's some awesome cabling, but is zip-tying to copper pipes ok?
 

Andy77

New Member
Joined
May 7, 2009
Messages
119 (0.02/day)
That is how most HVAC systems are ran

HVAC is air based... still, if you take a look at any car I doubt you'll see something like this on the car's coolant hoses, nor or the AC pipes, maybe on some occasions, but on mine all are clear, even padded against contact.


Pictures 3 and 4 just wow!

That's some awesome cabling, but is zip-tying to copper pipes ok?

They might not get that hot to melt isolation but is sure make a good support for straightening out cables.
 
Joined
Sep 1, 2010
Messages
7,023 (1.41/day)
With all that heat and hot water they can build public baths for homeless people.
 

trickson

OH, I have such a headache
Joined
Dec 5, 2004
Messages
7,595 (1.07/day)
Location
Planet Earth.
System Name Ryzen TUF.
Processor AMD Ryzen7 3700X
Motherboard Asus TUF X570 Gaming Plus
Cooling Noctua
Memory Gskill RipJaws 3466MHz
Video Card(s) Asus TUF 1650 Super Clocked.
Storage CB 1T M.2 Drive.
Display(s) 73" Soney 4K.
Case Antech LanAir Pro.
Audio Device(s) Denon AVR-S750H
Power Supply Corsair TX750
Mouse Optical
Keyboard K120 Logitech
Software Windows 10 64 bit Home OEM
Blah,Blah,Blah. Can it make coffee? If not FUCK that shit!
 
Joined
Nov 16, 2007
Messages
1,166 (0.19/day)
Location
Hampton Roads
Processor Xeon x5650
Motherboard SABERTOOTH X58
Cooling Fans
Memory 24 GB Kingston HyperX 1600
Video Card(s) GTX 1060 3GB
Storage small ssd
Display(s) Dell 2001F, BenQ short throw
Case Lian Li
Audio Device(s) onboard
Power Supply X750
Software Mint 19.3, Win 10
Benchmark Scores not so fast...
With all that heat and hot water they can build public baths for homeless people.

I was thinking of a laundro-mat, bulk laundry (hospitals, restaurants, hotels). That would be efficient. But...the temps seem too low.
 
Joined
May 1, 2012
Messages
1,027 (0.24/day)
Location
New Jersey, USA
System Name Current Rig
Processor AMD 7800X3D
Motherboard MSI x670e Tomahawk wifi
Cooling Artic Freezer II 360
Memory G.Skill 32gb ddr5 6000mhz
Video Card(s) AMD 7900XTX 24 GB
Storage Samsung SSD 980 PRO 2TB
Display(s) Alienware 3420DW 120 Freesync
Case LianLi Lancool III white non-rgb
Audio Device(s) Onboard ALC
Power Supply Corsair Shift 1000W
Mouse G502 Hero
Keyboard Ducky Shine 5
Software Win 11 64bit
Benchmark Scores The second best!
With all that heat and hot water they can build public baths for homeless people.

Build a small foot bath sauna for some funky smelling IT people. It's not cool wearing socks with sandals :laugh:
 

trickson

OH, I have such a headache
Joined
Dec 5, 2004
Messages
7,595 (1.07/day)
Location
Planet Earth.
System Name Ryzen TUF.
Processor AMD Ryzen7 3700X
Motherboard Asus TUF X570 Gaming Plus
Cooling Noctua
Memory Gskill RipJaws 3466MHz
Video Card(s) Asus TUF 1650 Super Clocked.
Storage CB 1T M.2 Drive.
Display(s) 73" Soney 4K.
Case Antech LanAir Pro.
Audio Device(s) Denon AVR-S750H
Power Supply Corsair TX750
Mouse Optical
Keyboard K120 Logitech
Software Windows 10 64 bit Home OEM
You know what would be even better than all this? If they could make a chip that does not need any cooling at all. All this is just BS in my book.
 
Joined
Mar 10, 2010
Messages
11,878 (2.31/day)
Location
Manchester uk
System Name RyzenGtEvo/ Asus strix scar II
Processor Amd R5 5900X/ Intel 8750H
Motherboard Crosshair hero8 impact/Asus
Cooling 360EK extreme rad+ 360$EK slim all push, cpu ek suprim Gpu full cover all EK
Memory Corsair Vengeance Rgb pro 3600cas14 16Gb in four sticks./16Gb/16GB
Video Card(s) Powercolour RX7900XT Reference/Rtx 2060
Storage Silicon power 2TB nvme/8Tb external/1Tb samsung Evo nvme 2Tb sata ssd/1Tb nvme
Display(s) Samsung UAE28"850R 4k freesync.dell shiter
Case Lianli 011 dynamic/strix scar2
Audio Device(s) Xfi creative 7.1 on board ,Yamaha dts av setup, corsair void pro headset
Power Supply corsair 1200Hxi/Asus stock
Mouse Roccat Kova/ Logitech G wireless
Keyboard Roccat Aimo 120
VR HMD Oculus rift
Software Win 10 Pro
Benchmark Scores 8726 vega 3dmark timespy/ laptop Timespy 6506
:eek::wtf: They sorta hijacked my general idea and gave it a fancy name,,, use pc to heat house by Ocín snot thereoff,, then fold 24/7 on all inc soundcard iff poss(1 day;)) ,,, comence strolling about in shorts perm and call whole plan and effieciency a win:D.

with water you more choose what temp and noise to run at more then anything else ,my water hits 45-50 permanently
 

faramir

New Member
Joined
May 20, 2011
Messages
203 (0.04/day)
I was thinking of a laundro-mat, bulk laundry (hospitals, restaurants, hotels). That would be efficient. But...the temps seem too low.

Too low for direct usage in scenarios you outlined above perhaps, but heat pumps could be used to get higher temperature. That's still far more efficient than heating water up to really high temperatures directly.
 
Joined
Mar 30, 2011
Messages
959 (0.20/day)
System Name Better than before
Processor 10400
Motherboard B460 Pro4
Cooling Id-Cooling 224
Memory 16 GB
Video Card(s) 1650 Super
Storage Swordfish 500 GB
Display(s) AOC G2
Case Coolermaster Ammo 533
Audio Device(s) Micca MB42X
Power Supply Pure Power 11
Mouse G403
Keyboard Sidewinder x4
Software Windows 10 (ugh)
That's insane. Now lets find a game that can use 150,000 cores and 324 tb of memory.
 

jamsbong

New Member
Joined
Mar 17, 2010
Messages
83 (0.02/day)
System Name 2500Kjamsbong
Processor Core i5 2500K @ 4.6Ghz
Motherboard Asrock Extreme 4 Z68
Cooling Zalman Reserator (CPU and GPU)
Memory DDR3 8GB
Video Card(s) EVGA Nvidia 560Ti 1GB
Storage 60GB Kingston SSD
Display(s) 24" Dell IPS
Case CoolerMaster 690 Advanced II
Audio Device(s) on-board
Power Supply Zalman ZM-600HP modular 600watt
Software Windows 7
Thats what I usually do at home. Just power up my water cooled silent PC and game on it. The room will slowly warm up.
 
Joined
Sep 3, 2010
Messages
3,527 (0.71/day)
Location
Netherlands
System Name desktop | Odroid N2+ |
Processor AMD Ryzen 5 3600 | Amlogic S922X |
Motherboard Gigabyte B550M DS3H |Odroid N2+ |
Cooling Inter-Tech Argus SU-200, 3x Arctic P12 case fans | stock heatsink + fan |
Memory Gskill Aegis DDR4 32GB | 4 GB DDR4 |
Video Card(s) Sapphire Pulse RX 6600 (8GB) | Arm Mali G52 |
Storage SK Hynix SSD 240GB, Samsung 840 EVO 250 GB, Toshiba DT01ACA100 1T | Samsung 850 Evo 500GB |
Display(s) AOC G2260VWQ6 | LG 24MT57D |
Case Asus Prime 201 | Stock case (black version) |
Audio Device(s) integrated
Power Supply BeQuiet! Pure Power 11 400W | 12v barrel jack |
Mouse Logitech G500 |Steelseries Rival 300
Keyboard Qpad MK-50 (Cherry MX brown)| Blaze Keyboard
Software Windows 10, Various Linux distros | Gentoo Linux
This is about a supercomputer. All gaming related posters are politely but certainly being requested to leave this room and go the gaming section. Thank you.
 
Top