• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

IBM Unveils Industry's Most Advanced Server Designed for Artificial Intelligence

Raevenlord

News Editor
Joined
Aug 12, 2016
Messages
3,755 (1.33/day)
Location
Portugal
System Name The Ryzening
Processor AMD Ryzen 9 5900X
Motherboard MSI X570 MAG TOMAHAWK
Cooling Lian Li Galahad 360mm AIO
Memory 32 GB G.Skill Trident Z F4-3733 (4x 8 GB)
Video Card(s) Gigabyte RTX 3070 Ti
Storage Boot: Transcend MTE220S 2TB, Kintson A2000 1TB, Seagate Firewolf Pro 14 TB
Display(s) Acer Nitro VG270UP (1440p 144 Hz IPS)
Case Lian Li O11DX Dynamic White
Audio Device(s) iFi Audio Zen DAC
Power Supply Seasonic Focus+ 750 W
Mouse Cooler Master Masterkeys Lite L
Keyboard Cooler Master Masterkeys Lite L
Software Windows 10 x64
IBM today unveiled its next-generation Power Systems Servers incorporating its newly designed POWER9 processor. Built specifically for compute-intensive AI workloads, the new POWER9 systems are capable of improving the training times of deep learning frameworks by nearly 4x allowing enterprises to build more accurate AI applications, faster.

The new POWER9-based AC922 Power Systems are the first to embed PCI-Express 4.0, next-generation NVIDIA NVLink and OpenCAPI, which combined can accelerate data movement, calculated at 9.5x faster than PCI-E 3.0 based x86 systems. The system was designed to drive demonstrable performance improvements across popular AI frameworks such as Chainer, TensorFlow and Caffe, as well as accelerated databases such as Kinetica. As a result, data scientists can build applications faster, ranging from deep learning insights in scientific research, real-time fraud detection and credit risk analysis.





POWER9 is at the heart of the soon-to-be most powerful data-intensive supercomputers in the world, the U.S. Department of Energy's "Summit"and "Sierra" supercomputers, and has been tapped by Google.

"Google is excited about IBM's progress in the development of the latest POWER technology," said Bart Sano, VP of Google Platforms "The POWER9 OpenCAPI Bus and large memory capabilities allow for further opportunities for innovation in Google data centers."

"We've built a game-changing powerhouse for AI and cognitive workloads," said Bob Picciano, SVP of IBM Cognitive Systems. "In addition to arming the world's most powerful supercomputers, IBM POWER9 Systems is designed to enable enterprises around the world to scale unprecedented insights, driving scientific discovery enabling transformational business outcomes across every industry."



Accelerating the Future with POWER9
Deep learning is a fast growing machine learning method that extracts information by crunching through millions of processes and data to detect and rank the most important aspects of the data.

To meet these growing industry demands, four years ago IBM set out to design the POWER9 chip on a blank sheet to build a new architecture to manage free-flowing data, streaming sensors and algorithms for data-intensive AI and deep learning workloads on Linux.

IBM is the only vendor that can provide enterprises with an infrastructure that incorporates cutting-edge hardware and software with the latest open-source innovations.

With PowerAI, IBM has optimized and simplified the deployment of deep learning frameworks and libraries on the Power architecture with acceleration, allowing data scientists to be up and running in minutes. IBM Research is developing a wide array of technologies for the Power architecture. IBM researchers have already cut deep learning times from days to hours with the PowerAI Distributed Deep Learning toolkit.



Building an Open Ecosystem to Fuel Innovation
The era of AI demands more than tremendous processing power and unprecedented speed; it also demands an open ecosystem of innovative companies delivering technologies and tools. IBM serves as a catalyst for innovation to thrive, fueling an open, fast-growing community of more than 300 OpenPOWER Foundation and OpenCAPI Consortium members.

View at TechPowerUp Main Site
 
Joined
Jan 8, 2017
Messages
8,942 (3.36/day)
System Name Good enough
Processor AMD Ryzen R9 7900 - Alphacool Eisblock XPX Aurora Edge
Motherboard ASRock B650 Pro RS
Cooling 2x 360mm NexXxoS ST30 X-Flow, 1x 360mm NexXxoS ST30, 1x 240mm NexXxoS ST30
Memory 32GB - FURY Beast RGB 5600 Mhz
Video Card(s) Sapphire RX 7900 XT - Alphacool Eisblock Aurora
Storage 1x Kingston KC3000 1TB 1x Kingston A2000 1TB, 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) LG UltraGear 32GN650-B + 4K Samsung TV
Case Phanteks NV7
Power Supply GPS-750C
That's a lot of cache.
 
Joined
Apr 1, 2013
Messages
223 (0.06/day)
Why IBM is always out of the context of the market ?

AI is about scalability, because it's very expensive. And there you go, they just tell us "we have the biggest one, and for sure the most expensive one. And on top of that, it's POWER9 architecture. U MAD BRO ?"

Seriously, everybody works with x86 ... and mainly because scalability of the system and handling of the cost is easier. Here you have to buy nuclear head of 20MT to start. WTF ...
 
Joined
Sep 14, 2017
Messages
610 (0.25/day)
I wish AMD & Intel did more L4 (eDRAM or HBM2) on their enthusiast and server lines. This thing has an amazing about of cache and IBM's SMT is also great, 4-way and 8-way. Anandtech did a review and it scales so well.
 
Joined
Jun 10, 2014
Messages
2,902 (0.80/day)
Processor AMD Ryzen 9 5900X ||| Intel Core i7-3930K
Motherboard ASUS ProArt B550-CREATOR ||| Asus P9X79 WS
Cooling Noctua NH-U14S ||| Be Quiet Pure Rock
Memory Crucial 2 x 16 GB 3200 MHz ||| Corsair 8 x 8 GB 1333 MHz
Video Card(s) MSI GTX 1060 3GB ||| MSI GTX 680 4GB
Storage Samsung 970 PRO 512 GB + 1 TB ||| Intel 545s 512 GB + 256 GB
Display(s) Asus ROG Swift PG278QR 27" ||| Eizo EV2416W 24"
Case Fractal Design Define 7 XL x 2
Audio Device(s) Cambridge Audio DacMagic Plus
Power Supply Seasonic Focus PX-850 x 2
Mouse Razer Abyssus
Keyboard CM Storm QuickFire XT
Software Ubuntu
Why IBM is always out of the context of the market ?

AI is about scalability, because it's very expensive. And there you go, they just tell us "we have the biggest one, and for sure the most expensive one. And on top of that, it's POWER9 architecture. U MAD BRO ?"

Seriously, everybody works with x86 ... and mainly because scalability of the system and handling of the cost is easier. Here you have to buy nuclear head of 20MT to start. WTF ...
They might have a tough time due to the architecture and the high price, but Power does have a niche market with customers needing high bandwidth for GPUs.

But Power is dying, just like SPARC, Alpha and Itanium. Its last stand is very specialized compute workloads, but even there I don't see a bright future for Power. And if IBM goes all in on AI, then they surely will kill it. Power + Nvidia Tesla may offer the ultimate AI performance at the moment, but this will change within few years when AI ASICs arrive, and then super-expensive Power CPUs along with Teslas wouldn't stand a chance against "cheap" specialized chips.

I wish AMD & Intel did more L4 (eDRAM or HBM2) on their enthusiast and server lines. This thing has an amazing about of cache and IBM's SMT is also great, 4-way and 8-way. Anandtech did a review and it scales so well.
Well, only certain workloads scale well above two threads per core. As you increase thread count, the cache efficiency decreases, resulting in more cache misses and stalls. Power9 actually introduces 4-way SMT in addition to 8-way SMT over Power8 which had 8-way SMT, because it will scale better for many workloads, such as VMs. Having many threads per core will only be beneficial when the threads are mostly stalled anyway and the cache misses doesn't get much worse from it.
 
Last edited:
Joined
Apr 1, 2013
Messages
223 (0.06/day)
this will change within few years when AI ASICs arrive

Indeed !
Every modern CPU/GPU are not made to do this kind of work, and ASIC systems are way more advanced and cheaper (mainly in terms of space and consumption) in the end.

Even if a niche exists and is profitable, this one is going to collapse really fast in the next years. I think it's a really bad move to engage this kind of change right now. Many European companies, or having activities in Europe will have to manage the new law about Data storage (GDPR link : https://publications.europa.eu/en/p...85e15-11bd-11e6-ba9a-01aa75ed71a1/language-en).
It's going to be a fucking huge mess in the next few years and we are more focused on this rather than buying a powerful server.

Not respecting this can cause 10M€ (yes, Million) or 5% of your revenue. And you pay the higher ! So startup can face a 10M€ lawsuit ...
 

rtwjunkie

PC Gaming Enthusiast
Supporter
Joined
Jul 25, 2008
Messages
13,909 (2.42/day)
Location
Louisiana -Laissez les bons temps rouler!
System Name Bayou Phantom
Processor Core i7-8700k 4.4Ghz @ 1.18v
Motherboard ASRock Z390 Phantom Gaming 6
Cooling All air: 2x140mm Fractal exhaust; 3x 140mm Cougar Intake; Enermax T40F Black CPU cooler
Memory 2x 16GB Mushkin Redline DDR-4 3200
Video Card(s) EVGA RTX 2080 Ti Xc
Storage 1x 500 MX500 SSD; 2x 6TB WD Black; 1x 4TB WD Black; 1x400GB VelRptr; 1x 4TB WD Blue storage (eSATA)
Display(s) HP 27q 27" IPS @ 2560 x 1440
Case Fractal Design Define R4 Black w/Titanium front -windowed
Audio Device(s) Soundblaster Z
Power Supply Seasonic X-850
Mouse Coolermaster Sentinel III (large palm grip!)
Keyboard Logitech G610 Orion mechanical (Cherry Brown switches)
Software Windows 10 Pro 64-bit (Start10 & Fences 3.0 installed)
Why is everyone complaining about cost? It's not for you consumers.

:p It's the beginning of Skynet...we will all be irrelevant anyway soon.
 
Joined
Nov 16, 2004
Messages
456 (0.06/day)
System Name Mr. Obsolete| Ms. Old
Processor Intel Core i5 3570K | Intel Core i7 6700
Motherboard Asus P8Z77-I Deluxe | Asus Maximus VIII Gene
Cooling DeepCool GAMMAXX 120 | Coolermaster i7C
Memory Kingston HyperX 1866 16GB (8x2) | Kingston HyperX 2400 16GB (8x2)
Video Card(s) Asus TUF GTX 1650 Super | Asus ROG Strix GTX 1050Ti
Storage Intel 330 180GB + WD Blue 1TB | ADATA XPG SX8200 Pro 512GB + WD Blue 1TB
Display(s) ASUS VZ239HE | ASUS VZ239HR
Case Silverstone SG13B | Silverstone PS15B
Audio Device(s) On-Board Realtek ALC898 + Sound Blaster X-Fi MB3 | ROG SupremeFX 2015 + Sound Blaster X-Fi MB3
Power Supply FSP SFX PRO 450 | Seasonic S12-III 500
Software Windows 10 Home
Top