• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Rambus Advances HBM2E Performance to 4.0 Gbps for AI/ML Training Applications

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,189 (0.91/day)
Rambus Inc. (NASDAQ: RMBS), a premier silicon IP and chip provider making data faster and safer, today announced it has achieved a record 4 Gbps performance with the Rambus HBM2E memory interface solution consisting of a fully-integrated PHY and controller. Paired with the industry's fastest HBM2E DRAM from SK hynix operating at 3.6 Gbps, the solution can deliver 460 GB/s of bandwidth from a single HBM2E device. This performance meets the terabyte-scale bandwidth needs of accelerators targeting the most demanding AI/ML training and high-performance computing (HPC) applications.

"With this achievement by Rambus, designers of AI and HPC systems can now implement systems using the world's fastest HBM2E DRAM running at 3.6 Gbps from SK hynix," said Uksong Kang, vice president of product planning at SK hynix. "In July, we announced full-scale mass-production of HBM2E for state-of-the-art computing applications demanding the highest bandwidth available."



The fully-integrated, production-ready Rambus HBM2E memory subsystem runs at 4 Gbps without PHY voltage overdrive. Rambus teamed with SK hynix and Alchip to implement the HBM2E 2.5D system to validate in silicon the Rambus HBM2E PHY and Memory Controller IP using TSMC's N7 process and CoWoS (Chip-on-Wafer-on-Substrate) advanced packaging technologies. Co-designing with the engineering team from Rambus, Alchip led the interposer and package substrate design.

"This advancement of Rambus and its partners, using TSMC's advanced process and packaging technologies, is another important achievement of our ongoing collaboration with Rambus," said Suk Lee, senior director of the Design Infrastructure Management Division at TSMC. "We look forward to a continued partnership with Rambus to enable the highest performance in AI/ML and HPC applications."

"Alchip brought a demonstrated track record of success in 7nm and 2.5D package design to this initiative," said Johnny Shen, CEO of Alchip Technologies. "We're extremely proud of our contributions to Rambus' breakthrough achievement."

Rambus has 30 years of high-speed memory design applied to the most demanding computing applications. Its renowned signal integrity expertise was key to achieving an HBM2E memory interface capable of 4 Gbps operation. This raises a new benchmark for meeting the insatiable bandwidth requirements of AI/ML training.

"With silicon operation up to 4 Gbps, designers can future-proof their HBM2E implementations and can be confident of ample margin for 3.6 Gbps designs," said Matthew Jones, senior director and general manager of IP cores at Rambus. "As part of every customer engagement, Rambus provides reference designs for the 2.5D package and interposer to ensure first-time right implementations for mission-critical AI/ML designs."

Benefits of the Rambus HBM2E Memory Interface (PHY and Controller):
  • Achieves the industry's highest speed of 4 Gbps per pin, delivering a system bandwidth of 460 GB from a single 3.6 Gbps HBM2E DRAM 3D device.
  • Fully-integrated and verified HBM2E PHY and Controller reduces ASIC design complexity and speeds time to market
  • Includes 2.5D package and interposer reference design as part of IP license
  • Provides access to Rambus system and SI/PI experts helping ASIC designers to ensure maximum signal and power integrity for devices and systems
  • Features LabStation development environment that enables quick system bring-up, characterization and debug
  • Supports high-performance applications including state-of-the-art AI/ML training and high-performance computing (HPC) systems

For more information on the Rambus Interface IP, including our PHYs and Controllers, please visit rambus.com/interface-ip.

View at TechPowerUp Main Site
 
Joined
Oct 15, 2019
Messages
549 (0.34/day)
Joined
Nov 6, 2016
Messages
1,557 (0.58/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
By 460GBps form a "single device", do they mean a single HBM2e stack? If so, does that mean near 2TB/s for four stacks?
 
Joined
Jul 15, 2006
Messages
972 (0.15/day)
Location
Malaysia
Processor AMD Ryzen 7 5700G
Motherboard Gigabyte B450M-S2H
Cooling Scythe Kotetsu Mark II
Memory 2 x 16GB SK Hynix OEM DDR4-3200 @ 3666 18-20-18-36
Video Card(s) Colorful RTX 2060 SUPER 8GB
Storage 250GB WD BLACK SN750 M.2 + 4TB WD Red Plus + 4TB WD Purple
Display(s) AOpen 27HC5R 27" 1080p 165Hz
Case COUGAR MX440 Mesh RGB
Audio Device(s) Creative X-Fi Titanium HD + Kurtzweil KS-40A bookshelf
Power Supply Corsair CX750M
Mouse Razer Deathadder Essential
Keyboard Cougar Attack2 Cherry MX Black
Software Windows 10 Pro 22H1 x64
Are they going to patent troll this one as well?
 
Joined
Mar 18, 2008
Messages
5,717 (0.98/day)
System Name Virtual Reality / Bioinformatics
Processor Undead CPU
Motherboard Undead TUF X99
Cooling Noctua NH-D15
Memory GSkill 128GB DDR4-3000
Video Card(s) EVGA RTX 3090 FTW3 Ultra
Storage Samsung 960 Pro 1TB + 860 EVO 2TB + WD Black 5TB
Display(s) 32'' 4K Dell
Case Fractal Design R5
Audio Device(s) BOSE 2.0
Power Supply Seasonic 850watt
Mouse Logitech Master MX
Keyboard Corsair K70 Cherry MX Blue
VR HMD HTC Vive + Oculus Quest 2
Software Windows 10 P
I hope Navi2X uses this instead of GDDR6
 
Joined
Oct 27, 2009
Messages
1,129 (0.21/day)
Location
Republic of Texas
System Name [H]arbringer
Processor 4x 61XX ES @3.5Ghz (48cores)
Motherboard SM GL
Cooling 3x xspc rx360, rx240, 4x DT G34 snipers, D5 pump.
Memory 16x gskill DDR3 1600 cas6 2gb
Video Card(s) blah bigadv folder no gfx needed
Storage 32GB Sammy SSD
Display(s) headless
Case Xigmatek Elysium (whats left of it)
Audio Device(s) yawn
Power Supply Antec 1200w HCP
Software Ubuntu 10.10
Benchmark Scores http://valid.canardpc.com/show_oc.php?id=1780855 http://www.hwbot.org/submission/2158678 http://ww
Joined
Jun 3, 2010
Messages
2,540 (0.50/day)
Are they going to patent troll this one as well?
They need the feasibility for rapid deployment. There is only 1 advantage 2.5D has over 3D and that is seamless correction after manufacture. They can machine test it, if things are known to work.
 
Joined
Nov 6, 2016
Messages
1,557 (0.58/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10

I soooooo want AMD to make an APU with 24-36 CUs and a 4-8GB HBM2e stack integrated into it that can dynamically switch between VRAM and L4 cache depending on need. I'm constantly looking at AMD patents and they do have the IP for such a product.

On another note, they also have recent patents for MCM GPUs that utilize a technique called "GPU masking" to make multiple GPU chiplets appear as a single logical device to both the OS and Graphics API, so I can't wait to see that come out in a few years

Polish_20200910_123853792.png
Polish_20200910_123801708.png
 
Joined
Feb 13, 2012
Messages
522 (0.12/day)
I soooooo want AMD to make an APU with 24-36 CUs and a 4-8GB HBM2e stack integrated into it that can dynamically switch between VRAM and L4 cache depending on need. I'm constantly looking at AMD patents and they do have the IP for such a product.

On another note, they also have recent patents for MCM GPUs that utilize a technique called "GPU masking" to make multiple GPU chiplets appear as a single logical device to both the OS and Graphics API, so I can't wait to see that come out in a few years

View attachment 168256View attachment 168257
It is my understanding that next gen will be multi chip/chiplet based for both AMD and Nvidia.
 
Joined
Feb 19, 2009
Messages
1,151 (0.21/day)
Location
I live in Norway
Processor R9 5800x3d | R7 3900X | 4800H | 2x Xeon gold 6142
Motherboard Asrock X570M | AB350M Pro 4 | Asus Tuf A15
Cooling Air | Air | duh laptop
Memory 64gb G.skill SniperX @3600 CL16 | 128gb | 32GB | 192gb
Video Card(s) RTX 4080 |Quadro P5000 | RTX2060M
Storage Many drives
Display(s) M32Q,AOC 27" 144hz something.
Case Jonsbo D41
Power Supply Corsair RM850x
Mouse g502 Lightspeed
Keyboard G913 tkl
Software win11, proxmox
Benchmark Scores 33000FS, 16300 TS. Lappy, 7000 TS.
Little chanche of that. Navi will use G6 for cost reasons.

G6X or hbm, I don't see how it could be that different in cost tbh.
also biggest navi 6900XT could have HBM easily!
 
Joined
Aug 21, 2013
Messages
1,669 (0.43/day)
G6X or hbm, I don't see how it could be that different in cost tbh.
also biggest navi 6900XT could have HBM easily!
G6X is Nvidia exclusive. Just like G5X was. HBM will not come to consumer cards anytime soon.
 
Joined
Apr 12, 2013
Messages
6,728 (1.68/day)
I don't think it's exclusive, AMD et al were going to move to GDDR6 & HBME that's why GDDR5x was largely ignored & Micron took quite a hit for that IIRC.
 
Joined
Feb 19, 2009
Messages
1,151 (0.21/day)
Location
I live in Norway
Processor R9 5800x3d | R7 3900X | 4800H | 2x Xeon gold 6142
Motherboard Asrock X570M | AB350M Pro 4 | Asus Tuf A15
Cooling Air | Air | duh laptop
Memory 64gb G.skill SniperX @3600 CL16 | 128gb | 32GB | 192gb
Video Card(s) RTX 4080 |Quadro P5000 | RTX2060M
Storage Many drives
Display(s) M32Q,AOC 27" 144hz something.
Case Jonsbo D41
Power Supply Corsair RM850x
Mouse g502 Lightspeed
Keyboard G913 tkl
Software win11, proxmox
Benchmark Scores 33000FS, 16300 TS. Lappy, 7000 TS.
G6X is Nvidia exclusive. Just like G5X was. HBM will not come to consumer cards anytime soon.
hbm have been on consumer cards for 5 years ?
 
Joined
Aug 21, 2013
Messages
1,669 (0.43/day)
hbm have been on consumer cards for 5 years ?
I meant new cards. Technically the last "consumer" card was Radeon VII that used HBM. Even that was just rebranded workstation card. I would consider Vega and Fiji the only true consumer cards that used HBM.

And with G6X largely equaling HBM2 in terms of bandwith (Radeon VII and 3090 are both roughly 1TB/s) i see even less reason for HBM.
 
Top