Thursday, April 20th 2023

SK hynix Develops Industry's First 12-Layer HBM3, Provides Samples To Customers

SK hynix announced today it has become the industry's first to develop 12-layer HBM3 product with a 24 gigabyte (GB) memory capacity, currently the largest in the industry, and said customers' performance evaluation of samples is underway. HBM (High Bandwidth Memory): A high-value, high-performance memory that vertically interconnects multiple DRAM chips and dramatically increases data processing speed in comparison to traditional DRAM products. HBM3 is the 4th generation product, succeeding the previous generations HBM, HBM2 and HBM2E

"The company succeeded in developing the 24 GB package product that increased the memory capacity by 50% from the previous product, following the mass production of the world's first HBM3 in June last year," SK hynix said. "We will be able to supply the new products to the market from the second half of the year, in line with growing demand for premium memory products driven by the AI-powered chatbot industry." SK hynix engineers improved process efficiency and performance stability by applying Advanced Mass Reflow Molded Underfill (MR-MUF)# technology to the latest product, while Through Silicon Via (TSV)## technology reduced the thickness of a single DRAM chip by 40%, achieving the same stack height level as the 16 GB product.
# MR-MUF (Mass Reflow Molded Underfill): A method of placing multiple chips on the lower substrate and bonding them at once through reflow, and then simultaneously filling the gap between the chips or between the chip and the substrate with a mold material.

## TSV (Through Silicon Via): An interconnecting technology used in advanced packaging that links the upper and lower chips with electrode that vertically passes through thousands of fine holes on DRAM chips. SK hynix's HBM3 that integrated this technology can process up to 819 GB per second, meaning that 163 FHD (Full-HD) movies can be transmitted in a single second


The HBM, first developed by SK hynix in 2013, has drawn broad attention from the memory chip industry for its crucial role in implementing generative AI that operates in high-performance computing (HPC) systems.

The latest HBM3 standard, in particular, is considered the optimal product for rapid processing of large volumes of data, and therefore its adoption by major global tech companies is on the rise.

SK hynix has provided samples of its 24 GB HBM3 product to multiple customers that have expressed great expectation for the latest product, while the performance evaluation of the product is in progress.

"SK hynix was able to continuously develop a series of ultra-high speed and high capacity HBM products through its leading technologies used in the back-end process," said Sang Hoo Hong, Head of Package & Test at SK hynix. "The company plans to complete mass production preparation for the new product within the first half of the year to further solidify its leadership in cutting-edge DRAM market in the era of AI."
Add your own comment

7 Comments on SK hynix Develops Industry's First 12-Layer HBM3, Provides Samples To Customers

#1
Calatinus
Maybe it's time for AMD to dust off the HBM R9 Fury / HBM2 Vega64 development paths and reconsider HBM3 as a good source of more VRAM and end the planned clown-obsolesce of memory bottle-necked graphic cards. Also Nvidia shall take notes.
Posted on Reply
#2
Haile Selassie
HBM2E is plenty used in the industry with one of the biggest customers being NVIDIA actually.
I'm sure they will be in the front row for HBM3.
Posted on Reply
#3
Denver
CalatinusMaybe it's time for AMD to dust off the HBM R9 Fury / HBM2 Vega64 development paths and reconsider HBM3 as a good source of more VRAM and end the planned clown-obsolesce of memory bottle-necked graphic cards. Also Nvidia shall take notes.
If you're willing to pay twice as much for GPUs. HBM is super expensive.
Posted on Reply
#4
kapone32
DenverIf you're willing to pay twice as much for GPUs. HBM is super expensive.
It's great if you want to put a Waterblock on the card though.
Posted on Reply
#5
Punkenjoy
I am not sure if that will ever be really available for consumable GPU.

For sure, the margin of the high end is so ridiculous that they could still put this on their board and make huge profits. But it look they don't want to affect to much their margin.

But with the huge increase of sales for AI silicons that really frequently use HBM, that might mean enough mass scale production to bring the price down for high end GPU while keeping their high margin.

We will see. In the past, the driving factor of GPU was gaming. These days, it's almost anything but gaming !
Posted on Reply
#6
Denver
kapone32It's great if you want to put a Waterblock on the card though.
Maybe AMD or Nvidia will release ultra expensive product with HBM3 to serve both enthusiast gamers and professional market.
Posted on Reply
#7
The_Enigma
Isn't this 24GB in a single stack though? That would be horrible for consumer cards. 2 stacks of this HBM3 has the same bandwidth as 384 bit GDDR7, so we would need at least 2 stacks. But why would you want that much memory on a consumer card? It would save you on power budget over GDDR7, but cost a lot more to make. Of course now with chiplets for GPUs coming the transistor savings of HBM are largely mitigated too, since you can move memory controllers and cache off the main die
Posted on Reply
Apr 30th, 2024 12:25 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts