Thursday, June 10th 2021
SK Hynix Details its Upcoming HBM3 Memory: 665 GB/s per Stack
SK Hynix is at the forefront of developing the next generation of stacked high-bandwidth memory, the HBM3 standard. Succeeding the current HBM2e standard, HBM3 will power next-generation HPC and AI processors in high-density multi-chip modules. A Tom's Hardware report citing information from SK Hynix reveals two key details about the new standard. For starters, it could offer per-pin data-rates of 5.2 Gbps, a 44% increase over the 3.6 Gbps that HBM2e caps out at. This results in a per-stack bandwidth of 665 GB/s, compared to 480 GB/s for the HBM2e. A processor with four such stacks (over a 4096-bit wide bus), would hence enjoy 2.66 TB/s of memory bandwidth. It's likely that HBM3 stacks from SK Hynix could implement the DBI Ultra 2.5D/3D hybrid bonding interconnect technology licensed from Xperi Corp.
Source:
Tom's Hardware
8 Comments on SK Hynix Details its Upcoming HBM3 Memory: 665 GB/s per Stack
www.innosilicon.com/html/ip-solution/39.html
Personaly, I wouldn't care if such APUs required a package the size of threadripper, but I realize I don't represent the majority.
So we won't see any APU+HBM for consumers anytime soon, but if the server/HPC market demand such product to justify it's cost then they will do it, but it seems there's not enough demand because we still don't have such product even for the HPC market.
Maybe with the current advances in packaging technology this might be possible, like if it will be possible to 3D stack the HBM stack over the IO die or over the cache just like how AMD's 3D V-Cache works. The main issue with such implementation is the Z-Height, HBM are already a 3D stacked DRAM dies, so they're "tall" if we can say that, stacking them over the IO/Cache will make the main Core die have lower Z-Height.
Intel was faced with this issue with their strange Intel+Radeon opGPU as it uses HBM also (connected via EMIB), they did some engineering work and succeeded but the concept was costly and never got popular enough, they dropped it.