• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

JEDEC Updates Groundbreaking High Bandwidth Memory (HBM) Standard

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,243 (7.55/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
JEDEC Solid State Technology Association, the global leader in the development of standards for the microelectronics industry, today announced the publication of an update to JESD235 High Bandwidth Memory (HBM) DRAM standard. HBM DRAM is used in Graphics, High Performance Computing, Server, Networking and Client applications where peak bandwidth, bandwidth per watt, and capacity per area are valued metrics to a solution's success in the market. The standard was developed and updated with support from leading GPU and CPU developers to extend the system bandwidth growth curve beyond levels supported by traditional discrete packaged memory. JESD235A is available for free download from the JEDEC website.

JESD235A leverages Wide I/O and TSV technologies to support up to 8 GB per device at speeds up to 256 GB/s. This bandwidth is delivered across a 1024-bit wide device interface that is divided into 8 independent channels on each DRAM stack. The standard supports 2-high, 4-high and 8-high TSV stacks of DRAM at full bandwidth to allow systems flexibility on capacity requirements from 1 GB - 8 GB per stack.

Additional improvements in the recent update include a new pseudo channel architecture to improve effective bandwidth, and clarifications and enhancements to the test features. JESD235A also defines a new feature to alert controllers when DRAM temperatures have exceeded a level considered acceptable for reliable operation so that the controller can take appropriate steps to return the system to normal operation.

"GPUs and CPUs continue to drive demand for more memory bandwidth and capacity, amid increasing display resolutions and the growth in computing datasets. HBM provides a compelling solution to reduce the IO power and memory footprint for our most demanding applications," said Barry Wagner, JEDEC HBM Task Group Chairman.

View at TechPowerUp Main Site
 
Joined
Sep 15, 2007
Messages
3,946 (0.63/day)
Location
Police/Nanny State of America
Processor OCed 5800X3D
Motherboard Asucks C6H
Cooling Air
Memory 32GB
Video Card(s) OCed 6800XT
Storage NVMees
Display(s) 32" Dull curved 1440
Case Freebie glass idk
Audio Device(s) Sennheiser
Power Supply Don't even remember
I better never see crap DDRx, again. Cancel this ddr4 bullshit lol
 
Joined
Jul 2, 2008
Messages
8,091 (1.35/day)
Location
Hillsboro, OR
System Name Main/DC
Processor i7-3770K/i7-2600K
Motherboard MSI Z77A-GD55/GA-P67A-UD4-B3
Cooling Phanteks PH-TC14CS/H80
Memory Crucial Ballistix Sport 16GB (2 x 8GB) LP /4GB Kingston DDR3 1600
Video Card(s) Asus GTX 660 Ti/MSI HD7770
Storage Crucial MX100 256GB/120GB Samsung 830 & Seagate 2TB(died)
Display(s) Asus 24' LED/Samsung SyncMaster B1940
Case P100/Antec P280 It's huge!
Audio Device(s) on board
Power Supply SeaSonic SS-660XP2/Seasonic SS-760XP2
Software Win 7 Home Premiun 64 Bit
Come on AMD. Surprise the crap out of everyone. Bring out ZEN with 2-4GB HBM L4! BAM.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.81/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Come on AMD. Surprise the crap out of everyone. Bring out ZEN with 2-4GB HBM L4! BAM.
Screw that. Four stacks of 4 or 8GB would make for an amazing SoC that doesn't require external DRAM. Cache is already nutty fast and makes up for slower DRAM pretty well (hence why memory speeds north of 1600Mhz on DDR3 don't really have much impact.) HBM most likely will only serve to reduce the footprint of current devices.
I better never see crap DDRx, again. Cancel this ddr4 bullshit lol
DDR4 spec includes support for DRAM stacking. DDR4 can and will far outpace HBM when it comes to capacity. Personally, I think HBM is a memory level somewhere between last level cache and system memory. It's not like HBM can be a replacement in every circumstance but, could in many.
 
Joined
Jun 3, 2010
Messages
2,540 (0.48/day)
Come on AMD. Surprise the crap out of everyone. Bring out ZEN with 2-4GB HBM L4! BAM.
They kind of announced Zen will be "1 GB HBM."
 
Joined
Dec 14, 2011
Messages
1,041 (0.22/day)
Location
South-Africa
Processor AMD Ryzen 9 5900X
Motherboard ASUS ROG STRIX B550-F GAMING (WI-FI)
Cooling Corsair iCUE H115i Elite Capellix 280mm
Memory 32GB G.Skill DDR4 3600Mhz CL18
Video Card(s) ASUS GTX 1650 TUF
Storage Sabrent Rocket 1TB M.2
Display(s) Dell S3220DGF
Case Corsair iCUE 4000X
Audio Device(s) ASUS Xonar D2X
Power Supply Corsair AX760 Platinum
Mouse Razer DeathAdder V2 - Wireless
Keyboard Redragon K618 RGB PRO
Software Microsoft Windows 11 - Enterprise (64-bit)
Well, all I can say is, that GPU's this year better have 8GB of ram, minimum, so it can be future proof. As in, lowest tier cards, being 8GB and higher end cards from 16GB to 32GB.
 
Joined
Aug 7, 2007
Messages
2,723 (0.43/day)
Processor i5-7600k
Motherboard ASRock Z170 Pro4
Cooling CM Hyper 212 EVO w/ AC MX-4
Memory 2x8GB DDR4 2400 Corsair LPX Vengeance 15-15-15-36
Video Card(s) MSI Twin Frozr 1070ti
Storage 240GB Corsair Force GT
Display(s) 23' Dell AW2310
Case Corsair 550D
Power Supply Seasonic SS-760XP2 Platinum
Software Windows 10 Pro 64-bit
HBM needs time to mature in order to be a viable replacement to comparable GDDR5 in terms of cost. We saw how it was priced with AMD's Fury line of cards. This time around since both camps are going to be implementing the newer HBM2 standard, I don't expect this next-gen will be any different. This of course doesn't mask the fact that forward progress is being made and I'm all for it. Barriers will be broke gentlemen. :toast:
 
Joined
Aug 23, 2013
Messages
471 (0.11/day)
Well, all I can say is, that GPU's this year better have 8GB of ram, minimum, so it can be future proof. As in, lowest tier cards, being 8GB and higher end cards from 16GB to 32GB.
By the time you need 8gb for regular gaming the card will not be able to run games above 30 fps. There is no point in future proofing. Not to mention the consoles will delay that.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.81/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
By the time you need 8gb for regular gaming the card will not be able to run games above 30 fps. There is no point in future proofing. Not to mention the consoles will delay that.
It's not about using 8GB IMHO, it's about using more than 4GB because you lose performance the moment you start using more VRAM than you actually have.
 
Joined
Feb 11, 2009
Messages
5,555 (0.96/day)
System Name Cyberline
Processor Intel Core i7 2600k -> 12600k
Motherboard Asus P8P67 LE Rev 3.0 -> Gigabyte Z690 Auros Elite DDR4
Cooling Tuniq Tower 120 -> Custom Watercoolingloop
Memory Corsair (4x2) 8gb 1600mhz -> Crucial (8x2) 16gb 3600mhz
Video Card(s) AMD RX480 -> RX7800XT
Storage Samsung 750 Evo 250gb SSD + WD 1tb x 2 + WD 2tb -> 2tb MVMe SSD
Display(s) Philips 32inch LPF5605H (television) -> Dell S3220DGF
Case antec 600 -> Thermaltake Tenor HTCP case
Audio Device(s) Focusrite 2i4 (USB)
Power Supply Seasonic 620watt 80+ Platinum
Mouse Elecom EX-G
Keyboard Rapoo V700
Software Windows 10 Pro 64bit
It's not about using 8GB IMHO, it's about using more than 4GB because you lose performance the moment you start using more VRAM than you actually have.

Not always the case, take GTA5, you can set the Vram usage higher then you actually have and run into no issues, if you go way overboard you still dont lose performance, you just have stuff popping in.
 
Joined
Feb 19, 2009
Messages
1,863 (0.32/day)
Location
UK Warwickshire
System Name PC-Chips
Processor AMD Ryzen 7 5700x3D
Motherboard Asus ROG Strix B550-F Gaming.
Cooling Thermalright Peerless Assassin 120 SE.
Memory Patriot Viper 32gig dual channel 3600mhz
Video Card(s) PowerColor HellHound RX 7900 GRE OC
Storage 2 Samsung 860 EVO's 500gig / 2TB crucial P3-NVME / WD-BLUE SN550 1TB M.2 / SP A55 512gig / 8TB HDD
Display(s) TCL 50-inch 4k TV freesync HDR
Case Modded NZXT H510
Audio Device(s) Realtek S1220A - Yamaha A-S501 AMP - Wharfedale diamond 9.1 speakers - Wharfedale SW150 sub
Power Supply EVGA SuperNOVA G6 750W 80+ Gold
Mouse Some cheap wireless thing
Keyboard Razer Cynosa lite
VR HMD Oculus Quest 2 128gig version
Software Windows 11 pro 64bit
Not always the case, take GTA5, you can set the Vram usage higher then you actually have and run into no issues, if you go way overboard you still dont lose performance, you just have stuff popping in.

Play gta 5 long enough while over the ram limit and it WILL eventualy crap out seen it first hand when i pushed my HD7970 over the 3gig limit.

Game ran fine for about an hour then bogged right down till it felt like 1FPS.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.81/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Not always the case, take GTA5, you can set the Vram usage higher then you actually have and run into no issues, if you go way overboard you still dont lose performance, you just have stuff popping in.
I used to use 1.6GB of VRAM on my 6870s (1 GB GPUs,) before I replaced them with the 390. Needless to say, you start taking a performance hit to use more VRAM than you have. The question is, does that performance hit prevent you from maintaining 60 FPS? For me in a lot of cases that was a "no" but, I would also never see full GPU utilization on my 6870s as a result. There comes a point where the GPU has to wait for data longer than it has to actually do the computation so if the set of data being worked on can't fully reside in VRAM, a lot of swapping is going to occur between main memory and the GPU which always harms performance but may not impact your experience, at least, not right away.
 
Last edited:
Joined
Nov 4, 2005
Messages
11,984 (1.72/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
It's not about using 8GB IMHO, it's about using more than 4GB because you lose performance the moment you start using more VRAM than you actually have.


GTA4 and its desire for more than 152MB of vmem, even users with 700MB were suffering, while 1GB users were fine, it prevented a lot of the issues people complained about. So yeah, i see 8GB becoming the norm for high end video cards, it will allow for better high end textures that require less filtering and thus less GPU power to render, and we can save the power to overdraw the whole scene and scale it back down to standard resolutions eliminating more AA need as well.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,171 (2.81/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
GTA4 and its desire for more than 152MB of vmem, even users with 700MB were suffering, while 1GB users were fine, it prevented a lot of the issues people complained about. So yeah, i see 8GB becoming the norm for high end video cards, it will allow for better high end textures that require less filtering and thus less GPU power to render, and we can save the power to overdraw the whole scene and scale it back down to standard resolutions eliminating more AA need as well.
...and everything being able to reside in VRAM means less waiting for data that exists in system memory. It's the same argument for system memory, the moment you have to swap data out of physical memory because you've run out, you're going to see a performance loss. Memory is one of those things where you always want more than what you're going to use because if you have less, you're going to run into performance impediments. I didn't get a 390 thinking that I'm going to fill 8GB, I got it with the expectation that it won't be long before I exceed 4GB and in surround, even Elite: Dangerous consumes up to 4.2GB on a regular basis now. Now, that could be textures and data that isn't used all the time but, not fetching that from system memory is far better than the alternative which is relatively slow. The more waiting the GPU has to do, the more the frame rate will fluctuate because the amount of time to access memory outside of VRAM isn't as consistent as pulling it from VRAM itself, so frame time will vary and your experience is going to suffer.

Simply put, having more VRAM is never a bad thing. It can be overkill, it can be useless in a lot of cases but, it's never a bad thing. Not having enough VRAM or system memory is far worse than having too much.
 
Top