• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Reportedly Having Issues with Samsung's HBM3 Chips Running Too Hot

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,777 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
According to Reuters, NVIDIA is having some major issues with Samsung's HBM3 chips, as NVIDIA hasn't managed to finalise its validations of the chips. Reuters are citing multiple sources that are familiar with the matter and it seems like Samsung is having some serious issues with its HMB3 chips if the sources are correct. Not only do the chips run hot, which itself is a big issue due to NVIDIA already having issues cooling some of its higher-end products, but the power consumption is apparently not where it should be either. Samsung is said to have tried to get its HBM3 and HBM3E parts validated by NVIDIA since sometime in 2023 according to Reuter's sources, which suggests that there have been issues for at least six months, if not longer.

The sources claim there are issues with both the 8- and 12-layer stacks of HMB3E parts from Samsung, suggesting that NVIDIA might only be able to supply parts from Micron and SK Hynix for now, the latter whom has been supplying HBM3 chips to NVIDIA since the middle of 2022 and HBM3E chips since March of this year. It's unclear if this is a production issue at Samsung's DRAM Fabs, a packaging related issue or something else entirely. The Reuter's piece goes on to speculating about Samsung not having had enough time to develop its HBM parts compared its competitors and that it's a rushed product, but Samsung issued a statement to the publication that it's a matter of customising the product for its customer's needs. Samsung also said that it's "the process of optimising its products through close collaboration with customers" without going into which customer(s). Samsung issued a further statement saying that "claims of failing due to heat and power consumption are not true" and that testing was going as expected.



View at TechPowerUp Main Site | Source
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,777 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Thanks to @P4-630 for the heads up.
 
Low quality post by bonehead123
Joined
Oct 18, 2013
Messages
6,266 (1.53/day)
Location
Over here, right where you least expect me to be !
System Name The Little One
Processor i5-11320H @4.4GHZ
Motherboard AZW SEI
Cooling Fan w/heat pipes + side & rear vents
Memory 64GB Crucial DDR4-3200 (2x 32GB)
Video Card(s) Iris XE
Storage WD Black SN850X 4TB m.2, Seagate 2TB SSD + SN850 4TB x2 in an external enclosure
Display(s) 2x Samsung 43" & 2x 32"
Case Practically identical to a mac mini, just purrtier in slate blue, & with 3x usb ports on the front !
Audio Device(s) Yamaha ATS-1060 Bluetooth Soundbar & Subwoofer
Power Supply 65w brick
Mouse Logitech MX Master 2
Keyboard Logitech G613 mechanical wireless
Software Windows 10 pro 64 bit, with all the unnecessary background shitzu turned OFF !
Benchmark Scores PDQ
sobs, tears, condolences....

poor nGreeddiya, wheh wheh wheh, gonna have to spend some of that jacket money to fix a problem that Sammy created for them, wheh, wheh, wheh....

Shoulda just stuck with TSMC... oh but wait, Apple beat them to it, wheh, wheh, wheh

Ha Ha Ha Lol GIF by Lucas and Friends by RV AppStudios
 
Joined
May 19, 2011
Messages
113 (0.02/day)
sobs, tears, condolences....

poor nGreeddiya, wheh wheh wheh, gonna have to spend some of that jacket money to fix a problem that Sammy created for them, wheh, wheh, wheh....

Shoulda just stuck with TSMC... oh but wait, Apple beat them to it, wheh, wheh, wheh

Ha Ha Ha Lol GIF by Lucas and Friends by RV AppStudios

Not like Apple has much of a choice… imagine them being forced to use Samsung fabs!!
 

MxPhenom 216

ASIC Engineer
Joined
Aug 31, 2010
Messages
13,011 (2.49/day)
Location
Loveland, CO
System Name Ryzen Reflection
Processor AMD Ryzen 9 5900x
Motherboard Gigabyte X570S Aorus Master
Cooling 2x EK PE360 | TechN AM4 AMD Block Black | EK Quantum Vector Trinity GPU Nickel + Plexi
Memory Teamgroup T-Force Xtreem 2x16GB B-Die 3600 @ 14-14-14-28-42-288-2T 1.45v
Video Card(s) Zotac AMP HoloBlack RTX 3080Ti 12G | 950mV 1950Mhz
Storage WD SN850 500GB (OS) | Samsung 980 Pro 1TB (Games_1) | Samsung 970 Evo 1TB (Games_2)
Display(s) Asus XG27AQM 240Hz G-Sync Fast-IPS | Gigabyte M27Q-P 165Hz 1440P IPS | LG 24" IPS 1440p
Case Lian Li PC-011D XL | Custom cables by Cablemodz
Audio Device(s) FiiO K7 | Sennheiser HD650 + Beyerdynamic FOX Mic
Power Supply Seasonic Prime Ultra Platinum 850
Mouse Razer Viper v2 Pro
Keyboard Corsair K65 Plus 75% Wireless - USB Mode
Software Windows 11 Pro 64-Bit
sobs, tears, condolences....

poor nGreeddiya, wheh wheh wheh, gonna have to spend some of that jacket money to fix a problem that Sammy created for them, wheh, wheh, wheh....

Shoulda just stuck with TSMC... oh but wait, Apple beat them to it, wheh, wheh, wheh

Ha Ha Ha Lol GIF by Lucas and Friends by RV AppStudios
LOL this has nothing to do with TSMC vs Samsung. Nvidia does not design their own HBM and they are not the only one sourcing HBM from Samsung. All these players making AI ASIC are sourcing HBM from 2-3 vendors.
 
Joined
May 19, 2011
Messages
113 (0.02/day)
Yeah imagine using the "fabs" of the biggest memory & NAND maker in the world :rolleyes:

I almost forgot how much Apple and Samsung get along! :p It’s one thing to buy flash memory and displays from them but entirely another to hand them the blueprints and allow them to control the manufacturing of the SOC which they directly compete against… :kookoo:
 
Joined
Nov 20, 2021
Messages
122 (0.11/day)
Not like Apple has much of a choice… imagine them being forced to use Samsung fabs!!
At this point, that the only thing Apple ISN’T using from Samesung. They pretty much use screens, memory, ram, and I’m pretty sure I’m forgetting something else related to Samesung.
 
Joined
Dec 29, 2010
Messages
3,809 (0.75/day)
Processor AMD 5900x
Motherboard Asus x570 Strix-E
Cooling Hardware Labs
Memory G.Skill 4000c17 2x16gb
Video Card(s) RTX 3090
Storage Sabrent
Display(s) Samsung G9
Case Phanteks 719
Audio Device(s) Fiio K5 Pro
Power Supply EVGA 1000 P2
Mouse Logitech G600
Keyboard Corsair K95
Whatever the extra cost they will just happily push it downstream. lol
 

Fourstaff

Moderator
Staff member
Joined
Nov 29, 2009
Messages
10,079 (1.83/day)
Location
Home
System Name Orange! // ItchyHands
Processor 3570K // 10400F
Motherboard ASRock z77 Extreme4 // TUF Gaming B460M-Plus
Cooling Stock // Stock
Memory 2x4Gb 1600Mhz CL9 Corsair XMS3 // 2x8Gb 3200 Mhz XPG D41
Video Card(s) Sapphire Nitro+ RX 570 // Asus TUF RTX 2070
Storage Samsung 840 250Gb // SX8200 480GB
Display(s) LG 22EA53VQ // Philips 275M QHD
Case NZXT Phantom 410 Black/Orange // Tecware Forge M
Power Supply Corsair CXM500w // CM MWE 600w
Probably explains why Samsung Electronics shuffled their leadership. Being second fiddle to SK Hynix is a bitter pill.
 

Fourstaff

Moderator
Staff member
Joined
Nov 29, 2009
Messages
10,079 (1.83/day)
Location
Home
System Name Orange! // ItchyHands
Processor 3570K // 10400F
Motherboard ASRock z77 Extreme4 // TUF Gaming B460M-Plus
Cooling Stock // Stock
Memory 2x4Gb 1600Mhz CL9 Corsair XMS3 // 2x8Gb 3200 Mhz XPG D41
Video Card(s) Sapphire Nitro+ RX 570 // Asus TUF RTX 2070
Storage Samsung 840 250Gb // SX8200 480GB
Display(s) LG 22EA53VQ // Philips 275M QHD
Case NZXT Phantom 410 Black/Orange // Tecware Forge M
Power Supply Corsair CXM500w // CM MWE 600w
SK Hynix has always led HBM production, with better yields and volume. This is not new...
What is new is the sudden and dramatic divergence in fortunes between HBM powering the AI boom and your run off the mill DRAMs which are languishing.
 
Joined
May 3, 2018
Messages
2,881 (1.19/day)
Ol' Jensen probably trying to squeeze a price cut out of Samsung. Hey man your chips run hot, we can still work with them, but it'll cost us a pretty penny to mitigate heat, so you better slash pricing.
 
Joined
Apr 30, 2020
Messages
999 (0.59/day)
System Name S.L.I + RTX research rig
Processor Ryzen 7 5800X 3D.
Motherboard MSI MEG ACE X570
Cooling Corsair H150i Cappellx
Memory Corsair Vengeance pro RGB 3200mhz 32Gbs
Video Card(s) 2x Dell RTX 2080 Ti in S.L.I
Storage Western digital Sata 6.0 SDD 500gb + fanxiang S660 4TB PCIe 4.0 NVMe M.2
Display(s) HP X24i
Case Corsair 7000D Airflow
Power Supply EVGA G+1600watts
Mouse Corsair Scimitar
Keyboard Cosair K55 Pro RGB
ah yes, the old "thermal density" problem is rearing its head again. Alongside probably a voltage/amperage curve problem.
 
Joined
Sep 6, 2013
Messages
3,393 (0.82/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 7600 / Ryzen 5 4600G / Ryzen 5 5500
Motherboard X670E Gaming Plus WiFi / MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2)
Cooling Aigo ICE 400SE / Segotep T4 / Νoctua U12S
Memory Kingston FURY Beast 32GB DDR5 6000 / 16GB JUHOR / 32GB G.Skill RIPJAWS 3600 + Aegis 3200
Video Card(s) ASRock RX 6600 + GT 710 (PhysX) / Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes / NVMes, SATA Storage / NVMe, SATA, external storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) / 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
Samsung and Intel should exchange information on how to manufacture power efficient chips........... :p
 
Joined
Feb 3, 2017
Messages
3,823 (1.33/day)
Processor Ryzen 7800X3D
Motherboard ROG STRIX B650E-F GAMING WIFI
Memory 2x16GB G.Skill Flare X5 DDR5-6000 CL36 (F5-6000J3636F16GX2-FX5)
Video Card(s) INNO3D GeForce RTX™ 4070 Ti SUPER TWIN X2
Storage 2TB Samsung 980 PRO, 4TB WD Black SN850X
Display(s) 42" LG C2 OLED, 27" ASUS PG279Q
Case Thermaltake Core P5
Power Supply Fractal Design Ion+ Platinum 760W
Mouse Corsair Dark Core RGB Pro SE
Keyboard Corsair K100 RGB
VR HMD HTC Vive Cosmos
Joined
Dec 30, 2010
Messages
2,200 (0.43/day)
I suspect, potential long term degradation. What Samsung reports as working, in DC enviroments with 24/7 usage and perhaps for the next years, this memory will show degradation and thus growing amount of damaged products and returns. You can only expect the highest grade stuff when you pay 10 to 30g per unit.

The Vega 56 with a flashed 64 bios was known for that. Long term HBM would degrade.
 

AsRock

TPU addict
Joined
Jun 23, 2007
Messages
19,110 (2.99/day)
Location
UK\USA
AMD had the same problem with HBM2 for the Vega64. Not to many working units these days.

Yeah, all so i be very weary about buying any when they "fix" the issue too. Remember as long as it lasts the warranty.
 

MxPhenom 216

ASIC Engineer
Joined
Aug 31, 2010
Messages
13,011 (2.49/day)
Location
Loveland, CO
System Name Ryzen Reflection
Processor AMD Ryzen 9 5900x
Motherboard Gigabyte X570S Aorus Master
Cooling 2x EK PE360 | TechN AM4 AMD Block Black | EK Quantum Vector Trinity GPU Nickel + Plexi
Memory Teamgroup T-Force Xtreem 2x16GB B-Die 3600 @ 14-14-14-28-42-288-2T 1.45v
Video Card(s) Zotac AMP HoloBlack RTX 3080Ti 12G | 950mV 1950Mhz
Storage WD SN850 500GB (OS) | Samsung 980 Pro 1TB (Games_1) | Samsung 970 Evo 1TB (Games_2)
Display(s) Asus XG27AQM 240Hz G-Sync Fast-IPS | Gigabyte M27Q-P 165Hz 1440P IPS | LG 24" IPS 1440p
Case Lian Li PC-011D XL | Custom cables by Cablemodz
Audio Device(s) FiiO K7 | Sennheiser HD650 + Beyerdynamic FOX Mic
Power Supply Seasonic Prime Ultra Platinum 850
Mouse Razer Viper v2 Pro
Keyboard Corsair K65 Plus 75% Wireless - USB Mode
Software Windows 11 Pro 64-Bit
Joined
Feb 1, 2019
Messages
3,667 (1.70/day)
Location
UK, Midlands
System Name Main PC
Processor 13700k
Motherboard Asrock Z690 Steel Legend D4 - Bios 13.02
Cooling Noctua NH-D15S
Memory 32 Gig 3200CL14
Video Card(s) 4080 RTX SUPER FE 16G
Storage 1TB 980 PRO, 2TB SN850X, 2TB DC P4600, 1TB 860 EVO, 2x 3TB WD Red, 2x 4TB WD Red
Display(s) LG 27GL850
Case Fractal Define R4
Audio Device(s) Soundblaster AE-9
Power Supply Antec HCG 750 Gold
Software Windows 10 21H2 LTSC
Trying to run the chips at too much clock speed, just slow them down lol.
 
Joined
Oct 6, 2021
Messages
1,605 (1.37/day)
Thats not really the issue
It is part of the problem, but SK Hynix has shaped to be extremely efficient in producing HBM over time, Samsung and Micron simply failed to follow. They may even seem to equate on Specs, but not in the efficiency/yields


"According to Choi, the company's head of packaging and testing, SK Hynix's proprietary MR-MUF is a key technology in HBM packaging. MR-MUF reduces chip stacking pressure by 6%, increases productivity by fourfold by reducing process time, and improves heat dissipation by 45% compared to earlier technologies.

SK Hynix recently released an advanced MR-MUF that improves heat dissipation by 10% through the use of a new protective material while keeping the existing advantages of MR-MUF, Choi said. Advanced MR-MUF is an optimum solution for high stacking, and technology development for 16-high stacking is underway. The company plans to utilize advanced MR-MUF achieving 16-high HBM4, while preemptively reviewing hybrid bonding technology."


"SK hynix currently controls roughly 46% - 49% of HBM market, and its share is not expected to drop significantly in 2025, according to market tracking firm TrendForce. By contrast, Micron's share on HBM memory market is between 4% and 6%."

SK hynix Reports That 2025 HBM Memory Supply Has Nearly Sold Out (anandtech.com)
 
Joined
Dec 29, 2010
Messages
3,809 (0.75/day)
Processor AMD 5900x
Motherboard Asus x570 Strix-E
Cooling Hardware Labs
Memory G.Skill 4000c17 2x16gb
Video Card(s) RTX 3090
Storage Sabrent
Display(s) Samsung G9
Case Phanteks 719
Audio Device(s) Fiio K5 Pro
Power Supply EVGA 1000 P2
Mouse Logitech G600
Keyboard Corsair K95
I imagine Jensen was watching SNL and he was like we need more COWBELL, er HBM.

 

wolf

Better Than Native
Joined
May 7, 2007
Messages
8,246 (1.28/day)
System Name MightyX
Processor Ryzen 9800X3D
Motherboard Gigabyte X650I AX
Cooling Scythe Fuma 2
Memory 32GB DDR5 6000 CL30
Video Card(s) Asus TUF RTX3080 Deshrouded
Storage WD Black SN850X 2TB
Display(s) LG 42C2 4K OLED
Case Coolermaster NR200P
Audio Device(s) LG SN5Y / Focal Clear
Power Supply Corsair SF750 Platinum
Mouse Corsair Dark Core RBG Pro SE
Keyboard Glorious GMMK Compact w/pudding
VR HMD Meta Quest 3
Software case populated with Artic P12's
Benchmark Scores 4k120 OLED Gsync bliss
Always fun to see the users who can't resist the opportunity for name calling and a good roast pop up, this seems pertinent to the topic though;
In separate statements after Reuters first published this report, Samsung said that "claims of failing due to heat and power consumption are not true," and that testing was "proceeding smoothly and as planned."
Media hungry as always to jump on any possible chance for coverage of a miss-step. After all, at the top of their game, all eyes are on them and there's no doubt a crowd hungry to feast on a meal of schadenfreude, as this thread demonstrates.
 
Joined
Jan 3, 2021
Messages
3,612 (2.49/day)
Location
Slovenia
Processor i5-6600K
Motherboard Asus Z170A
Cooling some cheap Cooler Master Hyper 103 or similar
Memory 16GB DDR4-2400
Video Card(s) IGP
Storage Samsung 850 EVO 250GB
Display(s) 2x Oldell 24" 1920x1200
Case Bitfenix Nova white windowless non-mesh
Audio Device(s) E-mu 1212m PCI
Power Supply Seasonic G-360
Mouse Logitech Marble trackball, never had a mouse
Keyboard Key Tronic KT2000, no Win key because 1994
Software Oldwin
Always fun to see the users who can't resist the opportunity for name calling and a good roast pop up, this seems pertinent to the topic though;

Media hungry as always to jump on any possible chance for coverage of a miss-step. After all, at the top of their game, all eyes are on them and there's no doubt a crowd hungry to feast on a meal of schadenfreude, as this thread demonstrates.
Hey. We come here for tech power-ups, and to no surprise, we get tech power-ups here.
 
Top