• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Hopper Whitepaper Reveals Key Specs of Monstrous Compute Processor

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,417 (7.51/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
The NVIDIA GH100 silicon powering the next-generation NVIDIA H100 compute processor is a monstrosity on paper, with an NVIDIA whitepaper published over the weekend revealing its key specifications. NVIDIA is tapping into the most advanced silicon fabrication node currently available from TSMC to build the compute die, which is TSMC N4 (4 nm-class EUV). The H100 features a monolithic silicon surrounded by up to six on-package HBM3 stacks.

The GH100 compute die is built on the 4 nm EUV process, and has a monstrous transistor-count of 80 billion, a nearly 50% increase over the GA100. Interestingly though, at 814 mm², the die-area of the GH100 is less than that of the GA100, with its 826 mm² die built on the 7 nm DUV (TSMC N7) node, all thanks to the transistor-density gains of the 4 nm node over the 7 nm one.



The component hierarchy of the GH100 is similar to that of previous generation NVIDIA architectures. The main number-crunching machinery is spread across 144 streaming multiprocessors (SM). The chip features 18,432 FP32 CUDA cores, and 9,216 double-precision (FP64) CUDA cores. There are also 576 fourth-generation Tensor cores. One of the GPCs on the silicon has raster graphics hardware, so the silicon has certain GPU capabilities.

The GH100 features a 6144-bit HBM3 memory interface, and 80 GB is the standard memory amount for the H100 compute processor. The memory bandwidth on offer is expected to exceed 3 TB/s, including ECC support. The host-interfaces get a major upgrade, too. The SXM form-factor board comes with the latest-generation NVLink interconnect that has 900 GB/s bandwidth.

The AIC (add-in card) form-factor model has PCI-Express 5.0 x16 (128 GB/s). Both interfaces introduce resource-pooling features. Lastly, NVIDIA is pushing up the power envelope in pursuit of performance, with the H100 having a typical power value of 700 W, compared to 400 W of the A100. Interestingly, the H100 does not max out the GH100 silicon, with the high-density SXM form-factor board featuring 132 out of 144 SM, while the PCIe AIC board only has 114 out of 144. Both models could come with clock speeds as high as 1.80 GHz.

View at TechPowerUp Main Site | Source
 
Joined
Dec 26, 2006
Messages
3,896 (0.59/day)
Location
Northern Ontario Canada
Processor Ryzen 5700x
Motherboard Gigabyte X570S Aero G R1.1 BiosF5g
Cooling Noctua NH-C12P SE14 w/ NF-A15 HS-PWM Fan 1500rpm
Memory Micron DDR4-3200 2x32GB D.S. D.R. (CT2K32G4DFD832A)
Video Card(s) AMD RX 6800 - Asus Tuf
Storage Kingston KC3000 1TB & 2TB & 4TB Corsair MP600 Pro LPX
Display(s) LG 27UL550-W (27" 4k)
Case Be Quiet Pure Base 600 (no window)
Audio Device(s) Realtek ALC1220-VB
Power Supply SuperFlower Leadex V Gold Pro 850W ATX Ver2.52
Mouse Mionix Naos Pro
Keyboard Corsair Strafe with browns
Software W10 22H2 Pro x64
So it can compute the monstrous profits ;)
 
Joined
Mar 14, 2014
Messages
1,450 (0.37/day)
Processor 11900K
Motherboard ASRock Z590 OC Formula
Cooling Noctua NH-D15 using 2x140mm 3000RPM industrial Noctuas
Memory G. Skill Trident Z 2x16GB 3600MHz
Video Card(s) eVGA RTX 3090 FTW3
Storage 2TB Crucial P5 Plus
Display(s) 1st: LG GR83Q-B 1440p 27in 240Hz / 2nd: Lenovo y27g 1080p 27in 144Hz
Case Lian Li Lancool MESH II RGB (I removed the RGB)
Audio Device(s) AKG Q701's w/ O2+ODAC (Sounds a little bright)
Power Supply Seasonic Prime 850 TX
Mouse Glorious Model D
Keyboard Glorious MMK2 65% Lynx MX switches
Software Win10 Pro
What is the little daughter board supposed to be?
 

Pierpaolo

New Member
Joined
May 5, 2022
Messages
2 (0.00/day)
Could Nvidia produce a card with the H100 chip like a Titan?Is it in his future plans?
 

Accelerator

New Member
Joined
Jan 7, 2020
Messages
7 (0.00/day)
The whitepaper was published before March 23rd, it is too late to publish it as a news.

Could Nvidia produce a card with the H100 chip like a Titan?Is it in his future plans?
H100 only have 1 GPC with 3D engine. Using it as a Graphic card will be terrible.
 
Joined
Mar 14, 2014
Messages
1,450 (0.37/day)
Processor 11900K
Motherboard ASRock Z590 OC Formula
Cooling Noctua NH-D15 using 2x140mm 3000RPM industrial Noctuas
Memory G. Skill Trident Z 2x16GB 3600MHz
Video Card(s) eVGA RTX 3090 FTW3
Storage 2TB Crucial P5 Plus
Display(s) 1st: LG GR83Q-B 1440p 27in 240Hz / 2nd: Lenovo y27g 1080p 27in 144Hz
Case Lian Li Lancool MESH II RGB (I removed the RGB)
Audio Device(s) AKG Q701's w/ O2+ODAC (Sounds a little bright)
Power Supply Seasonic Prime 850 TX
Mouse Glorious Model D
Keyboard Glorious MMK2 65% Lynx MX switches
Software Win10 Pro
Top