Report an Error

NVIDIA H200 NVL

Graphics Processor
GH100
Cores
16896
TMUs
528
ROPs
24
Memory Size
141 GB
Memory Type
HBM3e
Bus Width
5120 bit
GPU Chip
GPU
The H200 NVL is a professional graphics card by NVIDIA, launched on November 18th, 2024. Built on the 5 nm process, and based on the GH100 graphics processor, the card does not support DirectX. Since H200 NVL does not support DirectX 11 or DirectX 12, it might not be able to run all the latest games. The GH100 graphics processor is a large chip with a die area of 814 mm² and 80,000 million transistors. It features 16896 shading units, 528 texture mapping units, and 24 ROPs. Also included are 528 tensor cores which help improve the speed of machine learning applications. NVIDIA has paired 141 GB HBM3e memory with the H200 NVL, which are connected using a 5120-bit memory interface. The GPU is operating at a frequency of 1365 MHz, which can be boosted up to 1785 MHz, memory is running at 1313 MHz.
Being a dual-slot card, the NVIDIA H200 NVL draws power from an 8-pin EPS power connector, with power draw rated at 600 W maximum. This device has no display connectivity, as it is not designed to have monitors connected to it. H200 NVL is connected to the rest of the system using a PCI-Express 5.0 x16 interface. The card measures 267 mm in length, 111 mm in width, and features a dual-slot cooling solution.

Graphics Processor

GPU Name
GH100
Architecture
Hopper
Foundry
TSMC
Process Size
5 nm
Transistors
80,000 million
Density
98.3M / mm²
Die Size
814 mm²

Graphics Card

Release Date
Nov 18th, 2024
Generation
Tesla Hopper
(Hxx)
Predecessor
Tesla Ada
Successor
Tesla Blackwell
Production
Active
Bus Interface
PCIe 5.0 x16

Clock Speeds

Base Clock
1365 MHz
Boost Clock
1785 MHz
Memory Clock
1313 MHz
5.3 Gbps effective

Memory

Memory Size
141 GB
Memory Type
HBM3e
Memory Bus
5120 bit
Bandwidth
3.36 TB/s

Render Config

Shading Units
16896
TMUs
528
ROPs
24
SM Count
132
Tensor Cores
528
L1 Cache
256 KB (per SM)
L2 Cache
50 MB

Theoretical Performance

Pixel Rate
42.84 GPixel/s
Texture Rate
942.5 GTexel/s
FP16 (half)
241.3 TFLOPS (4:1)
FP32 (float)
60.32 TFLOPS
FP64 (double)
30.16 TFLOPS (1:2)

Board Design

Slot Width
Dual-slot
Length
267 mm
10.5 inches
Width
111 mm
4.4 inches
TDP
600 W
Suggested PSU
1000 W
Outputs
No outputs
Power Connectors
8-pin EPS

Graphics Features

DirectX
N/A
OpenGL
N/A
OpenCL
3.0
Vulkan
N/A
CUDA
9.0
Shader Model
N/A

GH100 GPU Notes

Tensor Cores: 4th Gen
NVENC: No Support
NVDEC: No Support
PureVideo HD: VP11
VDPAU: Feature Set K
Jan 11th, 2025 17:07 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts