Monday, June 26th 2023
NVIDIA Allegedly Preparing H100 GPU with 94 and 64 GB Memory
NVIDIA's compute and AI-oriented H100 GPU is supposedly getting an upgrade. The H100 GPU is NVIDIA's most powerful offering and comes in a few different flavors: H100 PCIe, H100 SXM, and H100 NVL (a duo of two GPUs). Currently, the H100 GPU comes with 80 GB of HBM2E, both in the PCIe and SXM5 version of the card. A notable exception if the H100 NVL, which comes with 188 GB of HBM3, but that is for two cards, making it 94 GB per each. However, we could see NVIDIA enable 94 and 64 GB options for the H100 accelerator soon, as the latest PCI ID Repository shows.
According to the PCI ID Repository listing, two messages are posted: "Kindly help to add H100 SXM5 64 GB into 2337." and "Kindly help to add H100 SXM5 94 GB into 2339." These two messages indicate that NVIDIA could prepare its H100 in more variations. In September 2022, we saw NVIDIA prepare an H100 variation with 120 GB of memory, but that still isn't official. These PCIe IDs could just come from engineering samples that NVIDIA is testing in the labs, and these cards could never appear on any market. So, we have to wait and see how it plays out.
Sources:
PCI ID List, via VideoCardz
According to the PCI ID Repository listing, two messages are posted: "Kindly help to add H100 SXM5 64 GB into 2337." and "Kindly help to add H100 SXM5 94 GB into 2339." These two messages indicate that NVIDIA could prepare its H100 in more variations. In September 2022, we saw NVIDIA prepare an H100 variation with 120 GB of memory, but that still isn't official. These PCIe IDs could just come from engineering samples that NVIDIA is testing in the labs, and these cards could never appear on any market. So, we have to wait and see how it plays out.
18 Comments on NVIDIA Allegedly Preparing H100 GPU with 94 and 64 GB Memory
I don't see anything wrong with calling it a GPU. Something like Instinct MI300 apparently lacks ROPs, I'd call that one a datacenter accelerator as it's certainly not a GPU.
You PC/laptop can already do this, you can use the display outputs connected to the iGPU and render the application on the dedicated video card.
MI300 isn't intended to process graphics because it's missing some of that dedicated hardware.
Companies buy these to be used in rendering farms, in case you didn't know, they are also used for virtualization, i.e partition each physical GPU into multiple instances to give virtual machines graphics hardware acceleration. Yes, they are GPUs and are used as such.
Plus, there is precious little mention about anything else graphics related.