Tuesday, March 21st 2023

Supermicro Servers Now Featuring NVIDIA HGX and PCIe-Based H100 8-GPU Systems

Supermicro, Inc., a Total IT Solution Provider for AI/ML, Cloud, Storage, and 5G/Edge, today has announced that it has begun shipping its top-of-the-line new GPU servers that feature the latest NVIDIA HGX H100 8-GPU system. Supermicro servers incorporate the new NVIDIA L4 Tensor Core GPU in a wide range of application-optimized servers from the edge to the data center.

"Supermicro offers the most comprehensive portfolio of GPU systems in the industry, including servers in 8U, 6U, 5U, 4U, 2U, and 1U form factors, as well as workstations and SuperBlade systems that support the full range of new NVIDIA H100 GPUs," said Charles Liang, president and CEO of Supermicro. "With our new NVIDIA HGX H100 Delta-Next server, customers can expect 9x performance gains compared to the previous generation for AI training applications. Our GPU servers have innovative airflow designs which reduce fan speeds, lower noise levels, and consume less power, resulting in a reduced total cost of ownership (TCO). In addition, we deliver complete rack-scale liquid-cooling options for customers looking to further future-proof their data centers."
Supermicro's most powerful new 8U GPU server is now shipping in volume. Optimized for AI, DL, ML, and HPC workloads, this new Supermicro 8U server is powered by the NVIDIA HGX H100 8-GPU featuring the highest GPU-to-GPU communication using the fastest NVIDIA NVLink 4.0 technology, NVSwitch interconnects, and NVIDIA Quantum-2 InfiniBand and Spectrum-4 Ethernet networking to break through the barriers of AI at scale. In addition, Supermicro offers several performance-optimized configurations of GPU servers, including direct-connect/single-root/dual-root CPUs to GPUs and front or rear I/O models with AC and DC power in standard and OCP DC rack configurations. The Supermicro X13 SuperBlade enclosure accommodates 20 NVIDIA H100 Tensor Core PCIe GPUs or 40 NVIDIA L40 GPUs in an 8U enclosure. In addition, up to 10 NVIDIA H100 PCIe GPUs or 20 NVIDIA L4 Tensor Core GPUs can be used in a 6U enclosure. These new systems deliver the optimized acceleration ideal for running NVIDIA AI Enterprise, the software layer of the NVIDIA AI platform.

Liquid cooling of these servers is also supported on many GPU servers. In addition, Supermicro is announcing a liquid-cooled AI development system (as a tower or rack-mounted configuration) containing two CPUs and four NVIDIA A100 Tensor Core GPUs, which are ideal for office and home office environments and capable of being deployed in departmental and corporate clusters.

Supermicro systems support the new NVIDIA L4 GPU, which delivers multi-fold acceleration gain and energy efficiency compared to previous generations. The same applies to AI inferencing, video streaming, virtual workstations, and graphics applications in the enterprise, in the cloud, and at the edge. With NVIDIA's AI platform and full-stack approach, the L4 is optimized for inference at scale for a broad range of AI applications, including recommendations, voice-based AI avatar assistants, chatbots, visual search, and contact center automation to deliver the best-personalized experiences. As the most efficient NVIDIA accelerator for mainstream servers, L4 has up to 4x higher AI performance, increased energy efficiency, and over 3x more video streaming capacity and efficiency supporting AV1 encoding/decoding. The L4 GPU's versatility for inference and visualization and its small, energy-efficient, single-slot, low-profile, low-power-use 72 W form factor make it ideal for global deployments, including at edge locations.

"Equipping Supermicro servers with the unmatched power of the new NVIDIA L4 Tensor Core GPU is enabling customers to accelerate their workloads efficiently and sustainably," said Dave Salvator, director of accelerated computing products at NVIDIA. "Optimized for mainstream deployments, the NVIDIA L4 delivers a low-profile form factor operating in a 72 W low-power envelope, taking AI performance and efficiency at the edge to new heights."

Supermicro's new PCIe accelerated solutions empower the creation of 3D worlds, digital twins, 3D simulation models, and the industrial metaverse. In addition to supporting the previous generations of NVIDIA OVX systems, Supermicro offers an OVX 3.0 configuration featuring four NVIDIA L40 GPUs, two NVIDIA ConnectX -7 SmartNICs, an NVIDIA BlueField -3 DPU, and the latest NVIDIA Omniverse Enterprise software.
Source: Supermicro
Add your own comment

Comments on Supermicro Servers Now Featuring NVIDIA HGX and PCIe-Based H100 8-GPU Systems

There are no comments yet.

Dec 29th, 2024 02:37 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts