Thursday, November 16th 2023

AMD Brings New AI and Compute Capabilities to Microsoft Customers

Today at Microsoft Ignite, AMD and Microsoft featured how AMD products, including the upcoming AMD Instinct MI300X accelerator, AMD EPYC CPUs and AMD Ryzen CPUs with AI engines, are enabling new services and compute capabilities across cloud and generative AI, Confidential Computing, Cloud Computing and smarter, more intelligent PCs.

"AMD is fostering AI everywhere - from the cloud, to the enterprise and end point devices - all powered by our CPUs, GPUs, accelerators and AI engines," said Vamsi Boppana, Senior Vice President, AI, AMD. "Together with Microsoft and a rapidly growing ecosystem of software and hardware partners, AMD is accelerating innovation to bring the benefits of AI to a broad portfolio of compute engines, with expanding software capabilities."
Powering New AI Capabilities in Azure AMD Instinct MI300X
Microsoft's new Azure ND MI300x v5 Virtual Machine (VM) series optimized for AI workloads features the AMD Instinct MI300X, making Azure the first cloud to use the new accelerator. The new VMs are part of Microsoft's diverse infrastructure supporting AI innovation for enterprises everywhere giving customers more choice in efficiency and scalability.

Advancing Cloud Computing with AMD EPYC Processors
4th Gen AMD EPYC processors are also now being used to run a new generation of general purpose, memory-intensive and compute-optimized VMs. These new VMs from Microsoft continue to showcase the growth and demand of AMD EPYC processors in the cloud and will provide better price options, up to 20% better performance for general purpose and memory-intensive VMs, and up to 2x the CPU performance for compute-optimized VMs versus the previous generation of AMD EPYC-powered VMs. The new VM series will be made available in public preview in the first quarter of 2024.

At Ignite, AMD is also highlighting the Azure NGads V620 series of VMs, now in general availability. It is a new addition to the Azure N-series family of GPU-accelerated VMs for visualization. These VMs are powered by multiple AMD technologies - AMD Radeon PRO V620 GPUs and 3rd Gen AMD EPYC CPUs. The NGads V620 series is intended for workloads that require relatively more GPU resources per VM, to support more demanding workloads or more users per VM. The V620 delivers a great experience for multiple classes of GPU workloads, including gaming, VDI and rendering. NG series users get an optimized driver through the new AMD Software: Cloud Edition.

AI for PCs
AMD also showcased the ongoing momentum of Ryzen AI, the first dedicated AI accelerator available on an x86 processor. With over 50 systems available now with Ryzen 7000 Series processors with Ryzen AI built in, there are millions of AMD AI PCs available in market. AMD and Microsoft have already jointly enabled Windows Studio Effects on Ryzen AI PCs, and AMD continues to work with software developers, to bring expanding AI workloads and generative AI experiences to consumers.

Tune into the AMD Advancing AI event on December 6 at 10am PT to hear more about the AMD portfolio of AI products.
Source: AMD
Add your own comment

3 Comments on AMD Brings New AI and Compute Capabilities to Microsoft Customers

#1
Daven
MS is using Nvidia, AMD and ARM tech for AI and Cloud. That just leaves Intel. Does MS use any Intel tech for these big data tasks?
Posted on Reply
#2
pressing on
DavenMS is using Nvidia, AMD and ARM tech for AI and Cloud. That just leaves Intel. Does MS use any Intel tech for these big data tasks?
It would seem so, according to Marc Charest an Azure specialist at Microsoft

"...Azure announces new AI optimized VM series featuring AMD’s flagship MI300X GPU

ND MI300X v5, Azure’s AI-focused virtual machine series with largest HBM capacity

What differentiates a ND MI300X v5 VM from our existing family of ND-series VMs is the inclusion of 8 x AMD Instinct MI300X GPUs interconnected via Infinity Fabric 3.0 in each VM. MI300X offers industry leading HBM capacity and bandwidth, 192 GB of HBM3 memory per GPU capable of speeds up to 5.2 TB/s. With greater capacity and more bandwidth customers can process larger models faster, using fewer GPUs. On top of this, these virtual machines use the same winning platform as our other ND-series VMs, which includes the latest technologies like:

400 Gb/s NVIDIA Quantum-2 CX7 InfiniBand per GPU with 3.2Tb/s per VM
4th Gen Intel Xeon Scalable processors
PCIE Gen5 host-to-GPU interconnect with 64GB/s bandwidth per GPU
16 Channels of DDR5 DIMMs...".
Posted on Reply
#3
Daven
pressing onIt would seem so, according to Marc Charest an Azure specialist at Microsoft

"...Azure announces new AI optimized VM series featuring AMD’s flagship MI300X GPU

ND MI300X v5, Azure’s AI-focused virtual machine series with largest HBM capacity

What differentiates a ND MI300X v5 VM from our existing family of ND-series VMs is the inclusion of 8 x AMD Instinct MI300X GPUs interconnected via Infinity Fabric 3.0 in each VM. MI300X offers industry leading HBM capacity and bandwidth, 192 GB of HBM3 memory per GPU capable of speeds up to 5.2 TB/s. With greater capacity and more bandwidth customers can process larger models faster, using fewer GPUs. On top of this, these virtual machines use the same winning platform as our other ND-series VMs, which includes the latest technologies like:

400 Gb/s NVIDIA Quantum-2 CX7 InfiniBand per GPU with 3.2Tb/s per VM
4th Gen Intel Xeon Scalable processors
PCIE Gen5 host-to-GPU interconnect with 64GB/s bandwidth per GPU
16 Channels of DDR5 DIMMs...".
I guess using Intel processors inside an Instinct accelerator data center doesn’t warrant an official MS press release.
Posted on Reply
Nov 21st, 2024 07:59 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts