• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Framework Dives Deep into Desktop Model's Deployment of Ryzen AI Max

T0@st

News Editor
Joined
Mar 7, 2023
Messages
3,100 (3.91/day)
Location
South East, UK
System Name The TPU Typewriter
Processor AMD Ryzen 5 5600 (non-X)
Motherboard GIGABYTE B550M DS3H Micro ATX
Cooling DeepCool AS500
Memory Kingston Fury Renegade RGB 32 GB (2 x 16 GB) DDR4-3600 CL16
Video Card(s) PowerColor Radeon RX 7800 XT 16 GB Hellhound OC
Storage Samsung 980 Pro 1 TB M.2-2280 PCIe 4.0 X4 NVME SSD
Display(s) Lenovo Legion Y27q-20 27" QHD IPS monitor
Case GameMax Spark M-ATX (re-badged Jonsbo D30)
Audio Device(s) FiiO K7 Desktop DAC/Amp + Philips Fidelio X3 headphones, or ARTTI T10 Planar IEMs
Power Supply ADATA XPG CORE Reactor 650 W 80+ Gold ATX
Mouse Roccat Kone Pro Air
Keyboard Cooler Master MasterKeys Pro L
Software Windows 10 64-bit Home Edition
We dedicated a lot of our launch presentation of Framework Desktop to the Ryzen AI Max processor it uses, and for a good reason. These truly unique, ultra-high-performance parts are the culmination of decades of technology and architecture investments that AMD has made, going all the way back to their acquisition of ATI in 2006. For our first technical deep dive on Framework Desktop, we're going to go even deeper into Ryzen AI Max and what makes it a killer processor for gaming, workstation, and AI workloads.

What makes Ryzen AI Max special is a combination of three elements: full desktop-class Zen 5 CPU cores, a massive 40-CU Radeon RDNA 3.5 GPU, and a giant 256-bit LPDDR5x memory bus to feed the two, supporting up to 128 GB of memory. Chips and Cheese did an excellent technical overview of the processor with AMD that goes even deeper on this, and we'll pull out some of the highlights along with our own insights. We'll start with the CPUs. Ryzen AI Max supports up to 16 CPU cores split across two 4 nm FinFET dies that AMD calls CCDs. These dies are connected together using an extremely wide, low power, low latency bus across the package substrate. The CPUs are full Zen 5 cores with 512-bit FPUs and support for AVX-512, a vector processing instruction set otherwise only available on Intel's top end server CPUs. We're excited for you to see the multicore performance numbers these CPUs can do in our upcoming press review cycle!




The GPU in Ryzen AI Max is discrete-class, with 40 RDNA 3.5 Compute Units in the Radeon 8060S configuration. For reference, the discrete Radeon 7700S GPU in Framework Laptop 16 has 32 RDNA 3 CUs. The GPU sits on a separate, even larger 4 nm FinFET die from the CPU CCDs. This die also carries the large NPU, video encode/decode blocks, 32 MB of additional MALL cache, and the memory and peripheral interfaces. The GPU handles essentially all current PC titles well at 1080p with high graphics settings, and most at 1440p as well.


To feed a GPU of this class, the processor needs a ton of memory bandwidth. Mobile and desktop processors like the Ryzen AI 300 Series used in Framework Laptop 13 top out at 128-bit memory buses, and Ryzen AI Max doubles that to 256-bit at 8000 MT/s, enabling a massive 256 GB/s of bandwidth. That is similar to the throughput that the discrete 7700S GPU achieves. With eight 32-bit memory packages, the processor can support a colossal 128 GB of LPDDR5x. On Windows, up to 96 GB can be dedicated to the GPU, and we've seen even higher numbers on Linux, making Ryzen AI Max excellent for AI workloads. We'll have a dedicated deep dive on the AI use case soon.

One tradeoff on the memory though is that fanning out that giant 256-bit memory bus requires the LPDDR5x to be soldered. When we learned about Ryzen AI Max, our first question for AMD was whether using LPCAMM2 was possible to modularize the memory. Instead of immediately saying "No, it's not possible," AMD allocated technical architects and engineers to spend days testing out different layouts and running simulations. They then finally concluded that it was in fact not possible without massively downclocking the memory, which would defeat the purpose of having a wide memory bus and large GPU. We accepted the tradeoff of using soldered memory, and unlike some electronics brands, aren't using that as an excuse to charge obscene sums for higher memory capacity.



What makes Ryzen AI Max especially interesting in the Framework Desktop is that we were able to unlock every bit of its power. Because we use a desktop-style 6-heatpipe heatsink from Cooler Master and a 120 mm fan, we can run it at its maximum sustained power of 120 W along with 140 W boost, while keeping the system quiet. We were also able to break out 2x USB4, 2x DisplayPort, HDMI, and all three PCIe x4 interfaces, two for M.2 SSDs and one as a x4 PCIe slot. All of this makes it great in the tiny Framework Desktop form factor, but also makes it excellent to drop the Mainboard into any standard Mini-ITX case. This is, after all, a standard PC! It's just one that uses a one-of-a-kind, monstrous processor from AMD. Pre-orders for Framework Desktop are open now, with new orders shipping in Q3.

View at TechPowerUp Main Site | Source
 
Framework laptops were interesting as concept, modular and upgradable, even if they cost a lot more

But this is the same as a Chinese motherboard with laptop CPU soldered in, or a Chinese mini PC, just more expensive
 
Last edited:
Framework laptops were interesting as concept, modular and upgradable, even if they cost a lot more

But this is the same as a Chinese motherboard with laptop CPU soldered in, or a Chinese mini PC, just more expensive

C'mon, at least use modular CAMM RAM
It does use modular CAMM RAM. Didn't you read the article?

.....Well actually if you did you'd know its impossible to use CAMM RAM at these speeds.
 
It does use modular CAMM RAM.
It doesn't, the RAM is actually soldered on the motherboard.
XV5q5IgLQJuf6Es8.jpg
 
I wonder how easy it would be to 3D print a laptop chassis for this board... I'm still ticked that they didn't fit this into their laptop form factor.
 
It's an interesting product. I am very skeptical about the PSU (the fan that is) though.

Certainly not gonna pre-order it to get it in Q3 at best :rolleyes:
 
A 9th-gen console you can mess with, essentially. It's rather expensive to start with sadly, but I'm all for the popularization of these 'franken-boards' into a legitimate option. I think they're neat.

I want to see an overview of how difficult it is to get suitable replacements for these memory chips at a repair shop. If the boards are easy to work with, I'd be a little happier with this restriction on the board. Also also, PLEASE revise these to have an open-ended x4 connector. I wanna slide x16-sized cards in there. Pretty please. Maybe I should email them about it.
 
A 9th-gen console you can mess with, essentially. It's rather expensive to start with sadly, but I'm all for the popularization of these 'franken-boards' into a legitimate option. I think they're neat.

I want to see an overview of how difficult it is to get suitable replacements for these memory chips at a repair shop. If the boards are easy to work with, I'd be a little happier with this restriction on the board. Also also, PLEASE revise these to have an open-ended x4 connector. I wanna slide x16-sized cards in there. Pretty please. Maybe I should email them about it.
I kinda wish they at-least stuck a 10gbit nic on it. Their cluster is using usb4-net 40gbit point to point networking, it has 2 ports but there aren't exactly usb-c 40gbit switches...
I would prefer something more akin to what Nvidia is doing with the digits box, rather than waste pcie lanes on 5gbit networking... 5gbit switches cost more than 10gbit, they are pointless.
1741939428483.png

1741938653685.png
1741939075086.png
 
I kinda wish they at-least stuck a 10gbit nic on it. Their cluster is using usb4-net 40gbit point to point networking, it has 2 ports but there aren't exactly usb-c 40gbit switches...
I would prefer something more akin to what Nvidia is doing with the digits box, rather than waste pcie lanes on 5gbit networking... 5gbit switches cost more than 10gbit, they are pointless.
View attachment 389652
View attachment 389644View attachment 389647
I think we'll eventually regret Nvidia getting into CPUs....that's all we need is for a giant, monopolistic company with a long history of anti-consumer practices to spread its tentacles further....
 
Back
Top