Thursday, March 13th 2025

Framework Dives Deep into Desktop Model's Deployment of Ryzen AI Max

We dedicated a lot of our launch presentation of Framework Desktop to the Ryzen AI Max processor it uses, and for a good reason. These truly unique, ultra-high-performance parts are the culmination of decades of technology and architecture investments that AMD has made, going all the way back to their acquisition of ATI in 2006. For our first technical deep dive on Framework Desktop, we're going to go even deeper into Ryzen AI Max and what makes it a killer processor for gaming, workstation, and AI workloads.

What makes Ryzen AI Max special is a combination of three elements: full desktop-class Zen 5 CPU cores, a massive 40-CU Radeon RDNA 3.5 GPU, and a giant 256-bit LPDDR5x memory bus to feed the two, supporting up to 128 GB of memory. Chips and Cheese did an excellent technical overview of the processor with AMD that goes even deeper on this, and we'll pull out some of the highlights along with our own insights. We'll start with the CPUs. Ryzen AI Max supports up to 16 CPU cores split across two 4 nm FinFET dies that AMD calls CCDs. These dies are connected together using an extremely wide, low power, low latency bus across the package substrate. The CPUs are full Zen 5 cores with 512-bit FPUs and support for AVX-512, a vector processing instruction set otherwise only available on Intel's top end server CPUs. We're excited for you to see the multicore performance numbers these CPUs can do in our upcoming press review cycle!
The GPU in Ryzen AI Max is discrete-class, with 40 RDNA 3.5 Compute Units in the Radeon 8060S configuration. For reference, the discrete Radeon 7700S GPU in Framework Laptop 16 has 32 RDNA 3 CUs. The GPU sits on a separate, even larger 4 nm FinFET die from the CPU CCDs. This die also carries the large NPU, video encode/decode blocks, 32 MB of additional MALL cache, and the memory and peripheral interfaces. The GPU handles essentially all current PC titles well at 1080p with high graphics settings, and most at 1440p as well.


To feed a GPU of this class, the processor needs a ton of memory bandwidth. Mobile and desktop processors like the Ryzen AI 300 Series used in Framework Laptop 13 top out at 128-bit memory buses, and Ryzen AI Max doubles that to 256-bit at 8000 MT/s, enabling a massive 256 GB/s of bandwidth. That is similar to the throughput that the discrete 7700S GPU achieves. With eight 32-bit memory packages, the processor can support a colossal 128 GB of LPDDR5x. On Windows, up to 96 GB can be dedicated to the GPU, and we've seen even higher numbers on Linux, making Ryzen AI Max excellent for AI workloads. We'll have a dedicated deep dive on the AI use case soon.

One tradeoff on the memory though is that fanning out that giant 256-bit memory bus requires the LPDDR5x to be soldered. When we learned about Ryzen AI Max, our first question for AMD was whether using LPCAMM2 was possible to modularize the memory. Instead of immediately saying "No, it's not possible," AMD allocated technical architects and engineers to spend days testing out different layouts and running simulations. They then finally concluded that it was in fact not possible without massively downclocking the memory, which would defeat the purpose of having a wide memory bus and large GPU. We accepted the tradeoff of using soldered memory, and unlike some electronics brands, aren't using that as an excuse to charge obscene sums for higher memory capacity.
What makes Ryzen AI Max especially interesting in the Framework Desktop is that we were able to unlock every bit of its power. Because we use a desktop-style 6-heatpipe heatsink from Cooler Master and a 120 mm fan, we can run it at its maximum sustained power of 120 W along with 140 W boost, while keeping the system quiet. We were also able to break out 2x USB4, 2x DisplayPort, HDMI, and all three PCIe x4 interfaces, two for M.2 SSDs and one as a x4 PCIe slot. All of this makes it great in the tiny Framework Desktop form factor, but also makes it excellent to drop the Mainboard into any standard Mini-ITX case. This is, after all, a standard PC! It's just one that uses a one-of-a-kind, monstrous processor from AMD. Pre-orders for Framework Desktop are open now, with new orders shipping in Q3.
Source: Framework Blog
Add your own comment

12 Comments on Framework Dives Deep into Desktop Model's Deployment of Ryzen AI Max

#1
Daven
I keep forgetting the Max has 16 cores.
Posted on Reply
#2
Mathragh
DavenI keep forgetting the Max has 16 cores.
Yeah it's quite awesome with two full Compute Dies
Posted on Reply
#3
friocasa
Framework laptops were interesting as concept, modular and upgradable, even if they cost a lot more

But this is the same as a Chinese motherboard with laptop CPU soldered in, or a Chinese mini PC, just more expensive
Posted on Reply
#4
Packabowl09
friocasaFramework laptops were interesting as concept, modular and upgradable, even if they cost a lot more

But this is the same as a Chinese motherboard with laptop CPU soldered in, or a Chinese mini PC, just more expensive

C'mon, at least use modular CAMM RAM
It does use modular CAMM RAM. Didn't you read the article?

.....Well actually if you did you'd know its impossible to use CAMM RAM at these speeds.
Posted on Reply
#5
friocasa
Packabowl09It does use modular CAMM RAM. Didn't you read the article?

.....Well actually if you did you'd know its impossible to use CAMM RAM at these speeds.
You just did it for me
Posted on Reply
#6
Pizdarenkowitch
Packabowl09It does use modular CAMM RAM.
It doesn't, the RAM is actually soldered on the motherboard.
Posted on Reply
#7
hsew
I wonder how easy it would be to 3D print a laptop chassis for this board... I'm still ticked that they didn't fit this into their laptop form factor.
Posted on Reply
#8
Timbaloo
It's an interesting product. I am very skeptical about the PSU (the fan that is) though.

Certainly not gonna pre-order it to get it in Q3 at best :rolleyes:
Posted on Reply
#9
yfn_ratchet
A 9th-gen console you can mess with, essentially. It's rather expensive to start with sadly, but I'm all for the popularization of these 'franken-boards' into a legitimate option. I think they're neat.

I want to see an overview of how difficult it is to get suitable replacements for these memory chips at a repair shop. If the boards are easy to work with, I'd be a little happier with this restriction on the board. Also also, PLEASE revise these to have an open-ended x4 connector. I wanna slide x16-sized cards in there. Pretty please. Maybe I should email them about it.
Posted on Reply
#10
Patriot
yfn_ratchetA 9th-gen console you can mess with, essentially. It's rather expensive to start with sadly, but I'm all for the popularization of these 'franken-boards' into a legitimate option. I think they're neat.

I want to see an overview of how difficult it is to get suitable replacements for these memory chips at a repair shop. If the boards are easy to work with, I'd be a little happier with this restriction on the board. Also also, PLEASE revise these to have an open-ended x4 connector. I wanna slide x16-sized cards in there. Pretty please. Maybe I should email them about it.
I kinda wish they at-least stuck a 10gbit nic on it. Their cluster is using usb4-net 40gbit point to point networking, it has 2 ports but there aren't exactly usb-c 40gbit switches...
I would prefer something more akin to what Nvidia is doing with the digits box, rather than waste pcie lanes on 5gbit networking... 5gbit switches cost more than 10gbit, they are pointless.

Posted on Reply
#11
AnarchoPrimitiv
PatriotI kinda wish they at-least stuck a 10gbit nic on it. Their cluster is using usb4-net 40gbit point to point networking, it has 2 ports but there aren't exactly usb-c 40gbit switches...
I would prefer something more akin to what Nvidia is doing with the digits box, rather than waste pcie lanes on 5gbit networking... 5gbit switches cost more than 10gbit, they are pointless.

I think we'll eventually regret Nvidia getting into CPUs....that's all we need is for a giant, monopolistic company with a long history of anti-consumer practices to spread its tentacles further....
Posted on Reply
#12
R0H1T
PizdarenkowitchIt doesn't, the RAM is actually soldered on the motherboard.
That's probably because it can't. Who'll develop another board/socket for 256bit wide regular DRAM?
Posted on Reply
Add your own comment
Apr 13th, 2025 06:47 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts