• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Framework Dives Deep into Desktop Model's Deployment of Ryzen AI Max

T0@st

News Editor
Joined
Mar 7, 2023
Messages
2,911 (3.78/day)
Location
South East, UK
System Name The TPU Typewriter
Processor AMD Ryzen 5 5600 (non-X)
Motherboard GIGABYTE B550M DS3H Micro ATX
Cooling DeepCool AS500
Memory Kingston Fury Renegade RGB 32 GB (2 x 16 GB) DDR4-3600 CL16
Video Card(s) PowerColor Radeon RX 7800 XT 16 GB Hellhound OC
Storage Samsung 980 Pro 1 TB M.2-2280 PCIe 4.0 X4 NVME SSD
Display(s) Lenovo Legion Y27q-20 27" QHD IPS monitor
Case GameMax Spark M-ATX (re-badged Jonsbo D30)
Audio Device(s) FiiO K7 Desktop DAC/Amp + Philips Fidelio X3 headphones, or ARTTI T10 Planar IEMs
Power Supply ADATA XPG CORE Reactor 650 W 80+ Gold ATX
Mouse Roccat Kone Pro Air
Keyboard Cooler Master MasterKeys Pro L
Software Windows 10 64-bit Home Edition
We dedicated a lot of our launch presentation of Framework Desktop to the Ryzen AI Max processor it uses, and for a good reason. These truly unique, ultra-high-performance parts are the culmination of decades of technology and architecture investments that AMD has made, going all the way back to their acquisition of ATI in 2006. For our first technical deep dive on Framework Desktop, we're going to go even deeper into Ryzen AI Max and what makes it a killer processor for gaming, workstation, and AI workloads.

What makes Ryzen AI Max special is a combination of three elements: full desktop-class Zen 5 CPU cores, a massive 40-CU Radeon RDNA 3.5 GPU, and a giant 256-bit LPDDR5x memory bus to feed the two, supporting up to 128 GB of memory. Chips and Cheese did an excellent technical overview of the processor with AMD that goes even deeper on this, and we'll pull out some of the highlights along with our own insights. We'll start with the CPUs. Ryzen AI Max supports up to 16 CPU cores split across two 4 nm FinFET dies that AMD calls CCDs. These dies are connected together using an extremely wide, low power, low latency bus across the package substrate. The CPUs are full Zen 5 cores with 512-bit FPUs and support for AVX-512, a vector processing instruction set otherwise only available on Intel's top end server CPUs. We're excited for you to see the multicore performance numbers these CPUs can do in our upcoming press review cycle!




The GPU in Ryzen AI Max is discrete-class, with 40 RDNA 3.5 Compute Units in the Radeon 8060S configuration. For reference, the discrete Radeon 7700S GPU in Framework Laptop 16 has 32 RDNA 3 CUs. The GPU sits on a separate, even larger 4 nm FinFET die from the CPU CCDs. This die also carries the large NPU, video encode/decode blocks, 32 MB of additional MALL cache, and the memory and peripheral interfaces. The GPU handles essentially all current PC titles well at 1080p with high graphics settings, and most at 1440p as well.


To feed a GPU of this class, the processor needs a ton of memory bandwidth. Mobile and desktop processors like the Ryzen AI 300 Series used in Framework Laptop 13 top out at 128-bit memory buses, and Ryzen AI Max doubles that to 256-bit at 8000 MT/s, enabling a massive 256 GB/s of bandwidth. That is similar to the throughput that the discrete 7700S GPU achieves. With eight 32-bit memory packages, the processor can support a colossal 128 GB of LPDDR5x. On Windows, up to 96 GB can be dedicated to the GPU, and we've seen even higher numbers on Linux, making Ryzen AI Max excellent for AI workloads. We'll have a dedicated deep dive on the AI use case soon.

One tradeoff on the memory though is that fanning out that giant 256-bit memory bus requires the LPDDR5x to be soldered. When we learned about Ryzen AI Max, our first question for AMD was whether using LPCAMM2 was possible to modularize the memory. Instead of immediately saying "No, it's not possible," AMD allocated technical architects and engineers to spend days testing out different layouts and running simulations. They then finally concluded that it was in fact not possible without massively downclocking the memory, which would defeat the purpose of having a wide memory bus and large GPU. We accepted the tradeoff of using soldered memory, and unlike some electronics brands, aren't using that as an excuse to charge obscene sums for higher memory capacity.



What makes Ryzen AI Max especially interesting in the Framework Desktop is that we were able to unlock every bit of its power. Because we use a desktop-style 6-heatpipe heatsink from Cooler Master and a 120 mm fan, we can run it at its maximum sustained power of 120 W along with 140 W boost, while keeping the system quiet. We were also able to break out 2x USB4, 2x DisplayPort, HDMI, and all three PCIe x4 interfaces, two for M.2 SSDs and one as a x4 PCIe slot. All of this makes it great in the tiny Framework Desktop form factor, but also makes it excellent to drop the Mainboard into any standard Mini-ITX case. This is, after all, a standard PC! It's just one that uses a one-of-a-kind, monstrous processor from AMD. Pre-orders for Framework Desktop are open now, with new orders shipping in Q3.

View at TechPowerUp Main Site | Source
 
Joined
Dec 3, 2009
Messages
1,311 (0.23/day)
Location
The Netherlands
System Name PC ||Zephyrus G14 2023
Processor Ryzen 9 5900x || R9 7940HS
Motherboard MAG B550M MORTAR WIFI ||
Cooling 1x Corsair XR5 360mm Rad||
Memory 2x16GB HyperX 3600 @ 3800 || 2x16GB DDR5 @ 4800MTs
Video Card(s) MSI RTX 2080Ti Sea Hawk EK X || RTX 4060
Storage Samsung 9801TB x2 + Striped Tiered Storage Space (2x 128Gb SSD + 2x 1TB HDD) || 1TB NVME
Display(s) Iiyama PL2770QS + Samsung U28E590, || 14' 2560x1600 165Hz IPS
Case SilverStone Alta G1M ||
Power Supply Cooler Master V850 SFX || 240W
Mouse ROG Pugio II
Software Win 11 64bit || Win 11 64bit
Joined
Aug 18, 2014
Messages
68 (0.02/day)
Framework laptops were interesting as concept, modular and upgradable, even if they cost a lot more

But this is the same as a Chinese motherboard with laptop CPU soldered in, or a Chinese mini PC, just more expensive
 
Last edited:

Packabowl09

New Member
Joined
May 4, 2023
Messages
15 (0.02/day)
Framework laptops were interesting as concept, modular and upgradable, even if they cost a lot more

But this is the same as a Chinese motherboard with laptop CPU soldered in, or a Chinese mini PC, just more expensive

C'mon, at least use modular CAMM RAM
It does use modular CAMM RAM. Didn't you read the article?

.....Well actually if you did you'd know its impossible to use CAMM RAM at these speeds.
 
Joined
Jun 24, 2023
Messages
51 (0.08/day)
It does use modular CAMM RAM.
It doesn't, the RAM is actually soldered on the motherboard.
XV5q5IgLQJuf6Es8.jpg
 
Joined
May 19, 2011
Messages
240 (0.05/day)
I wonder how easy it would be to 3D print a laptop chassis for this board... I'm still ticked that they didn't fit this into their laptop form factor.
 
Joined
Jan 7, 2020
Messages
237 (0.12/day)
It's an interesting product. I am very skeptical about the PSU (the fan that is) though.

Certainly not gonna pre-order it to get it in Q3 at best :rolleyes:
 
Joined
Jul 31, 2024
Messages
241 (0.93/day)
Processor AMD Ryzen 7 5700X
Motherboard ASUS ROG Strix B550-F Gaming Wifi II
Cooling Noctua NH-U12S Redux
Memory 4x8G Teamgroup Vulcan Z DDR4; 3600MHz @ CL18
Video Card(s) MSI Ventus 2X GeForce RTX 3060 12GB
Storage WD_Black SN770, Leven JPS600, Toshiba DT01ACA
Display(s) Samsung ViewFinity S6
Case Fractal Design Pop Air TG
Power Supply Corsair CX750M
Mouse Keychron M1
Keyboard Keychron C2 Pro
VR HMD Valve Index
A 9th-gen console you can mess with, essentially. It's rather expensive to start with sadly, but I'm all for the popularization of these 'franken-boards' into a legitimate option. I think they're neat.

I want to see an overview of how difficult it is to get suitable replacements for these memory chips at a repair shop. If the boards are easy to work with, I'd be a little happier with this restriction on the board. Also also, PLEASE revise these to have an open-ended x4 connector. I wanna slide x16-sized cards in there. Pretty please. Maybe I should email them about it.
 
Joined
Oct 27, 2009
Messages
1,212 (0.21/day)
Location
Republic of Texas
System Name [H]arbringer
Processor 4x 61XX ES @3.5Ghz (48cores)
Motherboard SM GL
Cooling 3x xspc rx360, rx240, 4x DT G34 snipers, D5 pump.
Memory 16x gskill DDR3 1600 cas6 2gb
Video Card(s) blah bigadv folder no gfx needed
Storage 32GB Sammy SSD
Display(s) headless
Case Xigmatek Elysium (whats left of it)
Audio Device(s) yawn
Power Supply Antec 1200w HCP
Software Ubuntu 10.10
Benchmark Scores http://valid.canardpc.com/show_oc.php?id=1780855 http://www.hwbot.org/submission/2158678 http://ww
A 9th-gen console you can mess with, essentially. It's rather expensive to start with sadly, but I'm all for the popularization of these 'franken-boards' into a legitimate option. I think they're neat.

I want to see an overview of how difficult it is to get suitable replacements for these memory chips at a repair shop. If the boards are easy to work with, I'd be a little happier with this restriction on the board. Also also, PLEASE revise these to have an open-ended x4 connector. I wanna slide x16-sized cards in there. Pretty please. Maybe I should email them about it.
I kinda wish they at-least stuck a 10gbit nic on it. Their cluster is using usb4-net 40gbit point to point networking, it has 2 ports but there aren't exactly usb-c 40gbit switches...
I would prefer something more akin to what Nvidia is doing with the digits box, rather than waste pcie lanes on 5gbit networking... 5gbit switches cost more than 10gbit, they are pointless.
1741939428483.png

1741938653685.png
1741939075086.png
 
Joined
Nov 6, 2016
Messages
1,861 (0.60/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
I kinda wish they at-least stuck a 10gbit nic on it. Their cluster is using usb4-net 40gbit point to point networking, it has 2 ports but there aren't exactly usb-c 40gbit switches...
I would prefer something more akin to what Nvidia is doing with the digits box, rather than waste pcie lanes on 5gbit networking... 5gbit switches cost more than 10gbit, they are pointless.
View attachment 389652
View attachment 389644View attachment 389647
I think we'll eventually regret Nvidia getting into CPUs....that's all we need is for a giant, monopolistic company with a long history of anti-consumer practices to spread its tentacles further....
 
Top