• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD Zen 5 Powered Ryzen AI 300 Series Mobile Processors Supercharge Next Gen Copilot+ AI PCs

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,055 (7.59/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
AMD today launched its Ryzen AI 300 series mobile processors, codenamed "Strix Point." These chips implement a combination of the AMD "Zen 5" microarchitecture for the CPU cores, the XDNA 2 architecture for its powerful new NPU, and the RDNA 3+ graphics architecture for its 33% faster iGPU. The new "Zen 5" microarchitecture provides a 16% generational IPC uplift over "Zen 4" on the backs of several front-end enhancements, wider execution pipelines, more intra core bandwidth, and a revamped FPU that doubles performance of AI and AVX-512 workloads. AMD didn't go in-depth with the microarchitecture, but the broad points of "Zen 5" are detailed in our article for the Ryzen 9000 "Granite Ridge" desktop processors. Not only is AMD using these faster "Zen 5" CPU cores, but also increased the CPU core count by 50%, for a maximum of 12-core/24-thread.

The "Strix Point" monolithic silicon is built on the 4 nm foundry node, and packs a CPU core complex (CCX) with 12 CPU cores, four of these are "Zen 5," which can achieve the highest possible boost frequencies, the other eight are "Zen 5c" cores that feature an identical IPC and the full ISA, including support for SMT; but don't boost as high as the "Zen 5" cores. AMD is claiming a productivity performance increase ranging between 4% and 73% for its top model based in the series, when compared to Intel's Core Ultra 9 185H "Meteor Lake" processor. The iGPU sees its compute unit (CU) count go all the way up to 16 from 12 in the previous generation, and this yields a claimed 33% increase in iGPU gaming performance compared to the integrated Arc graphics of the Core Ultra 9 185H. Lastly, the XDNA 2 NPU sees more that triple the AI inference performance to 50 AI TOPS, compared to the 16 TOPS of the Ryzen 8040 "Hawk Point" processor, and 12 TOPS of Core Ultra "Meteor Lake." This makes the processor meet Microsoft's Copilot+ AI PC requirements.



With this generation, AMD has revamped the processor naming scheme. Ryzen AI is the main brand, followed by a brand level (5, 7, 9, and form-factor U, H, HX); the generation (in this case, 3rd gen NPU-equipped Ryzen AI); and model number. Today, AMD is launching two processor models, the Ryzen AI 9 HX 370, and the Ryzen AI 9 365.


The HX 370 maxes out the silicon, featuring its full 12-core/24-thread CPU, its full 16 CU iGPU, and its XDNA 2 NPU with 50 TOPS on tap. The CPU cores boost up to 5.10 GHz, with a base frequency of 2.00 GHz. The chip's TDP is 28 W, but configurable between 15 W and 54 W by the OEM. The maxed out iGPU is branded the Radeon 890M Graphics, and comes with a maximum engine boost frequency of 2.90 GHz. The next processor model in the series if the Ryzen AI 9 365. This chip is configured with a 10-core/20-thread CPU with 2.00 GHz base- and 5.00 GHz boost frequencies; the Radeon 880M iGPU with 12 CU running at 2.90 GHz engine boost; and the same 50 AI TOPS NPU. It also has the same TDP numbers as the HX 370.



The new XDNA 2 NPU not only offers an over 3-fold increase in AI inferencing performance over the previous generation, but also support for the new Block FP16 datatype, which offers the performance of 8-bit with the precision of 16-bit. Since most AI applications use 16-bit, no quantization is needed.


Notebooks powered by the Ryzen AI 300 series are announcing at Computex.

View at TechPowerUp Main Site
 
Joined
Mar 16, 2017
Messages
1,999 (0.73/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
It's good to see they put more effort into the iGPU, as Intel has caught up and even passed the 780 with Meteor Lake. They definitely can't phone it in there anymore.
 
Joined
Oct 1, 2006
Messages
4,923 (0.75/day)
Location
Hong Kong
Processor Core i7-12700k
Motherboard Z690 Aero G D4
Cooling Custom loop water, 3x 420 Rad
Video Card(s) RX 7900 XTX Phantom Gaming
Storage Plextor M10P 2TB
Display(s) InnoCN 27M2V
Case Thermaltake Level 20 XT
Audio Device(s) Soundblaster AE-5 Plus
Power Supply FSP Aurum PT 1200W
Software Windows 11 Pro 64-bit
Intel has caught up and even passed the 780 with Meteor Lake.
I keep hearing this getting parroted around.
Meteor Lake has caught up with 780M in the way that Vega caught up with Pascal.
Years late and pulls signifcantly more energy to surpass it in 3Dmark but not real games.
Also the problem with iGPU performance has always been memory bandwidth.
 
Last edited:
Joined
Oct 1, 2006
Messages
4,923 (0.75/day)
Location
Hong Kong
Processor Core i7-12700k
Motherboard Z690 Aero G D4
Cooling Custom loop water, 3x 420 Rad
Video Card(s) RX 7900 XTX Phantom Gaming
Storage Plextor M10P 2TB
Display(s) InnoCN 27M2V
Case Thermaltake Level 20 XT
Audio Device(s) Soundblaster AE-5 Plus
Power Supply FSP Aurum PT 1200W
Software Windows 11 Pro 64-bit
I still can't believe they went with such naming scheme...
AMD Marketing never misses an opportunity to shoot themselves in the foot.
They pick the worst possible timing to associate themselves with Intel. Who recently degraded their cpus and reminds everyone that previous fk up on AM5.
Also everyone I know hated that Intel naming scheme.
 
Joined
May 22, 2024
Messages
346 (2.70/day)
System Name Kuro
Processor AMD Ryzen 7 7800X3D@65W
Motherboard MSI MAG B650 Tomahawk WiFi
Cooling Thermalright Phantom Spirit 120 EVO
Memory Corsair DDR5 6000C30 2x48GB (Hynix M)@6000 30-36-36-48 1.36V
Video Card(s) PNY XLR8 RTX 4070 Ti SUPER 16G@200W
Storage Crucial T500 2TB + WD Blue 8TB
Case Lian Li LANCOOL 216
Audio Device(s) Sound Blaster AE-7
Power Supply MSI MPG A850G
Software Ubuntu 24.04 LTS + Windows 10 Home Build 19045
Benchmark Scores 17761 C23 Multi@65W
Note that AI Responsiveness chart is "Time to first token" i.e. prompt processing time, not token generation rate which I understand is memory bandwidth bound. Sneaky.

Though given just how much system prompt and context such local LLM deployments would probably require, I suppose it is still a useful bench.

This AI bandwagon is now super dense crush load with latecomers climbing on top scary-close to overhead lines. The APU with 16 CU is much more exciting.
 
Joined
Aug 4, 2020
Messages
1,604 (1.06/day)
Location
::1
no1 cares about ai. what a fucking waste.
 
Joined
Jan 11, 2022
Messages
729 (0.74/day)
Pushing the mixed cores on a segment where they don’t have the People or market share to iron out the bugs is… bold
 
Joined
Dec 12, 2016
Messages
1,648 (0.58/day)
It seems like just yesterday that the highest iGPU went from 8 to 12 CUs. Now we are on 16 CUs with a 40 CU part on the horizon.

Forget about AI and enjoy the SoC goodness.

I keep hearing this getting parroted around.
Meteor Lake has caught up with 780M in the way that Vega caught up with Pascal.
Years late and pulls signifcantly more energy to surpass it in 3Dmark but not real games.
Also the problem with iGPU performance has always been memory bandwidth.
I agree with Zubasa. Handheld gaming devices using Z1 Extreme have been benchmarked against those with Intels fastest iGPU and the AMD iGPU is much faster and runs cooler.
 
Last edited:
Joined
Oct 6, 2021
Messages
1,605 (1.48/day)
It's good to see they put more effort into the iGPU, as Intel has caught up and even passed the 780 with Meteor Lake. They definitely can't phone it in there anymore.
With a TDP above 30w, yes, in many cases it's competitive. The comparison was made with both at 45w.

Then, I suppose it's faster than the 7840u by a similar margin...
 

SL2

Joined
Jan 27, 2006
Messages
2,248 (0.33/day)
I still can't believe they went with such naming scheme...
1 - What's in a name.
2 - If it generates 0.6 % lower sales by omitting the AI part, why would they.
I SAID IF
3 - I've seen that string size before.
Code:
RyzenAI9HX370
AthlonXP3200+

Pushing the mixed cores on a segment where they don’t have the People or market share to iron out the bugs is… bold
What do you mean? Phoenix 2 came out A YEAR AGO. Where are the complaints?

Edit:
Strix point doesn't support SODIMM.
I knew this was true for Strix halo, but this is news to me at least.

Source, 3 minutes.
 
Last edited:
Joined
Mar 16, 2017
Messages
1,999 (0.73/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
They pretty much have to go to soldered RAM if they want the faster RAM speeds, right? I guess that's the cost of feeding a beefier iGPU. I know there's that new memory standard, but I have my doubts about its adoption now that soldered RAM is so commonplace.
 
D

Deleted member 229121

Guest
+1 it is nice to see the iGPU get some love. As for naming...

Vomit Puke GIF by The Late Late Show with James Corden
 
Joined
May 3, 2018
Messages
2,800 (1.20/day)
no1 cares about ai. what a fucking waste.
Maybe not in the context of Microsoft's copilot total BS, but clearly you don't do photo or video processing. More and more AI photo software is leveraging GPU and now NPU. On Apples with M4 chip, Topaz software runs much faster. I'm actually annoyed desktop 9000 series isn't getting NPU unlike the APU's. I have to rely on my discrete GPU which is older and not particularly fast for AI and the desktop iGPU is piss weak in Zen 4 and Zen 5 compared to the laptop APU. Arrow lake is getting the same NPU as Lunar Lake, so I'm definitely waiting for comparisons to Zen 5 before committing to my new PC build.
 
Joined
Jan 14, 2019
Messages
11,559 (5.55/day)
Location
Midlands, UK
System Name Nebulon B
Processor AMD Ryzen 7 7800X3D
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 24 GB Corsair Vengeance DDR5-4800
Video Card(s) AMD Radeon RX 6750 XT 12 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2, 4 + 8 TB Seagate Barracuda 3.5"
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
I hate saying "AI" in any context other than science-fiction (because what we have now is not effing AI), but now I'll have to use it because it's right in the product name. Thanks, AMD! :shadedshu:
 
Joined
May 22, 2024
Messages
346 (2.70/day)
System Name Kuro
Processor AMD Ryzen 7 7800X3D@65W
Motherboard MSI MAG B650 Tomahawk WiFi
Cooling Thermalright Phantom Spirit 120 EVO
Memory Corsair DDR5 6000C30 2x48GB (Hynix M)@6000 30-36-36-48 1.36V
Video Card(s) PNY XLR8 RTX 4070 Ti SUPER 16G@200W
Storage Crucial T500 2TB + WD Blue 8TB
Case Lian Li LANCOOL 216
Audio Device(s) Sound Blaster AE-7
Power Supply MSI MPG A850G
Software Ubuntu 24.04 LTS + Windows 10 Home Build 19045
Benchmark Scores 17761 C23 Multi@65W
I hate saying "AI" in any context other than science-fiction (because what we have now is not effing AI), but now I'll have to use it because it's right in the product name. Thanks, AMD! :shadedshu:
It is a common trope that "AI" is something that don't yet exist, yet one cannot get around the 'net without stumbling over LLM-generated SEO trash these days, sometimes even on first result of more obscure topics. Simple Markov chain word salad, the usual stuff before LLM, won't usually end up on first page.

At current pace, humanity itself might not even get AGI, before shaking itself apart with all these new "toys".

Back on topic, wonder how long would it take, before someone does a comparative benchmark between this and the equivalent 4C/8c part from Intel. Should be fun.
 
Top