Wednesday, January 31st 2024
AMD Ryzen 7 8700G AI Performance Enhanced by Overclocked DDR5 Memory
We already know about AMD Ryzen 7 8700G APU's enjoyment of overclocked memory—early reviews demonstrated the graphical benefits granted by fiddling with "iGPU engine clock and the processor's memory frequency." While gamers can enjoy a boosted integrated graphics solution that is comparable in performance 1080p stakes to a discrete Radeon RX 6500 XT GPU, AI enthusiasts are eager to experiment with the "Hawk Point" pat's Radeon 780M IGP and Neural Processing Unit (NPU)—the first generation Ryzen XDNA inference engine can unleash up to 16 AI TOPs. One individual, chi11eddog, posted their findings through social media channels earlier today, coinciding with the official launch of Ryzen 8000G processors. The initial set of results concentrated on the Radeon 780M aspect; NPU-centric data may arrive at a later date.
They performed quick tests on AMD's freshly released Ryzen 7 8700G desktop processor, combined with an MSI B650 Gaming Plus WiFi motherboard and two sticks of 16 GB DDR5-4800 memory. The MSI exclusive "Memory Try It" feature was deployed further up in the tables—this assisted in achieving and gauging several "higher system RAM frequency" settings. Here is chi11eddog's succinct interpretation of benchmark results: "7600 MT/s is 15% faster than 4800 MT/s in UL Procyon AI Inference Benchmark and 4% faster in GIMP with Stable Diffusion." The processor's default memory state is capable of producing 210 Float32 TOPs, according to chi11eddog's inference chart. The 6000 MT/s setting produces a 7% improvement over baseline, while 7200 MT/s drives proceedings to 11%—the flagship APU's Radeon 780M iGPU appears to be quite dependent on bandwidth. Their GIMP w/ Stable Diffusion benchmarks also taxed the integrated RDNA 3 graphics solution—again, it was deemed to be fairly bandwidth hungry.
Sources:
chi11eddog Tweet, Wccftech
They performed quick tests on AMD's freshly released Ryzen 7 8700G desktop processor, combined with an MSI B650 Gaming Plus WiFi motherboard and two sticks of 16 GB DDR5-4800 memory. The MSI exclusive "Memory Try It" feature was deployed further up in the tables—this assisted in achieving and gauging several "higher system RAM frequency" settings. Here is chi11eddog's succinct interpretation of benchmark results: "7600 MT/s is 15% faster than 4800 MT/s in UL Procyon AI Inference Benchmark and 4% faster in GIMP with Stable Diffusion." The processor's default memory state is capable of producing 210 Float32 TOPs, according to chi11eddog's inference chart. The 6000 MT/s setting produces a 7% improvement over baseline, while 7200 MT/s drives proceedings to 11%—the flagship APU's Radeon 780M iGPU appears to be quite dependent on bandwidth. Their GIMP w/ Stable Diffusion benchmarks also taxed the integrated RDNA 3 graphics solution—again, it was deemed to be fairly bandwidth hungry.
6 Comments on AMD Ryzen 7 8700G AI Performance Enhanced by Overclocked DDR5 Memory
Also, 210 TOPS at Float32 sounds a little bit over the top. Like, about 1 order of magnitude vs AMD slides, and I don't think they were sandbagging here. This looks like a benchmark score, not TOPS indicator.
I haven't checked reviews to see where the GPU sits max at stock or overclocked, but it appears to make sense for a tweaker for a light-weight budget build that finds that level of CPU/GPU acceptable.
I definitely think he just about hit the nail on the head with ram speeds. I'd likely shoot for ~7600-8000 decoupled and be perfectly happy with that considering the power of the GPU.
I would probably buy something like $130 7200mhz RAM and then either bump the voltage to ~1.45v (or less if possible) and/or and loosen the timings until whatever GPU clock you end up gives the best performance. While latency matters for CPU performance, I doubt people care THAT much for this product, while it shouldn't really effect the GPU which thrives on raw BW.
I mean, it's not GOOD, but it could work for someone in a pinch, or be a nice toy to play around with.
This is one of the reasons I'll wait for Zen 6. Not just because there will probably be interesting APU options due to SEDs and sufficient cache (+ whatever else they come up with), but that IOD really needs to be updated (not just shrunk to)to what's possible on 4nm so that decent ram can run 1:1 with the fabric. I would imagine 4nm could support 7600, maybe ~7800-8000, closer to the fastest available OC (8400mhz)?
Maybe not. We shall see.
Could be one of those things that ends up making the difference between sticking with 32GB (if fast) versus upgrading to 48GB+ (of more traditional 6000-6400mhz) for some peoples' use-cases.
Still one of the things I anticipate, however much better. AMD has always needed bandwidth, especially for APUs. I hope this will finally be solved shortly (on 3nm APU/GPUs even if through 4nm cache/MC).