Friday, October 11th 2024

AMD EPYC "Turin" with 192 Cores and 384 Threads Delivers Almost 40% Higher Performance Than Intel Xeon 6

AMD has unveiled its latest EPYC processors, codenamed "Turin," featuring Zen 5 and Zen 5C dense cores. Phoronix's thorough testing reveals remarkable advancements in performance, efficiency, and value. The new lineup includes the EPYC 9575F (64-core), EPYC 9755 (128-core), and EPYC 9965 (192-core) models, all showing impressive capabilities across various server and HPC workloads. In benchmarks, a dual-socket configuration of the 128-core EPYC 9755 Turin outperformed Intel's dual Xeon "Granite Rapids" 6980P setup with MRDIMM-8800 by 40% in the geometric mean of all tests. Surprisingly, even a single EPYC 9755 or EPYC 9965 matched the dual Xeon 6980P in expanded tests with regular DDR5-6400. Within AMD's lineup, the EPYC 9755 showed a 1.55x performance increase over its predecessor, the 96-core EPYC 9654 "Genoa". The EPYC 9965 surpassed the dual EPYC 9754 "Bergamo" by 45%.

These gains come with improved efficiency. While power consumption increased moderately, performance improvements resulted in better overall efficiency. For example, the EPYC 9965 used 32% more power than the EPYC 9654 but delivered 1.55x the performance. Power consumption remains competitive: the EPYC 9965 averaged 275 Watts (peak 461 Watts), the EPYC 9755 averaged 324 Watts (peak 500 Watts), while Intel's Xeon 6980P averaged 322 Watts (peak 547 Watts). AMD's pricing strategy adds to the appeal. The 192-core model is priced at $14,813, compared to Intel's 128-core CPU at $17,800. This competitive pricing, combined with superior performance per dollar and watt, has resonated with hyperscalers. Estimates suggest 50-60% of hyperscale deployments now use AMD processors.
The Blue Empire is ready to strike back at AMD, with its upcoming "Sierra Forest" CPUs with up to 288 E-cores. Intel must deliver similar or greater performance metrics with its new E-core Xeon processor, keeping power consumption low and costs reasonable, so we expect to see a heated battle in the server space between Intel and AMD. Besides more cores, "Sierra Forest" will bring 12-channel DDR5 memory, so the massive core count will get adequate memory bandwidth. Until then, AMD has the crown of performance, efficiency, and value, and we are curious to see this driving competition and further innovation from both sides.
Source: Phoronix
Add your own comment

63 Comments on AMD EPYC "Turin" with 192 Cores and 384 Threads Delivers Almost 40% Higher Performance Than Intel Xeon 6

#26
DavidC1
There's a 10% performance hit because it's underperforming heavily in NAMD. Some platform immaturity for Granite Rapids as there are few others that show really bad performance for GNR.

Also 1P to 2P scaling sucks for Intel. 1P performance difference is only about 20% between Intel and AMD.
Posted on Reply
#27
Solaris17
Super Dainty Moderator
venturiWell... ...not exactly. ...Some of us have those builds as our personal home PC. Yes, you can actually get all the parts. It does require some creativity, engineering, and patience to make it quiet and suitable for your home.

Same I literally have a sapphire rapids chip in my main machine. Another in a clam shell and 2 emeral rapids chips in the room next to me.

you just have to know what your looking for.

this is super awesome from AMD the server space needs this kind of competition!
Posted on Reply
#28
Vya Domus
DavenBoth Intel and AMD have 128 Performance core versions with similar amounts of cache but AMD still kicks their butt by almost 40%. Is it clocks, IPC, AVX512, all, something else?
It's probably the clock speeds, Intel chips are notorious for sever throttling under AVX loads. Possibly inferior inter core communication.
Posted on Reply
#29
yfn_ratchet
Neo_MorpheusAlso this….

.
Gave this a look and it was a matter of 'sucks more power, but mean perf/watt is better' and I think that a pretty on-brand comparison between amd64 and aarch64.

ARM just isn't it for HPC unless you're really worried about the electricity bill. What's always been more exciting for me is how well ARM does in the consumer space, since it has already carved out a niche in low-power with mobile devices and Apple Silicon devices. The main issue seems to be adoption, and rightfully so—developing software for two different architectures ain't all that profitable unless you're in bed with Tim Cook. Microsoft bungled its chance with the Snapdragon X Elite and Windows ARM.
Posted on Reply
#30
AusWolf
Impressive... But the product naming is stupid. 9575 for the 64-core and 9755 for the 128-core chip? How many clients are gonna order the wrong part because they accidentally flipped two numbers in an email? :laugh:
Posted on Reply
#31
Minus Infinity
Why is Zen 5 in server config so much better than Zen 5% in desktop config. We are talking up to 10x better performance improvements.
Posted on Reply
#32
HDBitdata
venturiWell... ...not exactly. ...Some of us have those builds as our personal home PC. Yes, you can actually get all the parts. It does require some creativity, engineering, and patience to make it quiet and suitable for your home.

Wow. Care to share your case setup? I always wanted to get a dual Epyc with dual GPU like yours but didn’t know how to make it work with all these weird server motherboards.

edit: nvm just looked at your post history
Posted on Reply
#33
Chaitanya
AnarchoPrimitivAttention Gamers:

This is the point of Zen5.....to win the battle where the REAL money in x86 is....

But of course anyone who read Phoronix's review of Zen5 when the consumer chips were released, you would have seen this coming.
Tell that to Hardware unboxed, granted AMD's loud mouths at marketting were to blame for the desktop launch debacle.
Posted on Reply
#34
igormp
Minus InfinityWhy is Zen 5 in server config so much better than Zen 5% in desktop config. We are talking up to 10x better performance improvements.
Just look at Ryzen 9000 benchmarks on phoronix. It was widely known that Zen 5 got 20~40% improvements in those cases and that Epyc Turin would simply follow suit.

Main issue was that there were no noticeable benefits for gamers and that made this crowd throw a fit because their expected toy did not deliver lol
Posted on Reply
#35
Minus Infinity
igormpJust look at Ryzen 9000 benchmarks on phoronix. It was widely known that Zen 5 got 20~40% improvements in those cases and that Epyc Turin would simply follow suit.

Main issue was that there were no noticeable benefits for gamers and that made this crowd throw a fit because their expected toy did not deliver lol
No, not just gaming, productivity is just as weak 2-10% with some regressions.
Posted on Reply
#36
igormp
Minus InfinityNo, not just gaming, productivity is just as weak 2-10% with some regressions.
1- Lots of stuff were apparently windows issues. Same workloads on linux provided better improvements (for both Zen 4 and Zen 5, but Zen 5 also saw bigger uplifts nonetheless)
2- Some of the workloads indeed saw no benefit at all, such as cinebench, which is really a SSE benchmark, which Zen 5 saw no improvements compared to Zen 4.

www.phoronix.com/review/amd-ryzen-9950x-9900x/15

17.8% on average, with some workloads seeing 40~60% uplift. It really is a matter of what specific workload you're dealing with, there is no "productivity" overall.

Feel free to scroll over 400 results, all of those can be considered "productivity" workloads:
openbenchmarking.org/result/2408130-PTS-RYZEN99089&sgm=1&hgv=Ryzen+9+9900X%252CRyzen+9+9950X&sor
Posted on Reply
#37
Scrizz
HBSoundNICE! I would imagine that only a few pieces of software are designed to step on the gas to take advantage of a CPU like that!!!
Getting a CPU like that, only to take advantage of 75%, would not be worthwhile in the long run.
These things are for virtualization and the like.
You could run soo many VMs with it.
Posted on Reply
#38
Neo_Morpheus
AusWolfImpressive... But the product naming is stupid. 9575 for the 64-core and 9755 for the 128-core chip? How many clients are gonna order the wrong part because they accidentally flipped two numbers in an email? :laugh:
Hopefully this helps:

.
Posted on Reply
#39
tetrapak
venturiWell... ...not exactly. ...Some of us have those builds as our personal home PC. Yes, you can actually get all the parts. It does require some creativity, engineering, and patience to make it quiet and suitable for your home.

Total offtopic, but your system is impressive :O holy sh** that’s some serious powerhouse, nice !
Posted on Reply
#40
Wirko
Neo_MorpheusHopefully this helps:

.
They're going to have to extend the 2nd digit to A-Z or alpha-omega.
Vya DomusIt's probably the clock speeds, Intel chips are notorious for sever throttling under AVX loads. Possibly inferior inter core communication.
At least the inter-chiplet communication should be far superior with EMIB vs. wires on substrate. It would be reflected in some HPC benchmark where all the cores work on a common giant data set, of a size close to the total L3.
Posted on Reply
#41
AusWolf
Neo_MorpheusHopefully this helps:

.
This is the most retarded, idiotic, convoluted mess of a naming scheme I've seen in my whole life! Product series? Performance? Generation? What the hell do these things even mean? Complete bullshit. :kookoo:
Posted on Reply
#42
Darmok N Jalad
venturiWell... ...not exactly. ...Some of us have those builds as our personal home PC. Yes, you can actually get all the parts. It does require some creativity, engineering, and patience to make it quiet and suitable for your home.

I hope you don't have cats! :D
AusWolfThis is the most retarded, idiotic, convoluted mess of a naming scheme I've seen in my whole life! Product series? Performance? Generation? What the hell do these things even mean? Complete bullshit. :kookoo:
In this space, it really doesn't matter. Whatever name they choose, it's not really going to spell it out--it just needs to be a unique identifier. Anyone shopping this segment is going to have a product list open and do a lot of cost/benefit measures. Once they pick the winner, it's just a matter of putting the correct model number on the order sheet.
Posted on Reply
#43
mechtech
Vayra86Impressive. And actually capturing market share. Strange indeed, no anti AMD crowd here! Because the products just speak for themselves. Worth reflecting on, for any average GPU topic.
Sometimes it still doesn't matter. I asked our IT/IS admins how come we don't have a single AMD product.................answer...............we're not familiar with it so Intel only, or Intel is better in every way.

That's what I was told.
Posted on Reply
#44
Neo_Morpheus
AusWolfThis is the most retarded, idiotic, convoluted mess of a naming scheme I've seen in my whole life! Product series? Performance? Generation? What the hell do these things even mean? Complete bullshit. :kookoo:
I dont know, but it kinds makes sense to me.

Now, i would love something similar with Intel offerings, because those have no rhyme or reason, to me anyways.
Posted on Reply
#45
Wirko
AusWolfThis is the most retarded, idiotic, convoluted mess of a naming scheme I've seen in my whole life! Product series? Performance? Generation? What the hell do these things even mean? Complete bullshit. :kookoo:
Yeah, Zen generation being encoded in the model number is fully retarded. Luckily Intel avoids that, and often AMD does too.
Posted on Reply
#46
Vayra86
mechtechSometimes it still doesn't matter. I asked our IT/IS admins how come we don't have a single AMD product.................answer...............we're not familiar with it so Intel only, or Intel is better in every way.

That's what I was told.
That answers directly why it takes multiple generations of successful leading products to get a serious foot in the door. Enterprise is all about trust and support, consistency. Intel's been offering that for a long time. AMD will have to keep firing on all cylinders to attain that status.
Posted on Reply
#47
venturi
Darmok N JaladI hope you don't have cats! :D

In this space, it really doesn't matter. Whatever name they choose, it's not really going to spell it out--it just needs to be a unique identifier. Anyone shopping this segment is going to have a product list open and do a lot of cost/benefit measures. Once they pick the winner, it's just a matter of putting the correct model number on the order sheet.
I have "a" cat: a 23 LB, 11month old mainecoon. He's completely harmless around our PCs.

I understand your comment as the PCs in our house are more of an open case design. With the concept of quiet and cool (even under all core load or all GPU load, the fans do spin up but its not unpleasant, most of the tasks don't make things spool up to max

The CPUs are massive, and can generate a lot of heat, but we keep the house between 69-72F, so not an issue.
The new CPUs at 500W....well...I am not sure if I can design an air cooled system. 1000W on one board (before counting a couple of TB of ram, 2 video cards, and the U.2/u.3 drives is a massive amount of energy to dissipate quietly. Its only 200W more than what I'm doing now, but its still at the edge of feasible (quietly). For the prior, the heatsinks had to be heavily edited to retain air cool and be effective.

Would I embark on the highest of the new series? ....I might way to Zen 6
Beyond this CPU step, I would also need a massive increase in other factors such as a worthy GEN 6 and the rest.



While we can argue and postulate and many things on the new CPUs what I am most impressed with:


A week after Intel's reveal on their new server CPUs (in a sea of other intel organizational and product woes). WHAM!! --> AMD smacked them back down.
Amazing timing.....

I'd hate to be Patrick at the next board meeting...
Posted on Reply
#48
yfn_ratchet
Vayra86That answers directly why it takes multiple generations of successful leading products to get a serious foot in the door. Enterprise is all about trust and support, consistency. Intel's been offering that for a long time. AMD will have to keep firing on all cylinders to attain that status.
And even then those kinds of clients will only come around when it's necessary to replace everything, like companies still running on 2011 Xeons that can't keep up anymore and they need to be advertised to that yes, you can, in fact, run all of your clusters in the exact same way on AMD-based systems and we even made a helpful tool to do all the tedious work for you. I mean, I get it, it's the same human behavior patterns that surface in any vaguely bureaucratic system, but it gets rather frustrating to mull over for more than a few seconds.
Posted on Reply
#49
tpuuser256
HBSoundAlso, I think about when Asrock/Supermicro have the dual slot support for a processor like this, that is 1000W just at a dual CPUS.
The number of bots you could run with that... /s
Posted on Reply
#50
kondamin
Minus InfinityWhy is Zen 5 in server config so much better than Zen 5% in desktop config. We are talking up to 10x better performance improvements.
Zen 5 has A much wider pipeline than zen 4
it is capable of doing more work in one tick than zen 4 is but the workloads just aren’t there on the desktop.

buying a new truck that is just as fast but can carry 50% more load isn’t going to get the job done faster if the load remains the same as on the original truck.

amd Should follow intel and split server architecture from the desktop architecture and try to make it lean so it can better deal with higher frequencies
Posted on Reply
Add your own comment
Dec 11th, 2024 22:53 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts