Friday, November 22nd 2024

AMD's Future Ryzen SoCs May Feature New Chip-Stacking Technology

AMD has recently filed a patent revealing plans to implement "multi-chip stacking" in future Ryzen SoCs, as Wccftech reports, quoting a post on X from @coreteks: "New patent from AMD shows how future Zen SoCs could look. Basically a novel packaging design that enables compact chip stacking and interconnection by having them partially overlap, as in this figure. The dotted line is a larger die stacked on top of those smaller ones". The patent details a new approach where smaller chiplets partially overlap with a larger die, creating space for additional components and functions on the same die. This strategy aims to improve the efficiency of the contact area, thus making room for higher core counts, larger caches, and increased memory bandwidth within the same die size. The proposed stacking will reduce the physical distance between components through overlapping chiplets, thus minimizing interconnect latency and achieving faster communication between different chip parts. The design will also improve power management, as the segregated chiplets allow for better control of each unit through power gating.

Even if long-time rival Intel has lost some of its momentum (and market share) this year, AMD's chance to push ahead with its intention to become number one in the market is to continue to innovate. In the same way that its 3D V-Cache technology made the X3D processor lineup so successful, this chip stacking approach could play a major role in future AMD Ryzen SoCs. It seems that AMD is committed to moving away from the monolithic design era and taking the road of multi-chiplet; however, it can be a long wait until (and if) this chip stacking will complete the journey from patents to design, production, and final product.
Sources: Wccftech, @coreteks
Add your own comment

38 Comments on AMD's Future Ryzen SoCs May Feature New Chip-Stacking Technology

#1
Panther_Seraphin
This could be a massive leap from Infinity fabric and would be interesting to see if they could do a larger IO Die with things like quad channel memory or more CUs to rival things like quicksync while leaving enough space for CCDs to connect via TSVs which will hopefully eliminate the latency penalty that the current chiplet design suffers from by going through the substrate.

I would also wonder if it means things like NPUs/Accelerators could be interchanged to maximise the product stack across the differing markets. So you could have for example one part with 6 CCDs and 2 Accelerators and another with 2 CCDs and 6 accelerators and everything in between. With AMD moving to chiplet design in GPU as well, perhaps that could be a third option for those stacks.

ROCm needs to be AMDs focus in the short to mid term software wise to start taking some market share from nVidia and to make their CPUs have a real USP over an equivalent Intel.
Posted on Reply
#2
tommo1982
Before it reaches consumer market, if ever, it will be introduced in servers first. Certainly it will increase price and considering how PCIe 5.0 increased pc hardware prices in general, the genral consumer has no need for such thing.
Posted on Reply
#3
ymdhis
Yeah, this was mentioned on videocardz one or two weeks ago. Basically they are extrapolating the 9800X3D 3d stacking. The 9800X3D has the memory on bottom and CPU cores on the top for heat reasons. This has several components on the bottom and presumably the most heat intensive parts will go on top. Someone mentioned that the upcoming Halo APUs after Strix Halo will use this. Put cache and cpu cores on the bottom, and a giant GPU on top of them all, to minimize latency for the cache, which the memory starved GPU really really needs.

The one big problem with chiplets was that the interconnects had latency issues and consumed a lot of power, which is why high-end chiplet RDNA3 GPUs did not perform well, to the point that the RDNA4 equivalents have been cancelled. This seeks to improve on those.

What all that in mind, this may not help a lot for CPUs, but it can be one hell of a huge step for GPUs and APUs.... in 2026-7.
Posted on Reply
#4
Dr. Dro
I wonder if full 3D integration is still too costly or unfeasible for desktops. Perhaps they don't quite meet performance targets yet. Intel certainly seems to have greatly delayed/indefinitely postponed their implementation, and AMD certainly seems in no rush to abandon the chiplet design, opting to further refining it instead.
Posted on Reply
#5
R0H1T
I don't see the overlap, where is it?
Posted on Reply
#6
qcmadness
Dr. DroI wonder if full 3D integration is still too costly or unfeasible for desktops. Perhaps they don't quite meet performance targets yet. Intel certainly seems to have greatly delayed/indefinitely postponed their implementation, and AMD certainly seems in no rush to abandon the chiplet design, opting to further refining it instead.
Ask Intel.
Posted on Reply
#7
Readlight
Can't understand this part drawing.
Maybe doted line chip is backside
Posted on Reply
#8
ymdhis
ReadlightCan't understand this part drawing.
Maybe doted line chip is backside
The dotted line is a large chip, sitting on top of smaller chiplets. Think of the chiplets being pillars holding up the ceiling that is the GPU.
Posted on Reply
#9
SL2
ReadlightMaybe doted line chip is backside
Maybe read the text lol
The dotted line is a larger die stacked on top of those smaller ones
Posted on Reply
#11
ZoneDymo
Title of this article just annoys me, like clickbait youtube videos:

"AMD's Future Ryzen SoC's May Feature New Chip-Stacking Technology"

Wow so future stuff might use new tech??!!? unheard off, usually future stuff uses old tech.....
Posted on Reply
#12
Daven
Cache on the bottom, Zen dense cores in the middle and Zen classic cores on top. Sounds like the perfect chip sandwich. Put a dozen of those on package and you have yourself a party platter.
Posted on Reply
#13
SL2
ZoneDymoTitle of this article just annoys me, like clickbait youtube videos:

"AMD's Future Ryzen SoC's May Feature New Chip-Stacking Technology"

Wow so future stuff might use new tech??!!? unheard off, usually future stuff uses old tech.....
Not really. This is not just new tech in the broadesst of terms, it points directly to a specific patent (which I haven't bothered looking up).

Remove the word "future" and you just add confusion.

A bait would be: "AMD's insane new chip-stacking - Intel is doomed*?"


*
I'm not saying it already is/isn't

Give Nomad a break ffs
Posted on Reply
#14
kondamin
ymdhisThe one big problem with chiplets was that the interconnects had latency issues and consumed a lot of power, which is why high-end chiplet RDNA3 GPUs did not perform well, to the point that the RDNA4 equivalents have been cancelled. This seeks to improve on those.
I think it’s more of a tsmc can only produce so much of the stuff and nvidia gobbled it all up.
same happened to hbm
Posted on Reply
#15
Dr. Dro
qcmadnessAsk Intel.
My question was more generic in nature. I feel pretty horrible right now so excuse me if I worded things poorly, what I meant to say is that neither Intel nor AMD have released a fully integrated 3D packaged x86 SoC since Lakefield (largely a prototype), and neither seem to be planning on doing so imminently.

The way I interpreted this news post is that they'll be using something like CoWoS to essentially "bond" the chiplets together through an interposer which will essentially serve the purpose of interconnect, achieving monolithic-like access speeds across chiplets or very close to it, somewhat like an immensely high bandwidth ring bus?
Posted on Reply
#16
londiste
Panther_SeraphinThis could be a massive leap from Infinity fabric and would be interesting to see if they could do a larger IO Die with things like quad channel memory or more CUs to rival things like quicksync while leaving enough space for CCDs to connect via TSVs which will hopefully eliminate the latency penalty that the current chiplet design suffers from by going through the substrate.
Why would that change something significantly in terms of Infinity Fabric? They'll run IF over silicon an TSVs or something but it will still be IF. The latency penalty has quite a bit to do with distance and less about going over substrate. Power is a different thing though.
Dr. DroMy question was more generic in nature. I feel pretty horrible right now so excuse me if I worded things poorly, what I meant to say is that neither Intel nor AMD have released a fully integrated 3D packaged x86 SoC since Lakefield (largely a prototype), and neither seem to be planning on doing so imminently.
Isn't Arrow Lake today doing precisely that and same as Lakefield? It is chiplets/tiles over a silicon interposer. Today from what we know it still seems to be a passive interposer though.
Dr. DroThe way I interpreted this news post is that they'll be using something like CoWoS to essentially "bond" the chiplets together through an interposer which will essentially serve the purpose of interconnect, achieving monolithic-like access speeds across chiplets or very close to it, somewhat like an immensely high bandwidth ring bus?
There does not seem to be much out there about what the patent is actually about. Is it the partial overlap? I am struggling a bit to see the significance of that. Size and yield considerations for the interposer maybe?
Posted on Reply
#17
Wirko
DavenCache on the bottom, Zen dense cores in the middle and Zen classic cores on top. Sounds like the perfect chip sandwich. Put a dozen of those on package and you have yourself a party platter.
Wow, and its performance will be measured in pizzas per minute that it can bake! PPM!
Posted on Reply
#18
Aquinus
Resident Wat-man
AMD put the 3d v cache under the CCDs for current gen to get around the heat flux problem with heat having to travel through the cache. If we're stacking logic on top of eachother, how do they intend to solve the heat problem? Any logic sandwiched between other logic circuits are going to get very hot.
Posted on Reply
#19
freeagent
I also suspect they buried the cache so that they didn't have to use prime silicon to lower thermals.

This should be pretty interesting.
Posted on Reply
#20
TumbleGeorge
WirkoWow, and its performance will be measured in pizzas per minute that it can bake! PPM!
For every train there are passengers, for every pizza there is a computer enthusiast. Folk saying.
Posted on Reply
#21
qcmadness
Dr. DroMy question was more generic in nature. I feel pretty horrible right now so excuse me if I worded things poorly, what I meant to say is that neither Intel nor AMD have released a fully integrated 3D packaged x86 SoC since Lakefield (largely a prototype), and neither seem to be planning on doing so imminently.

The way I interpreted this news post is that they'll be using something like CoWoS to essentially "bond" the chiplets together through an interposer which will essentially serve the purpose of interconnect, achieving monolithic-like access speeds across chiplets or very close to it, somewhat like an immensely high bandwidth ring bus?
As others mentioned above, Arrowlake is exactly a "3D packaged x86 SoC".

But whether this type of products are profitable is up to debate.
Posted on Reply
#22
Dr. Dro
londisteIsn't Arrow Lake today doing precisely that and same as Lakefield? It is chiplets/tiles over a silicon interposer. Today from what we know it still seems to be a passive interposer though.
Lakefield went a step further as it also contained on-die memory, I suppose the technology as they were always raving on about is just not ready for prime time yet.
Posted on Reply
#23
ZoneDymo
SL2Not really. This is not just new tech in the broadesst of terms, it points directly to a specific patent (which I haven't bothered looking up).

Remove the word "future" and you just add confusion.

A bait would be: "AMD's insane new chip-stacking - Intel is doomed*?"


*
I'm not saying it already is/isn't

Give Nomad a break ffs
Could have just said "AMD filed for a new patent for ..."
Posted on Reply
#24
londiste
Dr. DroLakefield went a step further as it also contained on-die memory, I suppose the technology as they were always raving on about is just not ready for prime time yet.
Wasn't that a simple POP for the simple purpose of having a smaller package? It didn't do much other than keep the size of the thing really really small :D
Posted on Reply
#25
lexluthermiester
This only took what, 19 years after conception? Congrats AMD for being first in the X86/X64 market, but also a big damned BOO to both AMD and Intel for being so damn late to the stacked IC party.
Posted on Reply
Add your own comment
Dec 11th, 2024 20:30 EST change timezone

New Forum Posts

Popular Reviews

Controversial News Posts