• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

AMD MI300 Compute Accelerator Allegedly Features Eight Logic Dies

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,230 (7.55/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
AMD's next-generation MI300 compute accelerator is expected to significantly scale up the logic density, according to a rumor by Moore's Law is Dead. Based on the CDNA3 compute architecture, the MI300 will be a monstrous large multi-chip module with as many as 8 logic dies (compute dies), each with its dedicated HBM3 stack. The compute dies (logic dies), will be 3D-stacked on top of I/O dies that pack the memory controllers, and the interconnect that performs the inter-die, and inter-package communication.

The report even goes on to mention that the compute die at the top level of the stack will be built on TSMC N5 (5 nm) silicon fabrication process, while the I/O die below will be TSMC N6 (6 nm). At this point it's not known if AMD will use the package to wire the logic stacks to the memory stacks, or whether it will take the pricier route of using a silicon interposer, but the report supports the interposer theory—that an all-encompassing interposer seats all eight compute dies, all four I/O dies (each with two compute dies), and the eight HBM3 stacks. An interposer is a silicon die that facilitates high density microscopic wiring between two dies on a package, which are otherwise not possible through large package substrate wiring.



View at TechPowerUp Main Site | Source
 
Joined
Feb 15, 2019
Messages
1,658 (0.79/day)
System Name Personal Gaming Rig
Processor Ryzen 7800X3D
Motherboard MSI X670E Carbon
Cooling MO-RA 3 420
Memory 32GB 6000MHz
Video Card(s) RTX 4090 ICHILL FROSTBITE ULTRA
Storage 4x 2TB Nvme
Display(s) Samsung G8 OLED
Case Silverstone FT04
Just 600W ?
Nvidia wins the electric bill with 900W
 
Joined
Nov 6, 2016
Messages
1,751 (0.60/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
Just 600W ?
Nvidia wins the electric bill with 900W

Yeah, next thing you know, the "people" in the Wccftech comments section will be attacking each other for having "peasant" circuit breakers and standard home wiring that can't handle it

"This peasant doesn't run 240V three phase! What a l4m3r"
 
Last edited:
Joined
Jun 5, 2021
Messages
284 (0.22/day)
Intel and AMD are the leaders in mcm gpu's.. nvidia will be left behind if they dnot do mcm.. monolith has its limits
 
Joined
Nov 6, 2016
Messages
1,751 (0.60/day)
Location
NH, USA
System Name Lightbringer
Processor Ryzen 7 2700X
Motherboard Asus ROG Strix X470-F Gaming
Cooling Enermax Liqmax Iii 360mm AIO
Memory G.Skill Trident Z RGB 32GB (8GBx4) 3200Mhz CL 14
Video Card(s) Sapphire RX 5700XT Nitro+
Storage Hp EX950 2TB NVMe M.2, HP EX950 1TB NVMe M.2, Samsung 860 EVO 2TB
Display(s) LG 34BK95U-W 34" 5120 x 2160
Case Lian Li PC-O11 Dynamic (White)
Power Supply BeQuiet Straight Power 11 850w Gold Rated PSU
Mouse Glorious Model O (Matte White)
Keyboard Royal Kludge RK71
Software Windows 10
Its not just MCM. 3D stacking of core logic is also important and so far AMD is the only one doing this.

Yeah, considering what AMD has accomplished so far, it makes you wonder what Lisa Su would be capable of if she had Intel's $15.19 Billion annual R&D budget or Nvidia's $5.27 billion instead of AMD's $2.84 Billion which, unlike Nvidia, has to be divided between x86 and GPU, and I think it's safe to assume that x86 gets substantially more than 50% of that budget considering the x86 has a much larger T.A.M, so it's impressive that AMD has been able to reach parity and in some cases surpass Nvidia in rasterization, and if current leaks are to be believed, might edge out Nvidia for performance in every category with RDNA3.

*Yes, Intel has many different areas its R&D budget must be divided amongst, but I'd be willing to bet the share it allocates to x86 and GPU are larger than AMD's respective allocations. Either way, when considering what AMD is able to achieve with its comparably smaller financial resources, it's seriously impressive.
 
Joined
Apr 12, 2013
Messages
7,525 (1.77/day)
Especially so when you consider they were nearly bankrupt 6 years back, though the last CEO also shares quite a bit of credit in this massive turnaround.
 
Joined
Jun 18, 2021
Messages
2,547 (2.03/day)
Its not just MCM. 3D stacking of core logic is also important and so far AMD is the only one doing this.

Intel is also doing that with Foveros and EMIB, though I believe neither is yet in mass production and only in very select products (but they actually own the technology instead of depending on tsmc for most of it)
 

eidairaman1

The Exiled Airman
Joined
Jul 2, 2007
Messages
42,096 (6.63/day)
Location
Republic of Texas (True Patriot)
System Name PCGOD
Processor AMD FX 8350@ 5.0GHz
Motherboard Asus TUF 990FX Sabertooth R2 2901 Bios
Cooling Scythe Ashura, 2×BitFenix 230mm Spectre Pro LED (Blue,Green), 2x BitFenix 140mm Spectre Pro LED
Memory 16 GB Gskill Ripjaws X 2133 (2400 OC, 10-10-12-20-20, 1T, 1.65V)
Video Card(s) AMD Radeon 290 Sapphire Vapor-X
Storage Samsung 840 Pro 256GB, WD Velociraptor 1TB
Display(s) NEC Multisync LCD 1700V (Display Port Adapter)
Case AeroCool Xpredator Evil Blue Edition
Audio Device(s) Creative Labs Sound Blaster ZxR
Power Supply Seasonic 1250 XM2 Series (XP3)
Mouse Roccat Kone XTD
Keyboard Roccat Ryos MK Pro
Software Windows 7 Pro 64
Yeah, considering what AMD has accomplished so far, it makes you wonder what Lisa Su would be capable of if she had Intel's $15.19 Billion annual R&D budget or Nvidia's $5.27 billion instead of AMD's $2.84 Billion which, unlike Nvidia, has to be divided between x86 and GPU, and I think it's safe to assume that x86 gets substantially more than 50% of that budget considering the x86 has a much larger T.A.M, so it's impressive that AMD has been able to reach parity and in some cases surpass Nvidia in rasterization, and if current leaks are to be believed, might edge out Nvidia for performance in every category with RDNA3.

*Yes, Intel has many different areas its R&D budget must be divided amongst, but I'd be willing to bet the share it allocates to x86 and GPU are larger than AMD's respective allocations. Either way, when considering what AMD is able to achieve with its comparably smaller financial resources, it's seriously impressive.
For the budget AMD has, they are kicking both intel and nvidia in the balls over and over. Upward and Forward.
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,597 (2.41/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Yeah, next thing you know, the "people" in the Wccftech comments section will be attacking each other for having "peasant" circuit breakers and standard home wiring that can't handle it

"This peasant doesn't run 240V three phase! What a l4m3r"
Three phase is 400V...
 
Joined
Jun 6, 2021
Messages
684 (0.54/day)
System Name Red Devil
Processor AMD 5950x - Vermeer - B0
Motherboard Gigabyte X570 AORUS MASTER
Cooling NZXT Kraken Z73 360mm; 14 x Corsair QL 120mm RGB Case Fans
Memory G.SKill Trident Z Neo 32GB Kit DDR4-3600 CL14 (F4-3600C14Q-32GTZNB)
Video Card(s) PowerColor's Red Devil Radeon RX 6900 XT (Navi 21 XTX)
Storage 2 x Western Digital SN850 1GB; 1 x Samsung SSD 870EVO 2TB
Display(s) 3 x Asus VG27AQL1A; 1 x Sony A1E OLED 4K
Case Corsair Obsidian 1000D
Audio Device(s) Corsair SP2500; Steel Series Arctis Nova Pro Wireless (XBox Version)
Power Supply AX1500i Digital ATX - 1500w - 80 Plus Titanium
Mouse Razer Basilisk V3
Keyboard Razer Huntsman V2 - Optical Gaming Keyboard
Software Windows 11

r9

Joined
Jul 28, 2008
Messages
3,300 (0.55/day)
System Name Primary|Secondary|Poweredge r410|Dell XPS|SteamDeck
Processor i7 11700k|i7 9700k|2 x E5620 |i5 5500U|Zen 2 4c/8t
Memory 32GB DDR4|16GB DDR4|16GB DDR4|32GB ECC DDR3|8GB DDR4|16GB LPDDR5
Video Card(s) RX 7800xt|RX 6700xt |On-Board|On-Board|8 RDNA 2 CUs
Storage 2TB m.2|512GB SSD+1TB SSD|2x256GBSSD 2x2TBGB|256GB sata|512GB nvme
Display(s) 50" 4k TV | Dell 27" |22" |3.3"|7"
VR HMD Samsung Odyssey+ | Oculus Quest 2
Software Windows 11 Pro|Windows 10 Pro|Windows 10 Home| Server 2012 r2|Windows 10 Pro
For the budget AMD has, they are kicking both intel and nvidia in the balls over and over. Upward and Forward.
Especially that are no longer pretending to by your friendly neighborhood Pricederman.
 
Joined
Mar 21, 2016
Messages
2,508 (0.79/day)
So basically something resembling x8 RX 6400 XT's in a MCM design and I/O dies underneath that let them all communicate together!!? That or more of a die shrink on the RX 6400 XT bringing it up to parity with a RX 6500 XT plus any architectural changes if it's also RDNA3 as well!!? This is some amazing stuff. Funny how everything is resembling arcade boards and rom chips and stuff like the Atari STFM memory piggybacking scaled down to modern day manufacturing techniques and processes everything old is new again. The real magic is how they get it all to sync together from a engineering standpoint at reasonable latency what a achievement. It's sort of a LucidHydra concept all crunched together in a tidy package without all the latency complication concern troubles.
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,597 (2.41/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
I had to look this up... In the US, you can have a 3-phase 240v? Its called a 3 Phase Open Delta (No clue what dafuq that means). Unless this website is completely wrong, I personally do not know. So this is a legit question. https://www.oempanels.com/240v-single-phase-and-240v-3-phase
In Europe, three phase is 400V and uses that connector. That said most people have never seen that connector, as it's not commonly used outside of construction sites and farms. At least where I come most people do have a 400V Volt socket, bit it's for cookers, so again, not something a lot of people have seen, unless they bought a new cooker.

Open Delta is usually without a neutral wire, the other kind of three phase, which again is common in Europe it's in a Y configuration with a neutral wire.
 
Last edited:
Joined
Jun 18, 2021
Messages
2,547 (2.03/day)
Open Delta is usually without a neutral wire, the other kind of three phase, which again is common in Europe it's in a Y configuration with a neutral wire.

Their (US and other split phase countries) and ours (Europe and other three phase countries) Open Delta is a bit different, they require a neutral on the Open delta and that neutral is not that "neutral" (the voltage to neutral is different on one of the phases). Our Delta configuration simply has no neutral (there's not even a place for it because the three phases are all the same, where the split system Delta has a neutral between the regular split phases).

Our Y config usually has a neutral connected in the center (between all phases) but it's not always necessary to included it for 3 phase loads.
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,597 (2.41/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Their (US and other split phase countries) and ours (Europe and other three phase countries) Open Delta is a bit different, they require a neutral on the Open delta and that neutral is not that "neutral" (the voltage to neutral is different on one of the phases). Our Delta configuration simply has no neutral (there's not even a place for it because the three phases are all the same, where the split system Delta has a neutral between the regular split phases).

Our Y config usually has a neutral connected in the center (between all phases) but it's not always necessary to included it for 3 phase loads.
I hate three phase, it's so damned complicated.
 
Joined
Oct 27, 2009
Messages
1,182 (0.21/day)
Location
Republic of Texas
System Name [H]arbringer
Processor 4x 61XX ES @3.5Ghz (48cores)
Motherboard SM GL
Cooling 3x xspc rx360, rx240, 4x DT G34 snipers, D5 pump.
Memory 16x gskill DDR3 1600 cas6 2gb
Video Card(s) blah bigadv folder no gfx needed
Storage 32GB Sammy SSD
Display(s) headless
Case Xigmatek Elysium (whats left of it)
Audio Device(s) yawn
Power Supply Antec 1200w HCP
Software Ubuntu 10.10
Benchmark Scores http://valid.canardpc.com/show_oc.php?id=1780855 http://www.hwbot.org/submission/2158678 http://ww
So basically something resembling x8 RX 6400 XT's in a MCM design and I/O dies underneath that let them all communicate together!!? That or more of a die shrink on the RX 6400 XT bringing it up to parity with a RX 6500 XT plus any architectural changes if it's also RDNA3 as well!!? This is some amazing stuff. Funny how everything is resembling arcade boards and rom chips and stuff like the Atari STFM memory piggybacking scaled down to modern day manufacturing techniques and processes everything old is new again. The real magic is how they get it all to sync together from a engineering standpoint at reasonable latency what a achievement. It's sort of a LucidHydra concept all crunched together in a tidy package without all the latency complication concern troubles.


Except instead of 12cu 768sp rdna3 chiplets they use CDNA3 chiplets of unknown config. But likely more cores in total than the current gen CDNA2 Mi250s, which used dual chiplet 104cu config, with 6656sp per cu.

So we aren't expecting 8k cores, current 250x already has more than that. We are expecting 2x-4x current cores.
 
Joined
Mar 21, 2016
Messages
2,508 (0.79/day)
Yeah I forgot AMD forked it's GPU designs still same idea just more compute focused. Wonder how quickly this will trickle down to consumers.
 
Top