Giga Computing Leaked Server Roadmap Points to 600 W CPUs & 700 W GPUs

[T0@st]

A leaked roadmap (that seems to be authored) by Giga Computing provides an interesting peak into the future of next generation enterprise-oriented CPUs and GPUs. TDP details of Intel, AMD and NVIDIA hardware are featured within the presentation slide - and all indications point to a trend of continued power consumption growth. Intel's server CPU lineups, including fourth generation Sapphire Rapids-SP and fifth-gen Emerald Rapids-SP Xeon chips, are projected to hit maximum TGPs of 350 W by mid-2024. Team Blue's sixth gen Granite Rapids is expected to arrive in the latter half of 2024, and Gigabyte's leaked roadmap points to a push into 500 W territories going forward into 2025.

AMD's Zen 5-based Turin server CPUs are expected to ship by the second half of 2024, and power consumption is estimated to hit a maximum of 600 W - representing a 50% increase over the Zen 4-based Genoa family. The 2024 NVIDIA PCIe GPU lineup is likely hitting TDPs of up to 500 W, it is rumored that these enterprise cards will be based on the Blackwell chip architecture - set to succeed current generation H100 "Hopper" PCIe accelerators (featuring 350-450 W TDPs). It is possible that AMD's Instinct-class PCIe accelerator family will become the direct competition, these cards are rated up to 400 W. The AMD Instinct MI250 OAM category has a maximum rating of 560 W. The NVIDIA Grace and Grace Hopper CPU Superchips are said to feature 600 W and 1000 W TDPs (respectively).



View at TechPowerUp Main Site | Source

 

[Deleted member 230939]

Seems a little crazy to me.

 

[AusWolf]

Where are those 280 W AMD CPUs from last year?

Saying that this "roadmap" is far-fetched would be an understatement.

 

[Chrispy_]

The server TDPs increasing is entirely expected though because they're just cramming more cores into each socket.

50% higher TDP with 33%-50% more cores per socket, more IPC per core, and better performance/Watt makes the TDP irrelevant when taken in isolation.

 

[AnarchoPrimitiv]

It's called the "Rebound Effect" and it's been observed since the beginning of the Industrial revolution and its basically the observation that improvements in efficiency are NEVER met with a NET reduction in power consumption. It's one of the key arguments in the conclusion that many researchers are reaching: that technology will not, and inherently cannot, save us or the environment (with respect to the seemingly inevitable fate of every iteration of civilization prior to the current one: collapse).

Either way, don't expect power usage figures to go down.

 

[Division7800X3D]

The server TDPs increasing is entirely expected though because they're just cramming more cores into each socket.

50% higher TDP with 33%-50% more cores per socket, more IPC per core, and better performance/Watt makes the TDP irrelevant when taken in isolation.

exactly i hope the 600w to amd turin if for 2S Epyc zen5 aka dual sockets.... cuz 600W on a single package is insaine. I DONT WANT THAT!!! for DESKTOPS ITS REDICULOUS!~!!! so much for effeciancy going out the window! this is dumb as ****

unless this is on desktop with a 32core cpu and 80+CUs RDNA+ whatever by then APU (on AM5/AM6 ) then ok but 600w cpu only is JUST WRONG

gonna need 3-4000 wats psus that cost just as much . NO!

 

[TechLurker]

I can't wait until we return to having to slot CPUs in like we do with GPUs, and with GPU-style coolers slapped on.

 

[TheinsanegamerN]

exactly i hope the 600w to amd turin if for 2S Epyc zen5 aka dual sockets.... cuz 600W on a single package is insaine. I DONT WANT THAT!!! for DESKTOPS ITS REDICULOUS!~!!! so much for effeciancy going out the window! this is dumb as ****

And there it is, the ignorance of the peanut gallery. "efficiency" doesnt mean "below a static limit". 600w on a single package is not insane when said package is doing the work of 4x250w packages from the previous generation. You completely missed the point of the comment you were quoting, which is that CONTEXT MATTERS.

unless this is on desktop with a 32core cpu and 80+CUs RDNA+ whatever by then APU (on AM5/AM6 ) then ok but 600w cpu only is JUST WRONG

I'm guessing you're one of those types that thinks 4x200w cpus are more efficient then one 600w CPU because "number is smaller", right?

gonna need 3-4000 wats psus that cost just as much . NO!

This is for server use genius. Not home use. Multiple kW draws are not a problem in the pro space, and havent been for some time.

 

[konga]

Where are those 280 W AMD CPUs from last year?

Saying that this "roadmap" is far-fetched would be an understatement.

The 280W AMD CPUs are right here: https://www.amd.com/en/processors/epyc-7003-series

And the Epyc 9004 processors go up to 360W: https://www.amd.com/en/processors/epyc-9004-series

You realize this is about servers, right?

I can't wait until we return to having to slot CPUs in like we do with GPUs, and with GPU-style coolers slapped on.

Big CPU air coolers are already almost as large as GPU coolers in volume, only with different dimensions. These server CPUs have many chiplets with large IHSes, so the heat density isn't so bad and they're coolable without having to use massive heatsinks. Especially in a server chassis with forced air.

 

[Chrispy_]

Where are those 280 W AMD CPUs from last year?

Saying that this "roadmap" is far-fetched would be an understatement.

I have two in a VDI pod at one of the datacenters.

I don't know how available they are but when you're spending almost $25K on Quadro GPUs, you don't want to bottleneck the VMs with a CPU problem.

Both Dell and Supermicro quoted me similar numbers, I went with Supermicro because I hate aggressive Dell salesmen and enjoyed telling them to piss off - and that they lost the bid even though it was actually a really close call.

 

[Dristun]

It's called the "Rebound Effect" and it's been observed since the beginning of the Industrial revolution and its basically the observation that improvements in efficiency are NEVER met with a NET reduction in power consumption. It's one of the key arguments in the conclusion that many researchers are reaching: that technology will not, and inherently cannot, save us or the environment (with respect to the seemingly inevitable fate of every iteration of civilization prior to the current one: collapse).

Either way, don't expect power usage figures to go down.

Spoiler: offtop

I realize you'd probably disagree, given your username, but don't either expansion past our planet or self-replicating drones seem to solve at least the issue of being unable to save the current environment? While we might be unable to maintain our humanity, at least the lineage will be able to continue in some way.

 

[csendesmark]

This is why we get global warming....

 

[ymdhis]

Judging by the numbers those CPU numbers are from the server space, where it is expected. We won't be getting 500W CPUs just now, unless you want to get a Threadripper (which is already like 4x Ryzens in a single socket), or until next years desktop Intel i7 cpus.

I can't wait until we return to having to slot CPUs in like we do with GPUs, and with GPU-style coolers slapped on.

That would require a new desktop form factor since there's just no place to vent the heat in such a configuration.

I'd be more interested in either dedicated GPU sockets so we can put tower coolers on them, or having cpu + gpu + hbm chiplets all under one package and the motherboard reduced to a backplane with a rear panel.

 

[Nephilim666]

This is why we get global warming....

Nothing to do with emissions right?

 

[TechLurker]

That would require a new desktop form factor since there's just no place to vent the heat in such a configuration.

In all seriousness though, we ARE overdue for a new motherboard form-factor. I'm partial to the idea of motherboards now having integrated power delivery built-in, similar to the Gigabyte AORUS Stealth or ASUS Prime Utopia concepts, and to a similar degree, the Apple Mac Pro Cheese Grater Desktop with the custom GPU/motherboard that had an extra-long PCIe slot with the latter half of the slot just being pure power connections. Then redesign cases for more modern cooling and power arrangement setups to accommodate.

I'd be more interested in either dedicated GPU sockets so we can put tower coolers on them, or having cpu + gpu + hbm chiplets all under one package and the motherboard reduced to a backplane with a rear panel.

Could be interesting if motherboards once again had embedded memory (like Optane or HBM) that acted either as RAM or extra cache, then had socketed CPUs and GPUs with a large mono-block-style cooling assembly. Or giant SoCs that is both a CPU and GPU (Mega APU in AMD's case) that can be slotted in. Upgrading is going to be penalized though, since more than likely, both mega-chiplets ("Full CPU Chiplet" + "Full GPU Chiplet") would probably be locked by both core count and texture units (IE: Rydeon 9950X3D + 9950XT, 16c + 128 CUs), and also cost a lot more since they're sold "in permanent pairs". It'd also be a bit awkward for NVIDIA unless they partnered with both Intel and AMD on a full scale x86 SoC (AMD or Intel for CPU paired with an NVIDIA GPU).

 

[Minus Infinity]

The server TDPs increasing is entirely expected though because they're just cramming more cores into each socket.

50% higher TDP with 33%-50% more cores per socket, more IPC per core, and better performance/Watt makes the TDP irrelevant when taken in isolation.

Well yeah, Turin dense will have 192 5c cores, 2x Genoa's 96 cores and so only seeing a 50% increase in TDP is actually quite impressive, showing how efficient these AMD "e" cores will be, but they will still be quite powerful as they are still based on regular Zen 5 cores. If TSMC can get 3nm yields up to speed (N3E, N3P, N3X) AMD has also developed Turin dense with 256 5c cores. The 192 cores would be on N4P(X).

 

[XDDDant]

It's always Gigabyte lol

 

[Bomby569]

Nothing to do with emissions right?

when you turn the light where do you think the power comes from, magic goblins?

 

[ymdhis]

Upgrading is going to be penalized though,

Which is why I'm surprised it hasn't happened yet. It would be Intels dream to segment up the market like that, they could offer higher memory models at a premium that makes Apple blush. 8GB to 16GB jump -> +200$.
On the up side, it could make PCs extremely small and we could have 1+TB/sec system ram bandwidth courtesy of HBM. An APU like that would completely destroy the GPU market for everything but the high-end parts.

 

[TheinsanegamerN]

when you turn the light where do you think the power comes from, magic goblins?

Yes, because electricity is good for the environment. the government said so. It's GREEN.

 

[david salsero]

Honestamente, cada uno de nosotros necesitaremos una planta de energía nuclear al ritmo al que vamos.
Y mientras los OEMs no están usando los mejores procesadores del mercado, el AMD Zen 4 Phoenix increíble mientras miles de consolas portátiles ya están en el mercado, que pasa con AMD, TSMC y los OEMs que no están sacando los famosos al mercado ? Ultrabook de 2.2 lb prometido con RDNA 3