• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Apple Reportedly Developing Custom Data Center Processors with Focus on AI Inference

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,582 (0.97/day)
Apple is reportedly working on creating in-house chips designed explicitly for its data centers. This news comes from a recent report by the Wall Street Journal, which highlights the company's efforts to enhance its data processing capabilities and reduce dependency on third parties to supply the infrastructure. In the internal project called Apple Chips in Data Center (ACDC), which started in 2018, Apple wanted to design data center processors to handle the massive user base and increase the company's service offerings. The most recent advancement in AI means that Apple will probably serve an LLM processed in Apple's data center. The chip will most likely focus on inference of AI models rather than training.

The AI chips are expected to play a crucial role in improving the efficiency and speed of Apple's data centers, which handle vast amounts of data generated by the company's various services and products. By developing these custom chips, Apple aims to optimize its data processing and storage capabilities, ultimately leading to better user experiences across its ecosystem. The move by Apple to develop AI-enhanced chips for data centers is seen as a strategic step in the company's efforts to stay ahead in the competitive tech landscape. Almost all major tech companies, famously called the big seven, have products that use AI in silicon and in software processing. However, Apple is the one that seemingly lacked that. Now, the company is integrating AI across the entire vertical, from the upcoming iPhone integration to M4 chips for Mac devices and ACDC chips for data centers.



View at TechPowerUp Main Site | Source
 
Joined
Nov 27, 2023
Messages
2,321 (6.41/day)
System Name The Workhorse
Processor AMD Ryzen R9 5900X
Motherboard Gigabyte Aorus B550 Pro
Cooling CPU - Noctua NH-D15S Case - 3 Noctua NF-A14 PWM at the bottom, 2 Fractal Design 180mm at the front
Memory GSkill Trident Z 3200CL14
Video Card(s) NVidia GTX 1070 MSI QuickSilver
Storage Adata SX8200Pro
Display(s) LG 32GK850G
Case Fractal Design Torrent (Solid)
Audio Device(s) FiiO E-10K DAC/Amp, Samson Meteorite USB Microphone
Power Supply Corsair RMx850 (2018)
Mouse Razer Viper (Original) on a X-Raypad Equate Plus V2
Keyboard Cooler Master QuickFire Rapid TKL keyboard (Cherry MX Black)
Software Windows 11 Pro (23H2)
I see that Apple is on the same dubious track as everyone else with the current AI bubble. You might even say it’s a highway to hell.
…I’ll see myself out.
 
Joined
Jun 6, 2021
Messages
684 (0.54/day)
System Name Red Devil
Processor AMD 5950x - Vermeer - B0
Motherboard Gigabyte X570 AORUS MASTER
Cooling NZXT Kraken Z73 360mm; 14 x Corsair QL 120mm RGB Case Fans
Memory G.SKill Trident Z Neo 32GB Kit DDR4-3600 CL14 (F4-3600C14Q-32GTZNB)
Video Card(s) PowerColor's Red Devil Radeon RX 6900 XT (Navi 21 XTX)
Storage 2 x Western Digital SN850 1GB; 1 x Samsung SSD 870EVO 2TB
Display(s) 3 x Asus VG27AQL1A; 1 x Sony A1E OLED 4K
Case Corsair Obsidian 1000D
Audio Device(s) Corsair SP2500; Steel Series Arctis Nova Pro Wireless (XBox Version)
Power Supply AX1500i Digital ATX - 1500w - 80 Plus Titanium
Mouse Razer Basilisk V3
Keyboard Razer Huntsman V2 - Optical Gaming Keyboard
Software Windows 11
This will be a very interesting space to watch over the next decade. Apple has proven themselves to be some damn good chip designers, but can they put a dent in the server sector?
 
Joined
Sep 1, 2009
Messages
1,232 (0.22/day)
Location
CO
System Name 4k
Processor AMD 5800x3D
Motherboard MSI MAG b550m Mortar Wifi
Cooling ARCTIC Liquid Freezer II 240
Memory 4x8Gb Crucial Ballistix 3600 CL16 bl8g36c16u4b.m8fe1
Video Card(s) Nvidia Reference 3080Ti
Storage ADATA XPG SX8200 Pro 1TB
Display(s) LG 48" C1
Case CORSAIR Carbide AIR 240 Micro-ATX
Audio Device(s) Asus Xonar STX
Power Supply EVGA SuperNOVA 650W
Software Microsoft Windows10 Pro x64
This will be a very interesting space to watch over the next decade. Apple has proven themselves to be some damn good chip designers, but can they put a dent in the server sector?
This is all for their own garden, they want to use their own Hardware/Software from the cloud down. Build that walled garden to the Heavens.
 
Joined
Jun 21, 2021
Messages
3,121 (2.49/day)
System Name daily driver Mac mini M2 Pro
Processor Apple proprietary M2 Pro (6 p-cores, 4 e-cores)
Motherboard Apple proprietary
Cooling Apple proprietary
Memory Apple proprietary 16GB LPDDR5 unified memory
Video Card(s) Apple proprietary M2 Pro (16-core GPU)
Storage Apple proprietary onboard 512GB SSD + various external HDDs
Display(s) LG UltraFine 27UL850W (4K@60Hz IPS)
Case Apple proprietary
Audio Device(s) Apple proprietary
Power Supply Apple proprietary
Mouse Apple Magic Trackpad 2
Keyboard Keychron K1 tenkeyless (Gateron Reds)
VR HMD Oculus Rift S (hosted on a different PC)
Software macOS Sonoma 14.7
Benchmark Scores (My Windows daily driver is a Beelink Mini S12 Pro. I'm not interested in benchmarking.)
This will be a very interesting space to watch over the next decade. Apple has proven themselves to be some damn good chip designers, but can they put a dent in the server sector?
They will not sell these chips. They will be used to give them an advantage over their competitors in a broad spectrum of services for their users.

In the same way Apple does not sell A-series nor M-series SoCs to other companies who wish to make products based on Apple Silicon. The chips are for Apple's own proprietary hardware designs.

This goes back to Apple's fundamental business philosophy: Apple views itself primarily as a software company whose software and services run best on their proprietary hardware. Even though they book most of their revenue through hardware sales, their main focus is software.

Once a person comprehends this, Apple's business actions are very logical.

Apple doesn't want to sell server chips. They want to run their own proprietary AI models on their own proprietary server hardware to benefit a large swath of Apple customers.

I speculated this exact scenario multiple times here before. My guess is that ever since Apple started spinning their own silicon, they put some chips in test servers to gauge performance and used their findings to help develop Apple Silicon into a scalable architecture.
 
Last edited:
Joined
Mar 29, 2014
Messages
478 (0.12/day)
They will not sell these chips. They will be used to give them an advantage over their competitors in a broad spectrum of services for their users.

In the same way Apple does not sell A-series nor M-series SoCs to other companies who wish to make products based on Apple Silicon. The chips are for Apple's own proprietary hardware designs.

This goes back to Apple's fundamental business philosophy: Apple views itself primarily as a software company whose software and services run best on their proprietary hardware. Even though they book most of their revenue through hardware sales, their main focus is software.

Once a person comprehends this, Apple's business actions are very logical.

Apple doesn't want to sell server chips. They want to run their own proprietary AI models on their own proprietary server hardware to benefit a large swath of Apple customers.

I speculated this exact scenario multiple times here before. My guess is that ever since Apple started spinning their own silicon, they put some chips in test servers to gauge performance and used their findings to help develop Apple Silicon into a scalable architecture.
Good points, didn't think of it that way. Haha... now I know why Jensen does what he does. He wants to be like Steve!
 
Joined
Jun 6, 2021
Messages
684 (0.54/day)
System Name Red Devil
Processor AMD 5950x - Vermeer - B0
Motherboard Gigabyte X570 AORUS MASTER
Cooling NZXT Kraken Z73 360mm; 14 x Corsair QL 120mm RGB Case Fans
Memory G.SKill Trident Z Neo 32GB Kit DDR4-3600 CL14 (F4-3600C14Q-32GTZNB)
Video Card(s) PowerColor's Red Devil Radeon RX 6900 XT (Navi 21 XTX)
Storage 2 x Western Digital SN850 1GB; 1 x Samsung SSD 870EVO 2TB
Display(s) 3 x Asus VG27AQL1A; 1 x Sony A1E OLED 4K
Case Corsair Obsidian 1000D
Audio Device(s) Corsair SP2500; Steel Series Arctis Nova Pro Wireless (XBox Version)
Power Supply AX1500i Digital ATX - 1500w - 80 Plus Titanium
Mouse Razer Basilisk V3
Keyboard Razer Huntsman V2 - Optical Gaming Keyboard
Software Windows 11
They will not sell these chips. They will be used to give them an advantage over their competitors in a broad spectrum of services for their users.

In the same way Apple does not sell A-series nor M-series SoCs to other companies who wish to make products based on Apple Silicon. The chips are for Apple's own proprietary hardware designs.

This goes back to Apple's fundamental business philosophy: Apple views itself primarily as a software company whose software and services run best on their proprietary hardware. Even though they book most of their revenue through hardware sales, their main focus is software.

Once a person comprehends this, Apple's business actions are very logical.

Apple doesn't want to sell server chips. They want to run their own proprietary AI models on their own proprietary server hardware to benefit a large swath of Apple customers.

I speculated this exact scenario multiple times here before. My guess is that ever since Apple started spinning their own silicon, they put some chips in test servers to gauge performance and used their findings to help develop Apple Silicon into a scalable architecture.
Interesting perspective and it makes sense.
 
Top