TheLostSwede
News Editor
- Joined
- Nov 11, 2004
- Messages
- 16,886 (2.34/day)
- Location
- Sweden
System Name | Overlord Mk MLI |
---|---|
Processor | AMD Ryzen 7 7800X3D |
Motherboard | Gigabyte X670E Aorus Master |
Cooling | Noctua NH-D15 SE with offsets |
Memory | 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68 |
Video Card(s) | Gainward GeForce RTX 4080 Phantom GS |
Storage | 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000 |
Display(s) | Acer XV272K LVbmiipruzx 4K@160Hz |
Case | Fractal Design Torrent Compact |
Audio Device(s) | Corsair Virtuoso SE |
Power Supply | be quiet! Pure Power 12 M 850 W |
Mouse | Logitech G502 Lightspeed |
Keyboard | Corsair K70 Max |
Software | Windows 10 Pro |
Benchmark Scores | https://valid.x86.fr/yfsd9w |
One key takeaway from the ongoing GTC is that Nvidia's AI empire has taken shape with strong partnerships from TSMC and other Taiwanese makers, such as those major server ODMs.
According to the news report from the technology-focused media DIGITIMES Asia, during his keynote at GTC on March 18, Huang underscored his company's partnerships with TSMC, as well as the supply chain in Taiwan. Speaking to the press later, Huang said Nvidia will have a very strong demand for CoWoS, the advanced packaging services TSMC offers.
He said the company is embarking on a new journey and will work closely with TSMC. He said he believes TSMC's capacity will continue growing.
A major reason for the shortages of Nvidia's AI chips is insufficient CoWoS support from TSMC. To serve Nvidia and other AI chip customers, TSMC is accelerating the expansion of CoWoS capacity and has just confirmed that it will build two advanced packaging fabs in Chiayi, southern Taiwan.
Nvidia's AI foundry service
Nvidia is taking inspiration from TSMC's business model. Huang admitted that the way Nvidia is working for its partners and the AI industry is like the way TSMC is making chips for Nvidia.
Nvidia is learning from TSMC's business model where the foundry only handles the manufacturing. Nvidia is working in the same as an AI foundry, according to Huang.
In November 2023, Nvidia introduced an AI foundry service to customize generative AI applications for enterprises and startups deploying on Microsoft Azure. Sources from Taiwan's server supply chain noted that Nvidia has been the biggest winner in the AI boom with its prowess from the CUDA and GPU platforms.
Taiwanese firms have played a key role in helping build Nvidia's AI empire. At the same time, the Taiwanese supply chain also has been a major beneficiary of Nvidia's rise to dominance.
Nvidia is expected to introduce upgrades to its H100 and GH100 in the second quarter of 2024 - the H200 and GH200. It has also unveiled the B100/B200 and GB200 on its new Blackwell platform at GTC.
The launch of new chip products will benefit not only their contract maker TSMC and equipment suppliers but also the server supply chain.
TSMC is sole maker of Nvidia AI GPUs
The sources said TSMC has been the sole maker of Nvidia's AI GPUs. Nvidia had Samsung make its RTX 30 series at the 8 nm node for the gaming market.
However, yield and performance issues at Samsung later prompted Nvidia to let TSMC make all of its next-generation RTX 40 series at the 4 nm node, the sources said. The upcoming RTX 50 series will still be made by TSMC using 3/4 nm processes, sources added.
The Blackwell GPUs will also be made by TSMC. Its next-generation AI GPUs to be introduced in 2025 are expected to embrace 3 nm processes, the sources said.
As switching chipmaking partners will incur very high costs, Nvidia will continue using TSMC's 2 nm, A14, and A10 services in the coming years, barring unexpected developments. Nvidia's server partners in Taiwan, including ASRockRack, Asustek, Foxconn, Gigabyte, Inventec, Pegatron, Quanta Cloud Technology (GCT), Wistron, and Wiwynn, will supply servers running on the Blackwell platform.
View at TechPowerUp Main Site | Source
According to the news report from the technology-focused media DIGITIMES Asia, during his keynote at GTC on March 18, Huang underscored his company's partnerships with TSMC, as well as the supply chain in Taiwan. Speaking to the press later, Huang said Nvidia will have a very strong demand for CoWoS, the advanced packaging services TSMC offers.
![](https://www.techpowerup.com/img/wlbxF2WzCvcUAJlr_thm.jpg)
He said the company is embarking on a new journey and will work closely with TSMC. He said he believes TSMC's capacity will continue growing.
A major reason for the shortages of Nvidia's AI chips is insufficient CoWoS support from TSMC. To serve Nvidia and other AI chip customers, TSMC is accelerating the expansion of CoWoS capacity and has just confirmed that it will build two advanced packaging fabs in Chiayi, southern Taiwan.
Nvidia's AI foundry service
Nvidia is taking inspiration from TSMC's business model. Huang admitted that the way Nvidia is working for its partners and the AI industry is like the way TSMC is making chips for Nvidia.
Nvidia is learning from TSMC's business model where the foundry only handles the manufacturing. Nvidia is working in the same as an AI foundry, according to Huang.
In November 2023, Nvidia introduced an AI foundry service to customize generative AI applications for enterprises and startups deploying on Microsoft Azure. Sources from Taiwan's server supply chain noted that Nvidia has been the biggest winner in the AI boom with its prowess from the CUDA and GPU platforms.
Taiwanese firms have played a key role in helping build Nvidia's AI empire. At the same time, the Taiwanese supply chain also has been a major beneficiary of Nvidia's rise to dominance.
Nvidia is expected to introduce upgrades to its H100 and GH100 in the second quarter of 2024 - the H200 and GH200. It has also unveiled the B100/B200 and GB200 on its new Blackwell platform at GTC.
The launch of new chip products will benefit not only their contract maker TSMC and equipment suppliers but also the server supply chain.
TSMC is sole maker of Nvidia AI GPUs
The sources said TSMC has been the sole maker of Nvidia's AI GPUs. Nvidia had Samsung make its RTX 30 series at the 8 nm node for the gaming market.
However, yield and performance issues at Samsung later prompted Nvidia to let TSMC make all of its next-generation RTX 40 series at the 4 nm node, the sources said. The upcoming RTX 50 series will still be made by TSMC using 3/4 nm processes, sources added.
The Blackwell GPUs will also be made by TSMC. Its next-generation AI GPUs to be introduced in 2025 are expected to embrace 3 nm processes, the sources said.
As switching chipmaking partners will incur very high costs, Nvidia will continue using TSMC's 2 nm, A14, and A10 services in the coming years, barring unexpected developments. Nvidia's server partners in Taiwan, including ASRockRack, Asustek, Foxconn, Gigabyte, Inventec, Pegatron, Quanta Cloud Technology (GCT), Wistron, and Wiwynn, will supply servers running on the Blackwell platform.
View at TechPowerUp Main Site | Source