Saturday, August 3rd 2024
Design Issues May Postpone Launch of NVIDIA's Advanced Blackwell AI Chips
NVIDIA may face delays in releasing its newest artificial intelligence chips due to design issues, according to anonymous sources involved in chip and server hardware production cited by The Information. The delay could extend to three months or more, potentially affecting major customers such as Meta, Google, and Microsoft. An unnamed Microsoft employee and another source claim that NVIDIA has already informed Microsoft about delays affecting the most advanced models in the Blackwell AI chip series. As a result, significant shipments are not expected until the first quarter of 2025.
When approached for comment, an NVIDIA spokesperson did not address communications with customers regarding the delay but stated that "production is on track to ramp" later this year. The Information reports that Microsoft, Google, Amazon Web Services, and Meta declined to comment on the matter, while Taiwan Semiconductor Manufacturing Company (TSMC) did not respond to inquiries.
Update 1:
Update 2:
SemiAnalysis's Dylan Patel reports in a message on Twitter (now known as X) that Blackwell supply will be considerably lower than anticipated in Q4 2024 and H1 2025. This shortage stems from TSMC's transition from CoWoS-S to CoWoS-L technology, required for NVIDIA's advanced Blackwell chips. Currently, TSMC's AP3 packaging facility is dedicated to CoWoS-S production, while initial CoWoS-L capacity is being installed in the AP6 facility.
Additionally, NVIDIA appears to be prioritizing production of GB200 NVL72 units over NVL36 units. The GB200 NVL36 configuration features 36 GPUs in a single rack with 18 individual GB200 compute nodes. In contrast, the NVL72 design incorporates 72 GPUs, either in a single rack with 18 double GB200 compute nodes or spread across two racks, each containing 18 single nodes.
Source:
Bloomberg
When approached for comment, an NVIDIA spokesperson did not address communications with customers regarding the delay but stated that "production is on track to ramp" later this year. The Information reports that Microsoft, Google, Amazon Web Services, and Meta declined to comment on the matter, while Taiwan Semiconductor Manufacturing Company (TSMC) did not respond to inquiries.
The production issue was discovered by manufacturer TSMC, and involves the processor die that connects two Blackwell GPUs on a GB200." — via Data Center DynamicsNVIDIA needs to redesign its chip, requiring a new TSMC production test before mass production. Rumors say they're considering a single-GPU version to expedite delivery. The delay leaves TSMC production lines idle temporarily.
Update 2:
SemiAnalysis's Dylan Patel reports in a message on Twitter (now known as X) that Blackwell supply will be considerably lower than anticipated in Q4 2024 and H1 2025. This shortage stems from TSMC's transition from CoWoS-S to CoWoS-L technology, required for NVIDIA's advanced Blackwell chips. Currently, TSMC's AP3 packaging facility is dedicated to CoWoS-S production, while initial CoWoS-L capacity is being installed in the AP6 facility.
105 Comments on Design Issues May Postpone Launch of NVIDIA's Advanced Blackwell AI Chips
So, let's go in conspiracy mode.
NVIDIA is hit with a US Department of Justice (DOJ) antitrust probe and just the next day we hear that "Design Issues May Postpone Launch of NVIDIA's Advanced Blackwell AI Chips" which of course gives some time for Nvidia's competitors to manage to get some customers who just can't keep waiting for months for the new chips?
Just vote with your wallet and don't buy.
I read somewhere that AI profits are in, decilne or not growing as expected, at least from companies who built AI tools etc. Only one who profits are HW manufacturers as nVidia and AMD. Could that also be a baloon like "everyone is junior developer" during 2020-2023 and than BOOM.
ifwhen it pops it'll cause a massive ripple for sure!Personally I don't mind a big GPU expense every four years, since the old one is still fine anyway and typically goes into a friends PC.
I'm not sure I would say there are zero price/performance improvements either, with current gen cards. Maybe if you're the type to buy an xx60/xx70/x7xx class card every generation, but the budget trap has always been a thing.
They have increased prices across the board for all their products, so they have already passed on the TSMC price hikes to customers & then some.