Sunday, June 2nd 2024

NVIDIA Computex 2024 Keynote Address: The Big Daddy of AI Acceleration takes on AI PCs

We're in Taipei to catch NVIDIA's Computex 2024 keynote address. AI would be decades behind where it is without NVIDIA's single-minded focus on accelerating it, and supporting the most fundamental research in AI, to bring it where it is now—in a position to drive a whole new industrial revolution of the kind the Internet did some 30 years ago. While NVIDIA's AI acceleration focuses on hard iron AI GPUs for the data-centers, the company hasn't lost sight of the hundreds of millions of gamers with a GeForce RTX GPU that's capable of accelerating AI faster than any NPU could by far. The company has set sights on the AI PC. It's already been running AI-based applications for gamers for over 5 years now, with DLSS, but has been consistently releasing AI-based apps, such as the most recent ChatRTX. The company is looking to make gamers' lives even more enjoyable with the magic of AI. Join us in this live blog as we unwrap NVIDIA's latest toys for gamers.

10:59 UTC: And we're live!

11:09UTC: The show is running a little late.

11:12 UTC: NVIDIA CEO Jensen Huang takes stage at the NTU Sports Center stadium.

11:13 UTC: NVIDIA's relationship with Taiwan is inseparable, all its partners are there.
11:14 UTC: AI marks a restart of the computer industry: Jensen.

11:15 UTC: Graphics, simulations, and AI, are at the soul of NVIDIA, brought to life in Omniverse.
11:17 UTC: AI is the next chapter in computing.
11:20 UTC: Two fundamental things happening: the processor performance scaling slowed, but computing needs rising exponentially. If data keeps scaling and performance doesn't, we'll experience computation inflation (happening now). CPU scaling is never coming back to past trajectories, so we should accelerate everything, and make computing smarter with AI.
11:22 UTC: NVIDIA's fusion of CPU and accelerators offer 100x speedups for just 3x power and 1.5x power.
11:24 UTC: NVIDIA's acceleration pays for itself when implemented at scale.

11:25 UTC: The more you buy, the more you save.
11:26 UTC: AI acceleration's biggest hurdle is rewriting software for the new hardware. This is why NVIDIA invests so much on software.
11:28 UTC: TSMC is implementing cuLITHO, accelerated chipdesign.

11:29 UTC: cuOPT is the best route-planning algorithm based on AI.

11:29 UTC: cuQUANTUM emulates quantum computers using CUDA and cloud computing.

11:30 UTC: cuDF is a data-processing accelerator that's widely used in the industry.

11:31 UTC: NVIDIA has 350+ such libraries. Now accelerated Google Colab.
11:32 UTC: CUDA has achieved a virtuous cycle.
11:33 UTC: NVIDIA cracked the chicken-egg problem of accelerated computing through its hundreds of domain libraries.

11:34 UTC: The emergence of AI was made possible by reducing the cost of computing.

11:37 UTC: Earth 2 digital-twin. One of the world's most ambitious computing project.
11:38 UTC: NVIDIA's first contact with AI was in 2012 with CUDA, with Alexnet. This is where NVIDIA decided to understand the foundation of deep-learning and device accelerators for it.
11:43 UTC: NVLink and Tensor cores are now 10 years old, and the Mellanox acquisition came together .

11:44 UTC: By 2017, transformers and GPTs came to being.
11:45 UTC: November 2022 saw the big moment: ChatGPT.
11:46 UTC: AI was all about perception and detection. GPT was the first generative AI.

11:49 UTC: We have arrived at a generative AI era. Ai tokens are a new commodity. A token is a fungible bit of generated information.
11:51 UTC: AI has changed every single layer of computing.
11:53 UTC: The future of content is generated, because it consumes less energy.

11:54 UTC: NIMS: NVIDIA inference microservices. This will be as significant as packaged software became after Microsoft democratized the PC.
11:55 UTC: The basic model of NIMS.
11:57 UTC: NIMS build AI driven applications.
12:00 UTC: Every company in the future will have a large collection of NIMS and assemble applications.
12:02 UTC: Digital humans are natural-looking, realistically rendered AI agents.
12:03 UTC: Digital humans' applications transcend gaming, NVIDIA Ace is a suite of digital human NIMS.
12:06 UTC: Every GeForce RTX GPU has tensor cores, and there are over 100 million of them.
12:08 UTC: The next generation of AI needs to be physically based: Jensen.
12:11 UTC: Blackwell implements the 2nd generation of transformer acceleration.
12:14 UTC: Blackwell AI GPU production board.
12:15 UTC: Blackwell makes computation zoom far ahead of Moore's Law.
12:16 UTC: With great processing power comes great power savings.
12:18 UTC: 17000 Joules/token for Pascal (3 tokens per word). 0.4 Joules/token with Blackwell.
12:20 UTC: MGX modular system.
12:20 UTC: NVLink makes 72-GPU Blackwell DGX possible, thanks to a new generation switching chip.
12:22 UTC: DGX is a whole big GPU. 72 GPUs held together with an NVLINK spine, operates at 10 TB/s.
12:25 UTC: Scaleout of DGX sees the benefits of Infiniband to Ethernet.
12:27 UTC: Spectrum-X 1600 is a smart switch for connecting millions of GPUs in the datacenters.
12:30 UTC: Jensen announces the next generation successor to Blackwell, say hello to Blackwell Ultra.
12:38 UTC: Say hello to Rubin, successor to Blackwell.
12:38 UTC: This is the NVIDIA Blackwell platform.
12:39 UTC: One day, everything that moves will be robotic.
12:42 UTC: Omniverse is a robot gym, where robots can learn how to interact with the world.
12:47 UTC: Various Taiwan-based ODM giants are building digital twins of their factories.
12:53 UTC: The next generation of real world robots will be humanoid robots.
13:01 UTC: Thanks all folks.
Add your own comment

34 Comments on NVIDIA Computex 2024 Keynote Address: The Big Daddy of AI Acceleration takes on AI PCs

#1
Vayra86
Right.. so five years in now? They managed to remove some jaggies in gaming graphics, we can talk with it for whatever reason (just don't count on it being useful for anything), and RT still runs like shit.

Well done, Jensen. I wonder who's hallucinating more these days.

I'm sure you've got DLSS4 waiting around to obsoletify the Ada line up, can't wait.
Posted on Reply
#4
john_
Hello, I have 80 billions more or less fortune. Let's call a TAXI to go to our destination!!!
Posted on Reply
#5
Denver
Most boring presentation of all time...
Posted on Reply
#6
ZoneDymo
hope that tornado looks better in motion because that screenshot....yikez
Posted on Reply
#7
TheLostSwede
News Editor
ZoneDymohope that tornado looks better in motion because that screenshot....yikez
You mean to say that you're not watching the live stream?

Posted on Reply
#8
Denver
TheLostSwedeYou mean to say that you're not watching the live stream?

Honestly... I would only watch it if I was being paid to do so or if I wanted to induce sleep.
Posted on Reply
#9
Gucky
DenverMost boring presentation of all time...
What are you? A gamer? :D
Posted on Reply
#10
TheLostSwede
News Editor
DenverHonestly... I would only watch it if I was being paid to do so or if I wanted to induce sleep.
But he was telling stories about his childhood in Taiwan and how he was going to night markets back then and that night markets are very important to him because of that... Oh and there's some fruit lady that everyone should go and visit somewhere in Taiwan...
Note that I saw this on the Taiwanese news that my wife was watching, not on the live stream.
Posted on Reply
#11
Daven
TheLostSwedeBut he was telling stories about his childhood in Taiwan and how he was going to night markets back then and that night markets are very important to him because of that... Oh and there's some fruit lady that everyone should go and visit somewhere in Taiwan...
Note that I saw this on the Taiwanese news that my wife was watching, not on the live stream.
As happens with genetically hardwired ego driven humans, it will soon all be about him.
Posted on Reply
#12
Sabotaged_Enigma
Two-faced sack of *, hypocrite with infamous buniness partnerships
Who does he think he is? The world collapses or the Earth stops spinning without him?
Posted on Reply
#14
ilyon
Can't wait for my Switch 2, with DLSS4/RTX2. Will crush poor no DLSS/RTX consoles (not even DLSS1 on these).
Posted on Reply
#15
RGAFL
I never ever thought that I would see this industry be quite willingly led by the hand to one standard or company. Allowing itself to become anti-competitive. It's also quite said that the level of competition is allowing this to happen. Does no one at Intel or AMD or anywhere else have the intelligence or gumption or technology to make a fight of it.
Posted on Reply
#16
Prince Valiant
Something like: AI blah blah blah, Deep Learning Still Sucks, blah blah blah buy more save more? Going from FP16... to FP8... to... FP4, line goes up :laugh:!
Posted on Reply
#18
Darmok N Jalad
btarunrAI would be decades behind where it is without NVIDIA's single-minded focus on accelerating it...
Decades? I'm really trying to figure out that math.
Posted on Reply
#19
Onasi
This was somehow both more boring and more embarrassing than the previous NV presentation when they announced Blackwell, and that was 50% failed attempts by Jensen to be funny. I have no idea what he is going for in these, trying to be endearing?
Posted on Reply
#20
TheLostSwede
News Editor
OnasiThis was somehow both more boring and more embarrassing than the previous NV presentation when they announced Blackwell, and that was 50% failed attempts by Jensen to be funny. I have no idea what he is going for in these, trying to be endearing?
But the fruit stand lady comment!
Posted on Reply
#21
Onasi
TheLostSwedeBut the fruit stand lady comment!
That’s true, my bad. I forgot that I was watching a grocery stand PR presentation and not some IT giant presenting their new cutting edge hardware.
Sure makes me want to go out and buy some peaches and strawberries to mix into my ice cream. ‘Tis the season, after all.
Posted on Reply
#22
Prince Valiant
Vayra86Right.. so five years in now? They managed to remove some jaggies in gaming graphics, we can talk with it for whatever reason (just don't count on it being useful for anything), and RT still runs like shit.

Well done, Jensen. I wonder who's hallucinating more these days.

I'm sure you've got DLSS4 waiting around to obsoletify the Ada line up, can't wait.
I thought DLSS was an additional value which made the cards stay relevant longer and kept that poor RT "performance" afloat :rolleyes:.
Posted on Reply
#23
Darmok N Jalad
I'd have to really love a corporation to listen their CEO talk for 2 hours, or at least have it be a part of my job requirements to have to listen. It must be how James Bond felt when he's being held captive by the self-promoting villain that's hell-bent on changing the world to fit his vision for society.
Posted on Reply
#24
wolf
Better Than Native
I didn't think this thread would be going well, but even by TPU standards this is low, nobody has even said leather jacket man or ngreedia unironically yet. Standards are slipping, maybe AI can help with that...
Posted on Reply
#25
Ferrum Master
wolfI didn't think this thread would be going well, but even by TPU standards this is low, nobody has even said leather jacket man or ngreedia unironically yet. Standards are slipping, maybe AI can help with that...
What's the problem with free speech?

Meanwhile Boeing can't even launch a rocket due to shit code... all this crap is so far fetched, it is disconnected from reality, some places don't even utilize toilet paper yet...
Posted on Reply
Add your own comment
Aug 14th, 2024 11:37 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts