• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Computex 2024 Keynote Address: The Big Daddy of AI Acceleration takes on AI PCs

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
46,891 (7.62/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
We're in Taipei to catch NVIDIA's Computex 2024 keynote address. AI would be decades behind where it is without NVIDIA's single-minded focus on accelerating it, and supporting the most fundamental research in AI, to bring it where it is now—in a position to drive a whole new industrial revolution of the kind the Internet did some 30 years ago. While NVIDIA's AI acceleration focuses on hard iron AI GPUs for the data-centers, the company hasn't lost sight of the hundreds of millions of gamers with a GeForce RTX GPU that's capable of accelerating AI faster than any NPU could by far. The company has set sights on the AI PC. It's already been running AI-based applications for gamers for over 5 years now, with DLSS, but has been consistently releasing AI-based apps, such as the most recent ChatRTX. The company is looking to make gamers' lives even more enjoyable with the magic of AI. Join us in this live blog as we unwrap NVIDIA's latest toys for gamers.



10:59 UTC: And we're live!

11:09UTC: The show is running a little late.

11:12 UTC: NVIDIA CEO Jensen Huang takes stage at the NTU Sports Center stadium.



11:13 UTC: NVIDIA's relationship with Taiwan is inseparable, all its partners are there.


11:14 UTC: AI marks a restart of the computer industry: Jensen.

11:15 UTC: Graphics, simulations, and AI, are at the soul of NVIDIA, brought to life in Omniverse.


11:17 UTC: AI is the next chapter in computing.


11:20 UTC: Two fundamental things happening: the processor performance scaling slowed, but computing needs rising exponentially. If data keeps scaling and performance doesn't, we'll experience computation inflation (happening now). CPU scaling is never coming back to past trajectories, so we should accelerate everything, and make computing smarter with AI.


11:22 UTC: NVIDIA's fusion of CPU and accelerators offer 100x speedups for just 3x power and 1.5x power.


11:24 UTC: NVIDIA's acceleration pays for itself when implemented at scale.

11:25 UTC: The more you buy, the more you save.


11:26 UTC: AI acceleration's biggest hurdle is rewriting software for the new hardware. This is why NVIDIA invests so much on software.


11:28 UTC: TSMC is implementing cuLITHO, accelerated chipdesign.

11:29 UTC: cuOPT is the best route-planning algorithm based on AI.

11:29 UTC: cuQUANTUM emulates quantum computers using CUDA and cloud computing.

11:30 UTC: cuDF is a data-processing accelerator that's widely used in the industry.

11:31 UTC: NVIDIA has 350+ such libraries. Now accelerated Google Colab.


11:32 UTC: CUDA has achieved a virtuous cycle.


11:33 UTC: NVIDIA cracked the chicken-egg problem of accelerated computing through its hundreds of domain libraries.

11:34 UTC: The emergence of AI was made possible by reducing the cost of computing.

11:37 UTC: Earth 2 digital-twin. One of the world's most ambitious computing project.


11:38 UTC: NVIDIA's first contact with AI was in 2012 with CUDA, with Alexnet. This is where NVIDIA decided to understand the foundation of deep-learning and device accelerators for it.


11:43 UTC: NVLink and Tensor cores are now 10 years old, and the Mellanox acquisition came together .

11:44 UTC: By 2017, transformers and GPTs came to being.


11:45 UTC: November 2022 saw the big moment: ChatGPT.


11:46 UTC: AI was all about perception and detection. GPT was the first generative AI.


11:49 UTC: We have arrived at a generative AI era. Ai tokens are a new commodity. A token is a fungible bit of generated information.


11:51 UTC: AI has changed every single layer of computing.


11:53 UTC: The future of content is generated, because it consumes less energy.

11:54 UTC: NIMS: NVIDIA inference microservices. This will be as significant as packaged software became after Microsoft democratized the PC.


11:55 UTC: The basic model of NIMS.


11:57 UTC: NIMS build AI driven applications.


12:00 UTC: Every company in the future will have a large collection of NIMS and assemble applications.


12:02 UTC: Digital humans are natural-looking, realistically rendered AI agents.


12:03 UTC: Digital humans' applications transcend gaming, NVIDIA Ace is a suite of digital human NIMS.


12:06 UTC: Every GeForce RTX GPU has tensor cores, and there are over 100 million of them.


12:08 UTC: The next generation of AI needs to be physically based: Jensen.


12:11 UTC: Blackwell implements the 2nd generation of transformer acceleration.


12:14 UTC: Blackwell AI GPU production board.


12:15 UTC: Blackwell makes computation zoom far ahead of Moore's Law.


12:16 UTC: With great processing power comes great power savings.


12:18 UTC: 17000 Joules/token for Pascal (3 tokens per word). 0.4 Joules/token with Blackwell.


12:20 UTC: MGX modular system.


12:20 UTC: NVLink makes 72-GPU Blackwell DGX possible, thanks to a new generation switching chip.


12:22 UTC: DGX is a whole big GPU. 72 GPUs held together with an NVLINK spine, operates at 10 TB/s.


12:25 UTC: Scaleout of DGX sees the benefits of Infiniband to Ethernet.


12:27 UTC: Spectrum-X 1600 is a smart switch for connecting millions of GPUs in the datacenters.


12:30 UTC: Jensen announces the next generation successor to Blackwell, say hello to Blackwell Ultra.


12:38 UTC: Say hello to Rubin, successor to Blackwell.


12:38 UTC: This is the NVIDIA Blackwell platform.


12:39 UTC: One day, everything that moves will be robotic.


12:42 UTC: Omniverse is a robot gym, where robots can learn how to interact with the world.


12:47 UTC: Various Taiwan-based ODM giants are building digital twins of their factories.


12:53 UTC: The next generation of real world robots will be humanoid robots.


13:01 UTC: Thanks all folks.

View at TechPowerUp Main Site
 
Joined
Sep 17, 2014
Messages
21,717 (6.00/day)
Location
The Washing Machine
Processor 7800X3D
Motherboard MSI MAG Mortar b650m wifi
Cooling Thermalright Peerless Assassin
Memory 32GB Corsair Vengeance 30CL6000
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Lexar NM790 4TB + Samsung 850 EVO 1TB + Samsung 980 1TB + Crucial BX100 250GB
Display(s) Gigabyte G34QWC (3440x1440)
Case Lian Li A3 mATX White
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W11 IoT Enterprise LTSC
Right.. so five years in now? They managed to remove some jaggies in gaming graphics, we can talk with it for whatever reason (just don't count on it being useful for anything), and RT still runs like shit.

Well done, Jensen. I wonder who's hallucinating more these days.

I'm sure you've got DLSS4 waiting around to obsoletify the Ada line up, can't wait.
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
16,886 (2.34/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
I'm sure you've got DLSS4 waiting around to obsoletify the Ada line up, can't wait.
This year is all about AI, don't you know?
 
Joined
Sep 17, 2014
Messages
21,717 (6.00/day)
Location
The Washing Machine
Processor 7800X3D
Motherboard MSI MAG Mortar b650m wifi
Cooling Thermalright Peerless Assassin
Memory 32GB Corsair Vengeance 30CL6000
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Lexar NM790 4TB + Samsung 850 EVO 1TB + Samsung 980 1TB + Crucial BX100 250GB
Display(s) Gigabyte G34QWC (3440x1440)
Case Lian Li A3 mATX White
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W11 IoT Enterprise LTSC
This year is all about AI, don't you know?
Ahahahahaha you don't even have to play games anymore.

Let's outsource all skill development to AI! YES!!! Where do I sign up! Where do I donate my kidney!!!ONE

Seriously... this bubble is going to burst so hard
 
Joined
Sep 6, 2013
Messages
3,190 (0.80/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 5500 / Ryzen 5 4600G / FX 6300 (12 years latter got to see how bad Bulldozer is)
Motherboard MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2) / Gigabyte GA-990XA-UD3
Cooling Νoctua U12S / Segotep T4 / Snowman M-T6
Memory 16GB G.Skill RIPJAWS 3600 / 16GB G.Skill Aegis 3200 / 16GB Kingston 2400MHz (DDR3)
Video Card(s) ASRock RX 6600 + GT 710 (PhysX)/ Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes/ NVMes, SATA Storage / NVMe boot(Clover), SATA storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) ---- 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
Hello, I have 80 billions more or less fortune. Let's call a TAXI to go to our destination!!!
 
Joined
Feb 11, 2009
Messages
5,482 (0.97/day)
System Name Cyberline
Processor Intel Core i7 2600k -> 12600k
Motherboard Asus P8P67 LE Rev 3.0 -> Gigabyte Z690 Auros Elite DDR4
Cooling Tuniq Tower 120 -> Custom Watercoolingloop
Memory Corsair (4x2) 8gb 1600mhz -> Crucial (8x2) 16gb 3600mhz
Video Card(s) AMD RX480 -> RX7800XT
Storage Samsung 750 Evo 250gb SSD + WD 1tb x 2 + WD 2tb -> 2tb MVMe SSD
Display(s) Philips 32inch LPF5605H (television) -> Dell S3220DGF
Case antec 600 -> Thermaltake Tenor HTCP case
Audio Device(s) Focusrite 2i4 (USB)
Power Supply Seasonic 620watt 80+ Platinum
Mouse Elecom EX-G
Keyboard Rapoo V700
Software Windows 10 Pro 64bit
hope that tornado looks better in motion because that screenshot....yikez
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
16,886 (2.34/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
hope that tornado looks better in motion because that screenshot....yikez
You mean to say that you're not watching the live stream?

 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
16,886 (2.34/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Honestly... I would only watch it if I was being paid to do so or if I wanted to induce sleep.
But he was telling stories about his childhood in Taiwan and how he was going to night markets back then and that night markets are very important to him because of that... Oh and there's some fruit lady that everyone should go and visit somewhere in Taiwan...
Note that I saw this on the Taiwanese news that my wife was watching, not on the live stream.
 
Joined
Dec 12, 2016
Messages
1,528 (0.55/day)
But he was telling stories about his childhood in Taiwan and how he was going to night markets back then and that night markets are very important to him because of that... Oh and there's some fruit lady that everyone should go and visit somewhere in Taiwan...
Note that I saw this on the Taiwanese news that my wife was watching, not on the live stream.
As happens with genetically hardwired ego driven humans, it will soon all be about him.
 
Joined
Nov 11, 2020
Messages
457 (0.33/day)
Location
Earth, Solar System, Milky Way Galaxy, Local Group
Processor AMD Ryzen 7 5700X
Motherboard Asus TUF Gaming B550M-Plus (Wi-Fi)
Cooling Thermalright PA120 SE; Arctic P12, F12
Memory Crucial BL8G32C16U4W.M8FE1 ×2
Video Card(s) Sapphire Nitro+ RX 6600 XT
Storage Kingston SKC3000D/2048G; Samsung MZVLB1T0HBLR-000L2; Seagate ST1000DM010-2EP102
Display(s) AOC 24G2W1G4
Case Sama MiCube
Audio Device(s) Somic G923
Power Supply EVGA 650 GD
Mouse Logitech G102
Keyboard Logitech K845 TTC Brown
Software Windows 10 Pro 1903, Dism++, CCleaner
Benchmark Scores CPU-Z 17.01.64: 3700X @ 4.6 GHz 1.3375 V scoring 557/6206; 760K @ 5 GHz 1.5 V scoring 292/964
Two-faced sack of *, hypocrite with infamous buniness partnerships
Who does he think he is? The world collapses or the Earth stops spinning without him?
 
Joined
Sep 1, 2020
Messages
2,139 (1.48/day)
Location
Bulgaria
Тази година е всичко за AI, не знаете ли?
I am assist to myself for free. Nvidia assistance cost money and is expensive.
 
Joined
Nov 8, 2008
Messages
66 (0.01/day)
Can't wait for my Switch 2, with DLSS4/RTX2. Will crush poor no DLSS/RTX consoles (not even DLSS1 on these).
 
Joined
Jan 29, 2024
Messages
79 (0.40/day)
I never ever thought that I would see this industry be quite willingly led by the hand to one standard or company. Allowing itself to become anti-competitive. It's also quite said that the level of competition is allowing this to happen. Does no one at Intel or AMD or anywhere else have the intelligence or gumption or technology to make a fight of it.
 
Joined
Feb 16, 2017
Messages
484 (0.18/day)
Something like: AI blah blah blah, Deep Learning Still Sucks, blah blah blah buy more save more? Going from FP16... to FP8... to... FP4, line goes up :laugh:!
 
Joined
Jun 2, 2014
Messages
473 (0.13/day)
Location
Midwest
System Name Core
Processor Intel 12700k @ 5.1/3.6 no HT
Motherboard ASRock z690 Steel Legend
Cooling Artic Cooling Freezer 420 AiO
Memory GSkill 64GB 3200 cas 14 b die
Video Card(s) Asus Nvidia RTX 4070 Super OC
Storage Optane 900p x2, SK Hynix p41 Pro
Display(s) ACER 250hz 1080p 25" IPS display x2
Case Phanteks p500a with all Noctua Chromax/Arctic fans
Audio Device(s) Focusrite interface, Presonus Studio Monitors and Subwoofer
Power Supply Seasonic 850w plat with cable mod cables
Mouse Glorious Model O
Keyboard Corsair mech k65
Software Win 11 Pro
Benchmark Scores 3dmark TimeSpy 20240-rtx 3090FE/12700k/Optane 3dmark TimeSpy 21862-rtx 4070Super/12700k/Optane
No RTX cards.... snooze. Ai, snooze.
 
Joined
Mar 16, 2017
Messages
1,942 (0.72/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
AI would be decades behind where it is without NVIDIA's single-minded focus on accelerating it...
Decades? I'm really trying to figure out that math.
 
Joined
Nov 27, 2023
Messages
1,729 (6.60/day)
System Name The Workhorse
Processor AMD Ryzen R9 5900X
Motherboard Gigabyte Aorus B550 Pro
Cooling CPU - Noctua NH-D15S Case - 3 Noctua NF-A14 PWM at the bottom, 2 Fractal Design 180mm at the front
Memory GSkill Trident Z 3200CL14
Video Card(s) NVidia GTX 1070 MSI QuickSilver
Storage Adata SX8200Pro
Display(s) LG 32GK850G
Case Fractal Design Torrent
Audio Device(s) FiiO E-10K DAC/Amp, Samson Meteorite USB Microphone
Power Supply Corsair RMx850 (2018)
Mouse Razer Viper (Original)
Keyboard Cooler Master QuickFire Rapid TKL keyboard (Cherry MX Black)
Software Windows 11 Pro (23H2)
This was somehow both more boring and more embarrassing than the previous NV presentation when they announced Blackwell, and that was 50% failed attempts by Jensen to be funny. I have no idea what he is going for in these, trying to be endearing?
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
16,886 (2.34/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
This was somehow both more boring and more embarrassing than the previous NV presentation when they announced Blackwell, and that was 50% failed attempts by Jensen to be funny. I have no idea what he is going for in these, trying to be endearing?
But the fruit stand lady comment!
 
Joined
Nov 27, 2023
Messages
1,729 (6.60/day)
System Name The Workhorse
Processor AMD Ryzen R9 5900X
Motherboard Gigabyte Aorus B550 Pro
Cooling CPU - Noctua NH-D15S Case - 3 Noctua NF-A14 PWM at the bottom, 2 Fractal Design 180mm at the front
Memory GSkill Trident Z 3200CL14
Video Card(s) NVidia GTX 1070 MSI QuickSilver
Storage Adata SX8200Pro
Display(s) LG 32GK850G
Case Fractal Design Torrent
Audio Device(s) FiiO E-10K DAC/Amp, Samson Meteorite USB Microphone
Power Supply Corsair RMx850 (2018)
Mouse Razer Viper (Original)
Keyboard Cooler Master QuickFire Rapid TKL keyboard (Cherry MX Black)
Software Windows 11 Pro (23H2)
But the fruit stand lady comment!
That’s true, my bad. I forgot that I was watching a grocery stand PR presentation and not some IT giant presenting their new cutting edge hardware.
Sure makes me want to go out and buy some peaches and strawberries to mix into my ice cream. ‘Tis the season, after all.
 
Joined
Feb 16, 2017
Messages
484 (0.18/day)
Right.. so five years in now? They managed to remove some jaggies in gaming graphics, we can talk with it for whatever reason (just don't count on it being useful for anything), and RT still runs like shit.

Well done, Jensen. I wonder who's hallucinating more these days.

I'm sure you've got DLSS4 waiting around to obsoletify the Ada line up, can't wait.
I thought DLSS was an additional value which made the cards stay relevant longer and kept that poor RT "performance" afloat :rolleyes:.
 
Joined
Mar 16, 2017
Messages
1,942 (0.72/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
I'd have to really love a corporation to listen their CEO talk for 2 hours, or at least have it be a part of my job requirements to have to listen. It must be how James Bond felt when he's being held captive by the self-promoting villain that's hell-bent on changing the world to fit his vision for society.
 

wolf

Better Than Native
Joined
May 7, 2007
Messages
8,043 (1.27/day)
System Name MightyX
Processor Ryzen 5800X3D
Motherboard Gigabyte X570 I Aorus Pro WiFi
Cooling Scythe Fuma 2
Memory 32GB DDR4 3600 CL16
Video Card(s) Asus TUF RTX3080 Deshrouded
Storage WD Black SN850X 2TB
Display(s) LG 42C2 4K OLED
Case Coolermaster NR200P
Audio Device(s) LG SN5Y / Focal Clear
Power Supply Corsair SF750 Platinum
Mouse Corsair Dark Core RBG Pro SE
Keyboard Glorious GMMK Compact w/pudding
VR HMD Meta Quest 3
Software case populated with Artic P12's
Benchmark Scores 4k120 OLED Gsync bliss
I didn't think this thread would be going well, but even by TPU standards this is low, nobody has even said leather jacket man or ngreedia unironically yet. Standards are slipping, maybe AI can help with that...
 
Top