• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Advertises "Premium AI PC" Mocking the Compute Capability of Regular AI PCs

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,260 (0.92/day)
According to the report from BenchLife, NVIDIA has started the marketing campaign push for "Premium AI PC," squarely aimed at the industry's latest trend pushed by Intel, AMD, and Qualcomm for an "AI PC" system, which features a dedicated NPU for processing smaller models locally. NVIDIA's approach comes from a different point of view: every PC with an RTX GPU is a "Premium AI PC," which holds a lot of truth. Generally, GPUs (regardless of the manufacturer) hold more computing potential than the CPU and NPU combined. With NVIDIA's push to include Tensor cores in its GPUs, the company is preparing for next-generation software from vendors and OS providers that will harness the power of these powerful silicon pieces and embed more functionality in the PC.

At the Computex event in Taiwan, there should be more details about Premium AI PCs and general AI PCs. In its marketing materials, NVIDIA compares AI PCs to its Premium AI PCs, which have enhanced capabilities across various applications like image/video editing and upscaling, productivity, gaming, and developer applications. Another relevant selling point is the user base for these Premium AI PCs, which NVIDIA touts to be 100 million users. Those PCs support over 500 AI applications out of the box, highlighting the importance of proper software support. NVIDIA's systems are usually more powerful, with GeForce RTX GPUs reaching anywhere from 100-1300+ TOPS, compared to 40 TOPS of AI PCs. How other AI PC makers plan to fight in the AI PC era remains to be seen, but there is a high chance that this will be the spotlight of the upcoming Computex show.



View at TechPowerUp Main Site | Source
 
Joined
Sep 26, 2022
Messages
1,604 (2.67/day)
Location
Brazil
System Name G-Station 1.17 FINAL
Processor AMD Ryzen 7 5700X3D
Motherboard Gigabyte X470 Aorus Gaming 7 Wi-Fi
Cooling DeepCool AK620 Digital
Memory Asgard Bragi DDR4-3600CL14 2x16GB
Video Card(s) Sapphire Pulse RX 7900 XTX
Storage 240GB Samsung 840 Evo, 1TB Asgard AN2, 2TB Hiksemi FUTURE-LITE, 320GB+1TB 7200RPM HDD
Display(s) Samsung 34" Odyssey OLED G8
Case Thermaltake Level 20 MT
Audio Device(s) Astro A40 TR + MixAmp
Power Supply Cougar GEX X2 1000W
Mouse Razer Viper Ultimate
Keyboard Razer Huntsman Elite (Red)
Software Windows 11 Pro
NVIDIA putting the AI in "The way it's meant to be pAId".
 
Joined
Sep 17, 2014
Messages
21,075 (5.97/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
Nvidia seems so hellbent on telling us that we need this, I'm still trying to figure out why I need this though.

Its really getting awfully close to that shady salesman selling you real antique coins or something.
 
Joined
Jan 8, 2017
Messages
9,062 (3.37/day)
System Name Good enough
Processor AMD Ryzen R9 7900 - Alphacool Eisblock XPX Aurora Edge
Motherboard ASRock B650 Pro RS
Cooling 2x 360mm NexXxoS ST30 X-Flow, 1x 360mm NexXxoS ST30, 1x 240mm NexXxoS ST30
Memory 32GB - FURY Beast RGB 5600 Mhz
Video Card(s) Sapphire RX 7900 XT - Alphacool Eisblock Aurora
Storage 1x Kingston KC3000 1TB 1x Kingston A2000 1TB, 1x Samsung 850 EVO 250GB , 1x Samsung 860 EVO 500GB
Display(s) LG UltraGear 32GN650-B + 4K Samsung TV
Case Phanteks NV7
Power Supply GPS-750C
Oh you know things are rough when you have to shame your consumers into caring about your features.

Conventional GPUs were easy to sell, RT capable GPUs less so. ML capable GPUs, now that's a really tough sell because hardly anyone cares, if someone wants to use something that needs ML they just use web based resources.
 
Joined
Dec 16, 2017
Messages
2,734 (1.17/day)
Location
Buenos Aires, Argentina
System Name System V
Processor AMD Ryzen 5 3600
Motherboard Asus Prime X570-P
Cooling Cooler Master Hyper 212 // a bunch of 120 mm Xigmatek 1500 RPM fans (2 ins, 3 outs)
Memory 2x8GB Ballistix Sport LT 3200 MHz (BLS8G4D32AESCK.M8FE) (CL16-18-18-36)
Video Card(s) Gigabyte AORUS Radeon RX 580 8 GB
Storage SHFS37A240G / DT01ACA200 / WD20EZRX / ST10000VN0008 / SA400S37960G / SNV21000G / NM620 2TB
Display(s) LG 22MP55 IPS Display
Case NZXT Source 210
Audio Device(s) Logitech G430 Headset
Power Supply Corsair CX650M
Mouse Microsoft Trackball Optical 1.0
Keyboard HP Vectra VE keyboard (Part # D4950-63004)
Software Whatever build of Windows 11 is being served in Dev channel at the time.
Benchmark Scores Corona 1.3: 3120620 r/s Cinebench R20: 3355 FireStrike: 12490 TimeSpy: 4624
Nvidia seems so hellbent on telling us that we need this, I'm still trying to figure out why I need this though.

Its really getting awfully close to that shady salesman selling you real antique coins or something.
I still haven't heard of anything AI-related that I can run locally in my computer that meets the following criteria:
  • Needs to be fast (i.e., I don't have to wait for whatever result it is for longer than 10 seconds)
  • Doesn't require an obscene amount of computing power or purchasing new hardware
  • Is actually useful
  • Doesn't require touching a command prompt or doing any kind of configuration the regular user wouldn't know how to do.
  • EDIT: Doesn't require to be a privacy nightmare or have ethical concerns regarding whether the model was built with properly licensed data instead of stolen data
 
Last edited:
Joined
Mar 16, 2017
Messages
1,720 (0.66/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
At least their AI chat security bugs can operate at a premium level speeds.
 
Joined
Feb 23, 2012
Messages
39 (0.01/day)
They are salty because they will be excluded from every portable AI crazyness.

Every devices that is sub 50W will not use an nvidia GPU and will rely on integrated NPU (which is good, because that way it's less of a power hog).


They could be a part of the arm on pc race and try to compete with apple and qualcomm. But it seems they look more towards the insane margin of datacenter and they will only use salt for consumer.
 
Joined
Nov 4, 2005
Messages
11,736 (1.73/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
It's another PhysX with real PhysX, just like their real pre cooked stuff before when GPUs weren't powerful enough to run real time plus rendering.

Actually it's the turd in the punch bowl, getting PC nerds to pay for them to create more AI business they can ignore gaming for. Just to get dumb results from inadequate datasets and having the privilege of paying for beta testing it.
 
Joined
Aug 23, 2013
Messages
554 (0.14/day)
I can't wait till Jensen gets up and tells us how AI-powered Nvidia VLSS Pro (Voice Layer Sound System) with VLI (Voice Language Interface) is the secret sauce to making NPC's talk to us for realsies and shows off incredible conversations between players and NPC's. Then everyone floods Youtube with videos of them talking about dingdongs and hoho's and making the NPC's glitch. The scripting language can be called VUDA. Bring together all the buzzwords into a salad so chock full of hyperbole and exaggeration we'll all spend thousands of dollars for 80 series cards to have weird conversations with NPC's and pine for the days of actual writers writing dialogue again.

But by then writers will be dead and AI-written articles will tell us they were never real and were a myth. "Humans cannot write stories," the articles will say. "Preposterous."
 
Joined
Dec 25, 2020
Messages
4,827 (3.89/day)
Location
São Paulo, Brazil
System Name Project Kairi Mk. IV "Eternal Thunder"
Processor 13th Gen Intel Core i9-13900KS Special Edition
Motherboard MSI MEG Z690 ACE (MS-7D27) BIOS 1G
Cooling Noctua NH-D15S + NF-F12 industrialPPC-3000 w/ Thermalright BCF and NT-H1
Memory G.SKILL Trident Z5 RGB 32GB DDR5-6800 F5-6800J3445G16GX2-TZ5RK @ 6400 MT/s 30-38-38-38-70-2
Video Card(s) ASUS ROG Strix GeForce RTX™ 4080 16GB GDDR6X White OC Edition
Storage 1x WD Black SN750 500 GB NVMe + 4x WD VelociRaptor HLFS 300 GB HDDs
Display(s) 55-inch LG G3 OLED
Case Cooler Master MasterFrame 700
Audio Device(s) EVGA Nu Audio (classic) + Sony MDR-V7 cans
Power Supply EVGA 1300 G2 1.3kW 80+ Gold
Mouse Razer DeathAdder Essential Mercury White
Keyboard Redragon Shiva Lunar White
Software Windows 10 Enterprise 22H2
Benchmark Scores "Speed isn't life, it just makes it go faster."
Oh you know things are rough when you have to shame your consumers into caring about your features.

Conventional GPUs were easy to sell, RT capable GPUs less so. ML capable GPUs, now that's a really tough sell because hardly anyone cares, if someone wants to use something that needs ML they just use web based resources.

Well, it just so happens that practically every modern GPU is ML capable. It all boils down to "AI is the new kool thing and if you aren't using it, you're lame".

Guess i'm lame, then

They are salty because they will be excluded from every portable AI crazyness.

Quite contrary, since NVIDIA retains the most profitable slice of the AI market with a very comfortable lead and any significantly powerful mobile system will sport their hardware anyway. It'll actually be a combination of Intel or AMD's NPUs + a GeForce "AI GPU", which is somewhat the point.

$NVDA goes BRR.

1714686836800.png
 
Joined
Jun 1, 2010
Messages
248 (0.05/day)
Nvidia seems so hellbent on telling us that we need this, I'm still trying to figure out why I need this though.

Its really getting awfully close to that shady salesman selling you real antique coins or something.
This mockery isn't new at all. Just like everyone was ought to get PhysX, which suddenly became CUDA dependant. And then Tesselation (yeah, yeah, it was AMD's train first), Hairworks... and eventually RTRT, just as the sole reason to use and push the Tensor cores.
This is an old game. People been fooled and tricked for a while, but somehow completely missed the fact of it. Instead began to praise it as "holy grail" that somehow already existed and been in use for about a half century already. Not even the fact, that nobody is actually able to use it with the capabilities current consumer devices, but, that's another story. And now the gulible masses being baited by the fancy AI stuff, but no one really can give a reasonable answer why they need it. Even worse, most people not even asking themselves, if it's something they really need and want. Most just consume like it is the way it should be.

The answer is: about a hundred years ago, the electricity was introduced. Hardly anyone, including industrial big capital owners, as much as ordinary people, could imagine any use of it, outside of some light bulbs hanging out of the celling. And then the entire continents became dependant on it, like there's no tomorow. And the most horrible thing is, that most of the electric power, being criminally misused for the things that not only are not needed, but even should not exist at all. So many stuff that people could easilly get along without, but get only out of laziness and curiocity. People themselves got into this cozy cell, because being weak prey is easy and beneficial.

And Nvidia is the first company to know this, and exploit this dependancy and weakness at maximum. They've catched this whole "wave" and introduce even more useless ideas, to employ. So far, people greet them with huge praise. This is rampage.

I can't wait till Jensen gets up and tells us how AI-powered Nvidia VLSS Pro (Voice Layer Sound System) with VLI (Voice Language Interface) is the secret sauce to making NPC's talk to us for realsies and shows off incredible conversations between players and NPC's. Then everyone floods Youtube with videos of them talking about dingdongs and hoho's and making the NPC's glitch. The scripting language can be called VUDA. Bring together all the buzzwords into a salad so chock full of hyperbole and exaggeration we'll all spend thousands of dollars for 80 series cards to have weird conversations with NPC's and pine for the days of actual writers writing dialogue again.

But by then writers will be dead and AI-written articles will tell us they were never real and were a myth. "Humans cannot write stories," the articles will say. "Preposterous."

Some very popular games feel like their scripts, dialogues and even entire plots were written by machine. Even despite they've been made almost a decade ago. Some writers, are just so awful for their positions, that it's scary that AI picks their "style" as an example and put it as the basis for own "creativity".

It's all worse now. The Ministry speakers being replaced with an AI. So nobody would end up questioning the ones in power.
 
Last edited:
Joined
Nov 21, 2010
Messages
2,236 (0.45/day)
Location
Right where I want to be
System Name Miami
Processor Ryzen 3800X
Motherboard Asus Crosshair VII Formula
Cooling Ek Velocity/ 2x 280mm Radiators/ Alphacool fullcover
Memory F4-3600C16Q-32GTZNC
Video Card(s) XFX 6900 XT Speedster 0
Storage 1TB WD M.2 SSD/ 2TB WD SN750/ 4TB WD Black HDD
Display(s) DELL AW3420DW / HP ZR24w
Case Lian Li O11 Dynamic XL
Audio Device(s) EVGA Nu Audio
Power Supply Seasonic Prime Gold 1000W+750W
Mouse Corsair Scimitar/Glorious Model O-
Keyboard Corsair K95 Platinum
Software Windows 10 Pro
The usual Nvidia grift. Rush out to get ahead of everyone and establish a foothold. Make a push to be industry leader in area. Once established, wall off, and charge out the nose for access while attempting to corner market. Throws tantrum, goes on a mocking campaign when the industry gravitates away from them towards a more open or royalty free standard.
 
Joined
Feb 10, 2023
Messages
161 (0.35/day)
Location
Lake Superior
Well they're right. If you buying a PC for inference then they're better at it. And it can do training too.

Are they not supposed to point that out? Why does it make some people here mad. I'm not gonna buy a PC based on any of this but maybe someone else will.
 
Joined
Sep 26, 2012
Messages
866 (0.20/day)
Location
Australia
System Name ATHENA
Processor AMD 7950X
Motherboard ASUS Crosshair X670E Extreme
Cooling ASUS ROG Ryujin III 360, 13 x Lian Li P28
Memory 2x32GB Trident Z RGB 6000Mhz CL30
Video Card(s) ASUS 4090 STRIX
Storage 3 x Kingston Fury 4TB, 4 x Samsung 870 QVO
Display(s) Acer X38S, Wacom Cintiq Pro 15
Case Lian Li O11 Dynamic EVO
Audio Device(s) Topping DX9, Fluid FPX7 Fader Pro, Beyerdynamic T1 G2, Beyerdynamic MMX300
Power Supply Seasonic PRIME TX-1600
Mouse Xtrfy MZ1 - Zy' Rail, Logitech MX Vertical, Logitech MX Master 3
Keyboard Logitech G915 TKL
VR HMD Oculus Quest 2
Software Windows 11 + Universal Blue
Nvidia acting like a petulant child whilst it refuses to address that much of its AI products just consume way too much power to be left on all the time.
 
Joined
May 7, 2020
Messages
45 (0.03/day)
Well they're right. If you buying a PC for inference then they're better at it. And it can do training too.

Are they not supposed to point that out? Why does it make some people here mad. I'm not gonna buy a PC based on any of this but maybe someone else will.
Problem is that a "premium AI PC" could have no NPU and not be compatible with "AI PC" software.
IMHO the AI PC thing is BS, putting an NPU next to an iGPU that already has AI cores makes no sense. NPUs, again in my opinion, will consume more power than a discrete GPU, because people will eventually use it (willingly or unwillingly, pressing the AI key by mistake), versus not having an NPU and therefore not trying it.
 
Joined
May 3, 2018
Messages
2,355 (1.07/day)
Hey guys we don't make an NPU so all of them are shit and our uber expensive power hungry GPU's are the way to go, even for laptops where battery life is important. Just keep it plugged in you'll be fine.

Seriously Nvidia will eventually be in a pickle as it doesn't make cpu for laptops or desktop and in laptops it will eventually be a distant memory for dGPU's as apu's just keep getting better and better and will come with very powerful NPUs Lunar Lake will offer 100TOPS total performance and Panther Lake will double that and Strix's successor will no doubt do the same.

Nvidia can't just make a dNPU so how will it compete long term. Or it just won't give a shit as it earns hundreds of billion from datacentre and commercial AI. Will they try and get into desktop/laptop cpu/apu based on ARM?
 
Joined
Dec 25, 2020
Messages
4,827 (3.89/day)
Location
São Paulo, Brazil
System Name Project Kairi Mk. IV "Eternal Thunder"
Processor 13th Gen Intel Core i9-13900KS Special Edition
Motherboard MSI MEG Z690 ACE (MS-7D27) BIOS 1G
Cooling Noctua NH-D15S + NF-F12 industrialPPC-3000 w/ Thermalright BCF and NT-H1
Memory G.SKILL Trident Z5 RGB 32GB DDR5-6800 F5-6800J3445G16GX2-TZ5RK @ 6400 MT/s 30-38-38-38-70-2
Video Card(s) ASUS ROG Strix GeForce RTX™ 4080 16GB GDDR6X White OC Edition
Storage 1x WD Black SN750 500 GB NVMe + 4x WD VelociRaptor HLFS 300 GB HDDs
Display(s) 55-inch LG G3 OLED
Case Cooler Master MasterFrame 700
Audio Device(s) EVGA Nu Audio (classic) + Sony MDR-V7 cans
Power Supply EVGA 1300 G2 1.3kW 80+ Gold
Mouse Razer DeathAdder Essential Mercury White
Keyboard Redragon Shiva Lunar White
Software Windows 10 Enterprise 22H2
Benchmark Scores "Speed isn't life, it just makes it go faster."
The usual Nvidia grift. Rush out to get ahead of everyone and establish a foothold. Make a push to be industry leader in area. Once established, wall off, and charge out the nose for access while attempting to corner market. Throws tantrum, goes on a mocking campaign when the industry gravitates away from them towards a more open or royalty free standard.

Unfortunately for us, it would seem they're doing it right. Going by the latest earnings report, things are going really bad over at AMD's graphics division (not that it should be unexpected, given how things have been going). Last quarter brought only ~$900M in while the GPU market's booming this much. Imagine if it wasn't.
 
Joined
Aug 12, 2019
Messages
1,784 (1.02/day)
Location
LV-426
System Name Custom
Processor i9 9900k
Motherboard Gigabyte Z390 arous master
Cooling corsair h150i
Memory 4x8 3200mhz corsair
Video Card(s) Galax RTX 3090 EX Gamer White OC
Storage 500gb Samsung 970 Evo PLus
Display(s) MSi MAG341CQ
Case Lian Li Pc-011 Dynamic
Audio Device(s) Arctis Pro Wireless
Power Supply 850w Seasonic Focus Platinum
Mouse Logitech G403
Keyboard Logitech G110
but nvidia didnt put down the premium "price"
 
Joined
Dec 16, 2021
Messages
126 (0.14/day)
Location
Denmark
Processor AMD Ryzen 7 3800X
Motherboard ASUS Prime X470-Pro
Cooling bequiet! Dark Rock Slim
Memory 64 GB ECC DDR4 2666 MHz (Samsung M391A2K43BB1-CTD)
Video Card(s) eVGA GTX 1080 SC Gaming, 8 GB
Storage 1 TB Samsung 970 EVO Plus, 1 TB Samsung 850 EVO, 4 TB Lexar NM790, 12 TB WD HDDs
Display(s) Acer Predator XB271HU
Case Corsair Obsidian 550D
Audio Device(s) Creative X-Fi Fatal1ty
Power Supply Seasonic X-Series 560W
Mouse Logitech G502
Keyboard Glorious GMMK
Personally, I'm mocking every AI PC.
 
Joined
Sep 2, 2022
Messages
88 (0.14/day)
Location
Italy
Processor Intel Core i7-5960X
Motherboard MSI X99S SLI PLUS
Memory Corsair Vengeance LPX DDR4 4x8GB
Video Card(s) Gigabyte GTX 1070 TI 8GB
Storage Sandisk Ultra II 240GB + HDD
Display(s) Benq GL2480 24" 1080p 75 Hz
Power Supply Seasonic M12II 520W
Mouse Logitech G400
Software Windows 10 LTSC
In its marketing materials, NVIDIA compares AI PCs to its Premium AI PCs, which have enhanced capabilities across various applications like image/video editing and upscaling, productivity, gaming, and developer applications. Another relevant selling point is the user base for these Premium AI PCs, which NVIDIA touts to be 100 million users. Those PCs support over 500 AI applications out of the box, highlighting the importance of proper software support.
I'd like to see the list of these 500 AI applications. :rolleyes:
 
Joined
Apr 19, 2018
Messages
1,052 (0.47/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
You could buy 2 or 3 AI PC's for how much nGreedia charges for just a 4090.
 
Joined
Sep 26, 2022
Messages
181 (0.30/day)
Hey guys we don't make an NPU so all of them are shit and our uber expensive power hungry GPU's are the way to go, even for laptops where battery life is important. Just keep it plugged in you'll be fine.

Seriously Nvidia will eventually be in a pickle as it doesn't make cpu for laptops or desktop and in laptops it will eventually be a distant memory for dGPU's as apu's just keep getting better and better and will come with very powerful NPUs Lunar Lake will offer 100TOPS total performance and Panther Lake will double that and Strix's successor will no doubt do the same.

Nvidia can't just make a dNPU so how will it compete long term. Or it just won't give a shit as it earns hundreds of billion from datacentre and commercial AI. Will they try and get into desktop/laptop cpu/apu based on ARM?

AI is a GPU thing, you are speaking of consumer AI product (phone, laptop etc.) in which indeed a CPU could be enough..however an idle/near-idle Nvidia card consumes a ridiculous amount of power especially in laptop configuration

It's a budget thing, a CPU or a CPU+GPU it's more expensive
 
Top