• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Jensen Huang Celebrates Rise of Portable AI Workstations

T0@st

News Editor
Joined
Mar 7, 2023
Messages
2,077 (3.19/day)
Location
South East, UK
2024 will be the year generative AI gets personal, the CEOs of NVIDIA and HP said today in a fireside chat, unveiling new laptops that can build, test and run large language models. "This is a renaissance of the personal computer," said NVIDIA founder and CEO Jensen Huang at HP Amplify, a gathering in Las Vegas of about 1,500 resellers and distributors. "The work of creators, designers and data scientists is going to be revolutionized by these new workstations."

Greater Speed and Security
"AI is the biggest thing to come to the PC in decades," said HP's Enrique Lores, in the runup to the announcement of what his company billed as "the industry's largest portfolio of AI PCs and workstations." Compared to running their AI work in the cloud, the new systems will provide increased speed and security while reducing costs and energy, Lores said in a keynote at the event. New HP ZBooks provide a portfolio of mobile AI workstations powered by a full range of NVIDIA RTX Ada Generation GPUs. Entry-level systems with the NVIDIA RTX 500 Ada Generation Laptop GPU let users run generative AI apps and tools wherever they go. High-end models pack the RTX 5000 to deliver up to 682 TOPS, so they can create and run LLMs locally, using retrieval-augmented generation (RAG) to connect to their content for results that are both personalized and private.




Access to Accelerated Software
The new workstations can tap into NVIDIA's full-stack AI platform, including software that speeds the data science at the foundation of generative AI. The systems' Z by HP AI Studio platform—developed in collaboration with NVIDIA—links to NVIDIA NGC, a catalog of GPU-accelerated software for AI and data science. NGC includes NVIDIA NeMo, a framework to build, customize and deploy generative AI models. In addition, HP and NVIDIA announced that NVIDIA CUDA-X libraries will be integrated with the systems to turbocharge the data preparation and processing that's fundamental for generative AI.

Speedups for Data Scientists
The libraries include NVIDIA RAPIDS cuDF, which accelerates pandas, software used by nearly 10 million data scientists. "It used to take them hours and sometimes days to process data that now they can do in minutes," Huang said.

"This pandas library is insanely complex," he added, noting NVIDIA engineers worked for more than five years on reformulating the code so it can be accelerated with GPUs.



Entering a New Era
In tandem with the new systems, HP announced a partner training program developed in collaboration with NVIDIA. It will equip computer vendors to advise customers on the right AI products and solutions to meet their needs. Such programs pave the way for an industry that's entering an era where AI lets software write software.

"We've reinvented the computer. We've reinvented how software is written, and now we have to reinvent how software is used," said Huang. "Large language models, connected into other LLMs, will help solve application problems—that's the future."

View at TechPowerUp Main Site | Source
 
Joined
Apr 2, 2008
Messages
447 (0.07/day)
System Name -
Processor Ryzen 9 5900X
Motherboard MSI MEG X570
Cooling Arctic Liquid Freezer II 280 (4x140 push-pull)
Memory 32GB Patriot Steel DDR4 3733 (8GBx4)
Video Card(s) MSI RTX 4080 X-trio.
Storage Sabrent Rocket-Plus-G 2TB, Crucial P1 1TB, WD 1TB sata.
Display(s) LG Ultragear 34G750 nano-IPS 34" utrawide
Case Define R6
Audio Device(s) Xfi PCIe
Power Supply Fractal Design ION Gold 750W
Mouse Razer DeathAdder V2 Mini.
Keyboard Logitech K120
VR HMD Er no, pointless.
Software Windows 10 22H2
Benchmark Scores Timespy - 24522 | Crystalmark - 7100/6900 Seq. & 84/266 QD1 |
Whats utterly pointless non-news this is. Yet another rich guy flexing and saying look at me.

I have Zero F's to give.
 
Joined
Apr 26, 2023
Messages
129 (0.21/day)
I believe those portable workstations are called Laptops.
I must work on HP Z, because our managers think that these portable workstations are better than desktops. This thing has very poor cooling and overheats ant throttles. An in my work I only need CPU. I wonder how it cools GPU if needed for more then displaying 2D graphics.
 
Joined
May 3, 2018
Messages
2,881 (1.19/day)
Whats utterly pointless non-news this is. Yet another rich guy flexing and saying look at me.

I have Zero F's to give.
Totally agree. What he's saying "we are ecstatic to see our massively expensive Quadro cards being fitted to already expensive 'workstation' laptops". Our Xmas bonuses will just keep growing exponentially with all my AI hype pushing sales to new frontiers.
 

Space Lynx

Astronaut
Joined
Oct 17, 2014
Messages
17,417 (4.69/day)
Location
Kepler-186f
Processor 7800X3D -25 all core
Motherboard B650 Steel Legend
Cooling Frost Commander 140
Video Card(s) Merc 310 7900 XT @3100 core -.75v
Display(s) Agon 27" QD-OLED Glossy 240hz 1440p
Case NZXT H710 (Red/Black)
Audio Device(s) Asgard 2, Modi 3, HD58X
Power Supply Corsair RM850x Gold
Whats utterly pointless non-news this is. Yet another rich guy flexing and saying look at me.

I have Zero F's to give.

I disagree, specific AI coded things for certain industries is going to be world changing. I really hope some start up healthcare company gets a AI specific workstation for their specific field of medicine and takes the big guys head on with AI assisted RnD. This is the future, and it might be a big win for the little guy actually, all depends how it plays out, and who has the motivation to innovate.
 
Joined
Oct 18, 2013
Messages
6,249 (1.53/day)
Location
Over here, right where you least expect me to be !
System Name The Little One
Processor i5-11320H @4.4GHZ
Motherboard AZW SEI
Cooling Fan w/heat pipes + side & rear vents
Memory 64GB Crucial DDR4-3200 (2x 32GB)
Video Card(s) Iris XE
Storage WD Black SN850X 4TB m.2, Seagate 2TB SSD + SN850 4TB x2 in an external enclosure
Display(s) 2x Samsung 43" & 2x 32"
Case Practically identical to a mac mini, just purrtier in slate blue, & with 3x usb ports on the front !
Audio Device(s) Yamaha ATS-1060 Bluetooth Soundbar & Subwoofer
Power Supply 65w brick
Mouse Logitech MX Master 2
Keyboard Logitech G613 mechanical wireless
Software Windows 10 pro 64 bit, with all the unnecessary background shitzu turned OFF !
Benchmark Scores PDQ
Totally agree. What he's saying "we are ecstatic to see our massively expensive Quadro cards being fitted to already expensive 'workstation' laptops". Our Xmas bonuses will just keep growing exponentially with all my AI hype pushing sales to new frontiers.
Soooo, what Jacket man is REALLY sayin is that he knows that as long as the AI thingy persists, he will be able to continue buying 100's or even 1000's of new jackets for many, many years to come, hehehe :)
 
Joined
Oct 21, 2005
Messages
7,072 (1.01/day)
Location
USA
System Name Computer of Theseus
Processor Intel i9-12900KS: 50x Pcore multi @ 1.18Vcore (target 1.275V -100mv offset)
Motherboard EVGA Z690 Classified
Cooling Noctua NH-D15S, 2xThermalRight TY-143, 4xNoctua NF-A12x25,3xNF-A12x15, 2xAquacomputer Splitty9Active
Memory G-Skill Trident Z5 (32GB) DDR5-6000 C36 F5-6000J3636F16GX2-TZ5RK
Video Card(s) ASUS PROART RTX 4070 Ti-Super OC 16GB, 2670MHz, 0.93V
Storage 1x Samsung 970 Pro 512GB NVMe (OS), 2x Samsung 970 Evo Plus 2TB (data), ASUS BW-16D1HT (BluRay)
Display(s) Dell S3220DGF 32" 2560x1440 165Hz Primary, Dell P2017H 19.5" 1600x900 Secondary, Ergotron LX arms.
Case Lian Li O11 Air Mini
Audio Device(s) Audiotechnica ATR2100X-USB, El Gato Wave XLR Mic Preamp, ATH M50X Headphones, Behringer 302USB Mixer
Power Supply Super Flower Leadex Platinum SE 1000W 80+ Platinum White, MODDIY 12VHPWR Cable
Mouse Zowie EC3-C
Keyboard Vortex Multix 87 Winter TKL (Gateron G Pro Yellow)
Software Win 10 LTSC 21H2
Soooo, what Jacket man is REALLY sayin is that he knows that as long as the AI thingy persists, he will be able to continue buying 100's or even 1000's of new jackets for many, many years to come, hehehe :)
the more you buy the more you save

 
Joined
Sep 25, 2023
Messages
159 (0.35/day)
Location
Finland
System Name RayneOSX
Processor Ryzen 9 5900x 185w
Motherboard Asus Strix x570-E
Cooling EKWB AIO 360 RGB (9 ekwb vardar RGB fans)
Memory Gskill Trident Z neo CL18 3600mhz 64GB
Video Card(s) MSI RTX 3080 Gaming Z Trio 10G LHR
Storage Wayy too many to list here
Display(s) Samsung Odyssey G5 1440p 144hz 27 x2 / Samsung Odyssey CRG5 1080p 144hz 24
Case LianLi 011D white w/ Vertical GPU
Audio Device(s) Sound Blaster Z / Swisssonic Audio 2
Power Supply Corsair RM1000x (2021)
Mouse Logitech G502 Hyperion Fury
Keyboard Ducky One 2 mini Cherry MX silent Nordic
VR HMD Quest 2
Software Win10 Pro / Ubuntu 20.04
Benchmark Scores Timespy 17 219 https://www.3dmark.com/spy/49036100 PERKELE!
Huh? anyway
 
Joined
Jul 15, 2020
Messages
1,021 (0.63/day)
System Name Dirt Sheep | Silent Sheep
Processor i5-2400 | 13900K (-0.02mV offset)
Motherboard Asus P8H67-M LE | Gigabyte AERO Z690-G, bios F29e Intel baseline
Cooling Scythe Katana Type 1 | Noctua NH-U12A chromax.black
Memory G-skill 2*8GB DDR3 | Corsair Vengeance 4*32GB DDR5 5200Mhz C40 @4000MHz
Video Card(s) Gigabyte 970GTX Mini | NV 1080TI FE (cap at 50%, 800mV)
Storage 2*SN850 1TB, 230S 4TB, 840EVO 128GB, WD green 2TB HDD, IronWolf 6TB, 2*HC550 18TB in RAID1
Display(s) LG 21` FHD W2261VP | Lenovo 27` 4K Qreator 27
Case Thermaltake V3 Black|Define 7 Solid, stock 3*14 fans+ 2*12 front&buttom+ out 1*8 (on expansion slot)
Audio Device(s) Beyerdynamic DT 990 (or the screen speakers when I'm too lazy)
Power Supply Enermax Pro82+ 525W | Corsair RM650x (2021)
Mouse Logitech Master 3
Keyboard Roccat Isku FX
VR HMD Nop.
Software WIN 10 | WIN 11
Benchmark Scores CB23 SC: i5-2400=641 | i9-13900k=2325-2281 MC: i5-2400=i9 13900k SC | i9-13900k=37240-35500
Sounds like 'Rise Of The Mechanics'.

Say "hallo world", Skynet.
 
Joined
Mar 16, 2017
Messages
2,154 (0.76/day)
Location
Tanagra
System Name Budget Box
Processor Xeon E5-2667v2
Motherboard ASUS P9X79 Pro
Cooling Some cheap tower cooler, I dunno
Memory 32GB 1866-DDR3 ECC
Video Card(s) XFX RX 5600XT
Storage WD NVME 1GB
Display(s) ASUS Pro Art 27"
Case Antec P7 Neo
I must work on HP Z, because our managers think that these portable workstations are better than desktops. This thing has very poor cooling and overheats ant throttles. An in my work I only need CPU. I wonder how it cools GPU if needed for more then displaying 2D graphics.
I have one, too, and yes the poor thing chokes, especially when laying flat. One of my coworkers 3D-printed a vertical stand for me, and it makes a good deal of difference reducing thermal throttling. I am disappointed by the i7-1265U inside, with its measly 2 performance cores. I'd rather have a fat notebook than this thing, as 95% of my workdays are spent docked at a desk.
 
Joined
Nov 11, 2020
Messages
460 (0.31/day)
Location
Earth, Solar System, Milky Way Galaxy, Local Group
Processor AMD Ryzen 7 5700X
Motherboard Asus TUF Gaming B550M-Plus (Wi-Fi)
Cooling Thermalright PA120 SE; Arctic P12, F12
Memory Crucial BL8G32C16U4W.M8FE1 ×2
Video Card(s) Sapphire Nitro+ RX 6600 XT
Storage Kingston SKC3000D/2048G; Samsung MZVLB1T0HBLR-000L2; Seagate ST1000DM010-2EP102
Display(s) AOC 24G2W1G4
Case Sama MiCube
Audio Device(s) Somic G923
Power Supply EVGA 650 GD
Mouse Logitech G102
Keyboard Logitech K845 TTC Brown
Software Windows 10 Pro 1903, Dism++, CCleaner
Benchmark Scores CPU-Z 17.01.64: 3700X @ 4.6 GHz 1.3375 V scoring 557/6206; 760K @ 5 GHz 1.5 V scoring 292/964
How about celebrating huge drop in market value?
 
Joined
Dec 26, 2006
Messages
3,859 (0.59/day)
Location
Northern Ontario Canada
Processor Ryzen 5700x
Motherboard Gigabyte X570S Aero G R1.1 BiosF5g
Cooling Noctua NH-C12P SE14 w/ NF-A15 HS-PWM Fan 1500rpm
Memory Micron DDR4-3200 2x32GB D.S. D.R. (CT2K32G4DFD832A)
Video Card(s) AMD RX 6800 - Asus Tuf
Storage Kingston KC3000 1TB & 2TB & 4TB Corsair MP600 Pro LPX
Display(s) LG 27UL550-W (27" 4k)
Case Be Quiet Pure Base 600 (no window)
Audio Device(s) Realtek ALC1220-VB
Power Supply SuperFlower Leadex V Gold Pro 850W ATX Ver2.52
Mouse Mionix Naos Pro
Keyboard Corsair Strafe with browns
Software W10 22H2 Pro x64
I disagree, specific AI coded things for certain industries is going to be world changing. I really hope some start up healthcare company gets a AI specific workstation for their specific field of medicine and takes the big guys head on with AI assisted RnD. This is the future, and it might be a big win for the little guy actually, all depends how it plays out, and who has the motivation to innovate.
Anything can be used for good or bad depending on the human wielding it.

I think there is huge potential for good for it if used ethically, but even if laws are passed for it, that does not mean people and countries will follow them. Anyway, genie is out of the bottle now just like fission after ww2, I guess we just hope for the best now?
 
Joined
Jun 27, 2017
Messages
278 (0.10/day)
Processor Intel i5-13600k
Motherboard MSI MEG Z690i Unify
Cooling Noctua NH-C14S
Memory G.Skill Ripjaws V F5-5600J2834F32GX2-RS5W 64GB
Video Card(s) Asus RX6800XT TUF
Storage Samsung 980 Pro 500GB x2
Display(s) Samsung U32H850
Case Streacom DA6 XL chrome
Audio Device(s) Denon PMA-50
Power Supply Corsair SF750
Mouse Logitech MX Master 3
Keyboard Microsoft Surface
Software Win 11 Pro
Jensen Huang is full shit
 
Joined
Jun 21, 2021
Messages
3,121 (2.44/day)
System Name daily driver Mac mini M2 Pro
Processor Apple proprietary M2 Pro (6 p-cores, 4 e-cores)
Motherboard Apple proprietary
Cooling Apple proprietary
Memory Apple proprietary 16GB LPDDR5 unified memory
Video Card(s) Apple proprietary M2 Pro (16-core GPU)
Storage Apple proprietary onboard 512GB SSD + various external HDDs
Display(s) LG UltraFine 27UL850W (4K@60Hz IPS)
Case Apple proprietary
Audio Device(s) Apple proprietary
Power Supply Apple proprietary
Mouse Apple Magic Trackpad 2
Keyboard Keychron K1 tenkeyless (Gateron Reds)
VR HMD Oculus Rift S (hosted on a different PC)
Software macOS Sonoma 14.7
Benchmark Scores (My Windows daily driver is a Beelink Mini S12 Pro. I'm not interested in benchmarking.)
Well, we are never returning to pre-AI computing that's for sure so people here are going to have to cope with it. No one is pointing a gun at your head saying you have to buy a PC with AI/ML cores but over the next few years it will become harder and harder to do so. Any top tier smartphone from the past 3-4 years probably has ML cores anyhow.

As for laughing at Nvidia and hoping for a huge drop in market value, why? Any American with a retirement plan is benefiting from Nvidia's current success; market cap weighted indexes like the S&P 500 and Nasdaq-100 are heavily represented by MSFT, AAPL, GOOG, AMZN, FB, NVDA, etc.

And a run on AI technology is synergistic in the semiconductor industry. It means some companies will opt for Intel or AMD solutions rather than Nvidia's products. Everyone needs to buy more semiconductor manufacturing equipment (Applied Materials, Lam Research, ASML, whatever). And you can't build any of these things without memory (Micron) or other auxiliary components (Texas Instruments).

And living somewhere else outside the USA isn't an excuse to be snarky about this. Wall Street doesn't exist in a vacuum, growth in the semiconductor industry has wide ranging benefits elsewhere, not just the USA, Netherlands, Korea, Japan and Taiwan.

As for the term "portable workstation" PC companies have been using this term for many years to separate the professionally targeted portables from general purpose offerings. If you want to call them all "laptops" go right ahead, but if you get treated like a rube in certain circles, you'll know who to blame.

Is this all marketing posturing? Yes it is but the (most) of the modern world is driven by sales growth and technology advancements. And all of this stuff will happen regardless of whether or not you want to buy into it.

When you purchase your next Motorola Star-TAC, think about some of this.
 
Last edited:
Joined
Mar 24, 2022
Messages
113 (0.11/day)
System Name Lenovo LOQ 15
Processor Ryzen 7 7840HS
Memory Crucial 32GB (2 x 16) DDR5 5600 SODIMM
Video Card(s) RTX 4050 Mobile OC @ 2.8 GHz (dGPU)/ Radeon 780M (iGPU)
Storage Micron MTFDKCD512TFK 512GB (Will Upgrade)
Display(s) 1080p 144Hz Laptop Display
Audio Device(s) Laptop Realtek Speakers (Dolby Atmos for Headphones)
Software Windows 11
Certain laptops have had Quadros packing tensor cores since 2019. This headline is 5 years late.
 
Joined
May 13, 2010
Messages
6,080 (1.14/day)
System Name RemixedBeast-NX
Processor Intel Xeon E5-2690 @ 2.9Ghz (8C/16T)
Motherboard Dell Inc. 08HPGT (CPU 1)
Cooling Dell Standard
Memory 24GB ECC
Video Card(s) Gigabyte Nvidia RTX2060 6GB
Storage 2TB Samsung 860 EVO SSD//2TB WD Black HDD
Display(s) Samsung SyncMaster P2350 23in @ 1920x1080 + Dell E2013H 20 in @1600x900
Case Dell Precision T3600 Chassis
Audio Device(s) Beyerdynamic DT770 Pro 80 // Fiio E7 Amp/DAC
Power Supply 630w Dell T3600 PSU
Mouse Logitech G700s/G502
Keyboard Logitech K740
Software Linux Mint 20
Benchmark Scores Network: APs: Cisco Meraki MR32, Ubiquiti Unifi AP-AC-LR and Lite Router/Sw:Meraki MX64 MS220-8P
Can't use AI accelerator because you're low on cyan ink and your credit card expired
 
Joined
Mar 21, 2016
Messages
2,508 (0.79/day)
I disagree, specific AI coded things for certain industries is going to be world changing. I really hope some start up healthcare company gets a AI specific workstation for their specific field of medicine and takes the big guys head on with AI assisted RnD. This is the future, and it might be a big win for the little guy actually, all depends how it plays out, and who has the motivation to innovate.

100% agree that it can be a positive game changer for a lot of industries. The flip side of that is some of those industries are bound to intentionally misuse AI for their own selfish or malicious reasons rather than to enhance society and provide a benefit and service to it and at a improved or more reasonable price that's more environmentally sound. It depends on just the AI is used and trained and I know I've simulated the AI Matrix and broke free of it and am living in a new AI simulation.
 
Top