Friday, March 8th 2024
Jensen Huang Celebrates Rise of Portable AI Workstations
2024 will be the year generative AI gets personal, the CEOs of NVIDIA and HP said today in a fireside chat, unveiling new laptops that can build, test and run large language models. "This is a renaissance of the personal computer," said NVIDIA founder and CEO Jensen Huang at HP Amplify, a gathering in Las Vegas of about 1,500 resellers and distributors. "The work of creators, designers and data scientists is going to be revolutionized by these new workstations."
Greater Speed and Security
"AI is the biggest thing to come to the PC in decades," said HP's Enrique Lores, in the runup to the announcement of what his company billed as "the industry's largest portfolio of AI PCs and workstations." Compared to running their AI work in the cloud, the new systems will provide increased speed and security while reducing costs and energy, Lores said in a keynote at the event. New HP ZBooks provide a portfolio of mobile AI workstations powered by a full range of NVIDIA RTX Ada Generation GPUs. Entry-level systems with the NVIDIA RTX 500 Ada Generation Laptop GPU let users run generative AI apps and tools wherever they go. High-end models pack the RTX 5000 to deliver up to 682 TOPS, so they can create and run LLMs locally, using retrieval-augmented generation (RAG) to connect to their content for results that are both personalized and private.
Access to Accelerated Software
The new workstations can tap into NVIDIA's full-stack AI platform, including software that speeds the data science at the foundation of generative AI. The systems' Z by HP AI Studio platform—developed in collaboration with NVIDIA—links to NVIDIA NGC, a catalog of GPU-accelerated software for AI and data science. NGC includes NVIDIA NeMo, a framework to build, customize and deploy generative AI models. In addition, HP and NVIDIA announced that NVIDIA CUDA-X libraries will be integrated with the systems to turbocharge the data preparation and processing that's fundamental for generative AI.
Speedups for Data Scientists
The libraries include NVIDIA RAPIDS cuDF, which accelerates pandas, software used by nearly 10 million data scientists. "It used to take them hours and sometimes days to process data that now they can do in minutes," Huang said.
"This pandas library is insanely complex," he added, noting NVIDIA engineers worked for more than five years on reformulating the code so it can be accelerated with GPUs.
Entering a New Era
In tandem with the new systems, HP announced a partner training program developed in collaboration with NVIDIA. It will equip computer vendors to advise customers on the right AI products and solutions to meet their needs. Such programs pave the way for an industry that's entering an era where AI lets software write software.
"We've reinvented the computer. We've reinvented how software is written, and now we have to reinvent how software is used," said Huang. "Large language models, connected into other LLMs, will help solve application problems—that's the future."
Source:
NVIDIA Blog
Greater Speed and Security
"AI is the biggest thing to come to the PC in decades," said HP's Enrique Lores, in the runup to the announcement of what his company billed as "the industry's largest portfolio of AI PCs and workstations." Compared to running their AI work in the cloud, the new systems will provide increased speed and security while reducing costs and energy, Lores said in a keynote at the event. New HP ZBooks provide a portfolio of mobile AI workstations powered by a full range of NVIDIA RTX Ada Generation GPUs. Entry-level systems with the NVIDIA RTX 500 Ada Generation Laptop GPU let users run generative AI apps and tools wherever they go. High-end models pack the RTX 5000 to deliver up to 682 TOPS, so they can create and run LLMs locally, using retrieval-augmented generation (RAG) to connect to their content for results that are both personalized and private.
The new workstations can tap into NVIDIA's full-stack AI platform, including software that speeds the data science at the foundation of generative AI. The systems' Z by HP AI Studio platform—developed in collaboration with NVIDIA—links to NVIDIA NGC, a catalog of GPU-accelerated software for AI and data science. NGC includes NVIDIA NeMo, a framework to build, customize and deploy generative AI models. In addition, HP and NVIDIA announced that NVIDIA CUDA-X libraries will be integrated with the systems to turbocharge the data preparation and processing that's fundamental for generative AI.
Speedups for Data Scientists
The libraries include NVIDIA RAPIDS cuDF, which accelerates pandas, software used by nearly 10 million data scientists. "It used to take them hours and sometimes days to process data that now they can do in minutes," Huang said.
"This pandas library is insanely complex," he added, noting NVIDIA engineers worked for more than five years on reformulating the code so it can be accelerated with GPUs.
In tandem with the new systems, HP announced a partner training program developed in collaboration with NVIDIA. It will equip computer vendors to advise customers on the right AI products and solutions to meet their needs. Such programs pave the way for an industry that's entering an era where AI lets software write software.
"We've reinvented the computer. We've reinvented how software is written, and now we have to reinvent how software is used," said Huang. "Large language models, connected into other LLMs, will help solve application problems—that's the future."
18 Comments on Jensen Huang Celebrates Rise of Portable AI Workstations
I have Zero F's to give.
Say "hallo world", Skynet.
I think there is huge potential for good for it if used ethically, but even if laws are passed for it, that does not mean people and countries will follow them. Anyway, genie is out of the bottle now just like fission after ww2, I guess we just hope for the best now?
As for laughing at Nvidia and hoping for a huge drop in market value, why? Any American with a retirement plan is benefiting from Nvidia's current success; market cap weighted indexes like the S&P 500 and Nasdaq-100 are heavily represented by MSFT, AAPL, GOOG, AMZN, FB, NVDA, etc.
And a run on AI technology is synergistic in the semiconductor industry. It means some companies will opt for Intel or AMD solutions rather than Nvidia's products. Everyone needs to buy more semiconductor manufacturing equipment (Applied Materials, Lam Research, ASML, whatever). And you can't build any of these things without memory (Micron) or other auxiliary components (Texas Instruments).
And living somewhere else outside the USA isn't an excuse to be snarky about this. Wall Street doesn't exist in a vacuum, growth in the semiconductor industry has wide ranging benefits elsewhere, not just the USA, Netherlands, Korea, Japan and Taiwan.
As for the term "portable workstation" PC companies have been using this term for many years to separate the professionally targeted portables from general purpose offerings. If you want to call them all "laptops" go right ahead, but if you get treated like a rube in certain circles, you'll know who to blame.
Is this all marketing posturing? Yes it is but the (most) of the modern world is driven by sales growth and technology advancements. And all of this stuff will happen regardless of whether or not you want to buy into it.
When you purchase your next Motorola Star-TAC, think about some of this.