Thursday, December 14th 2023
Intel Accelerates AI Everywhere with Launch of Powerful Next-Gen Products
At its "AI Everywhere" launch in New York City today, Intel introduced an unmatched portfolio of AI products to enable customers' AI solutions everywhere—across the data center, cloud, network, edge and PC. "AI innovation is poised to raise the digital economy's impact up to as much as one-third of global gross domestic product," Gelsinger said. "Intel is developing the technologies and solutions that empower customers to seamlessly integrate and effectively run AI in all their applications—in the cloud and, increasingly, locally at the PC and edge, where data is generated and used."
Gelsinger showcased Intel's expansive AI footprint, spanning cloud and enterprise servers to networks, volume clients and ubiquitous edge environments. He also reinforced that Intel is on track to deliver five new process technology nodes in four years. "Intel is on a mission to bring AI everywhere through exceptionally engineered platforms, secure solutions and support for open ecosystems. Our AI portfolio gets even stronger with today's launch of Intel Core Ultra ushering in the age of the AI PC and AI-accelerated 5th Gen Xeon for the enterprise," Gelsinger said.Highlights include:
Intel Core Ultra represents the company's largest architectural shift in 40 years and launches the AI PC generation with innovation on all fronts: CPU compute, graphics, power, battery life and profound new AI features. The AI PC represents the largest transformation of the PC experience in 20 years, since Intel Centrino untethered laptops to connect to Wi-Fi from anywhere.
Intel Core Ultra features Intel's first client on-chip AI accelerator—the neural processing unit, or NPU—to enable a new level of power-efficient AI acceleration with 2.5x better power efficiency than the previous generation. Its world-class GPU and leadership CPU are each also capable of speeding up AI solutions.
New Xeon Brings More Powerful AI to the Data Center, Cloud, Network and Edge
The 5th Gen Intel Xeon processor family, also introduced today, brings a significant leap in performance and efficiency: Compared with the previous generation of Xeon, these processors deliver 21% average performance gain for general compute performance and enable 36% higher average performance per watt across a range of customer workloads. Customers following a typical five-year refresh cycle and upgrading from even older generations can reduce their TCO by up to 77%8.
Xeon is the only mainstream data center processor with built-in AI acceleration, with the new 5th Gen Xeon delivering up to 42% higher inference and fine-tuning on models as large as 20 billion parameters. It's also the only CPU with a consistent and ever-improving set of MLPerf training and inference benchmark results.
Xeon's built-in AI accelerators, together with optimized software and enhanced telemetry capabilities, enable more manageable and efficient deployments of demanding network and edge workloads for communication service providers, content delivery networks and broad vertical markets, including retail, healthcare and manufacturing.
During today's event, IBM announced that 5th Gen Intel Xeon processors achieved up to 2.7x better query throughput on its watsonx.data platform compared to previous-generation Xeon processors during testing 10. Google Cloud, which will deploy 5th Gen Xeon next year, noted that Palo Alto Networks experienced a 2x performance boost in its threat detection deep learning models by using built-in acceleration in 4th Gen Xeon through Google Cloud. And indie game studio Gallium Studios turned to Numenta's AI platform running on Xeon processors to improve inference performance by 6.5x over a GPU-based cloud instance, saving cost and latency in its AI-based game, Proxi.
This kind of performance unlocks new possibilities for advanced AI - not only in the data center and cloud, but across the world's networks and edge applications.
As important, Intel is partnering with more than 100 software vendors to bring several hundred AI-boosted applications to the PC market—a wide array of highly creative, productive and fun applications that will change the PC experience. For consumer and commercial customers, this means a larger and more extensive set of AI-enhanced applications will run great on Intel Core Ultra, particularly compared to competing platforms. For example, content creators working in Adobe Premiere Pro will enjoy 40% better performance versus the competition.
Intel Core Ultra-based AI PCs are available now from select U.S. retailers for the holiday season. Over the next year, Intel Core Ultra will bring AI to more than 230 designs from laptop and PC makers worldwide. AI PCs will comprise 80% of the PC market by 20284 and will bring new tools to the way we work, learn and create.
AI Acceleration and Solutions Everywhere Developers Need It
Both Intel Core Ultra and 5th Gen Xeon will find their way into places you might not expect. Imagine a restaurant that guides your menu choices based on your budget and dietary needs; a manufacturing floor that catches quality and safety issues at the source; an ultrasound that sees what human eyes might miss; a power grid that manages electricity with careful precision.
These edge computing use cases represent the fastest-growing segment of computing—projected to surge to a $445 billion global market by the end of the decade—within which AI is the fastest-growing workload. In that market, edge and client devices are driving 1.4x more demand for inference than the data center.
In many cases, customers will employ a mix of AI solutions. Take Zoom, which runs AI workloads on Intel Core-based client systems and Intel Xeon based-cloud solutions within its all-in-one communications and collaboration platform to deliver best user experience and costs. Zoom uses AI to suppress the neighbor's barking dog and blur your cluttered home office, and to generate a meeting summary and email.
To make AI hardware technologies as accessible and easy-to-use as possible, Intel builds optimizations into the AI frameworks developers use (like PyTorch and TensorFlow) and offers foundational libraries (through oneAPI) to make software portable and highly performant across different types of hardware.
Advanced developer tools, including Intel's oneAPI and OpenVINO toolkit, help developers harness hardware acceleration for AI workloads and solutions and quickly build, optimize and deploy AI models across a wide variety of inference targets.
Sneak Peek: Intel Gaudi AI Accelerator
Wrapping up the event, Gelsinger provided an update on Intel Gaudi, coming next year. He showed for the first time the next-generation AI accelerator for deep learning and large-scale generative AI models. Intel has seen a rapid expansion of its Gaudi pipeline due to growing and proven performance advantages combined with highly competitive TCO and pricing. With increasing demand for generative AI solutions, Intel expects to capture a larger portion of the accelerator market in 2024 with its suite of AI accelerators led by Gaudi.
With partners and a broad ecosystem, Intel is unlocking new growth opportunities fueled by AI, bringing AI everywhere. Today.
Gelsinger showcased Intel's expansive AI footprint, spanning cloud and enterprise servers to networks, volume clients and ubiquitous edge environments. He also reinforced that Intel is on track to deliver five new process technology nodes in four years. "Intel is on a mission to bring AI everywhere through exceptionally engineered platforms, secure solutions and support for open ecosystems. Our AI portfolio gets even stronger with today's launch of Intel Core Ultra ushering in the age of the AI PC and AI-accelerated 5th Gen Xeon for the enterprise," Gelsinger said.Highlights include:
- The Intel Core Ultra mobile processor family, the first built on the Intel 4 process technology and the first to benefit from the company's largest architectural shift in 40 years, delivers Intel's most power-efficient client processor and ushers in the age of the AI PC.
- The 5th Gen Intel Xeon processor family is built with AI acceleration in every core, bringing leaps in AI and overall performance and lowering total cost of ownership (TCO).
- Intel CEO Pat Gelsinger showed for the first time an Intel Gaudi 3 AI accelerator, arriving on schedule next year.
Intel Core Ultra represents the company's largest architectural shift in 40 years and launches the AI PC generation with innovation on all fronts: CPU compute, graphics, power, battery life and profound new AI features. The AI PC represents the largest transformation of the PC experience in 20 years, since Intel Centrino untethered laptops to connect to Wi-Fi from anywhere.
Intel Core Ultra features Intel's first client on-chip AI accelerator—the neural processing unit, or NPU—to enable a new level of power-efficient AI acceleration with 2.5x better power efficiency than the previous generation. Its world-class GPU and leadership CPU are each also capable of speeding up AI solutions.
New Xeon Brings More Powerful AI to the Data Center, Cloud, Network and Edge
The 5th Gen Intel Xeon processor family, also introduced today, brings a significant leap in performance and efficiency: Compared with the previous generation of Xeon, these processors deliver 21% average performance gain for general compute performance and enable 36% higher average performance per watt across a range of customer workloads. Customers following a typical five-year refresh cycle and upgrading from even older generations can reduce their TCO by up to 77%8.
Xeon is the only mainstream data center processor with built-in AI acceleration, with the new 5th Gen Xeon delivering up to 42% higher inference and fine-tuning on models as large as 20 billion parameters. It's also the only CPU with a consistent and ever-improving set of MLPerf training and inference benchmark results.
Xeon's built-in AI accelerators, together with optimized software and enhanced telemetry capabilities, enable more manageable and efficient deployments of demanding network and edge workloads for communication service providers, content delivery networks and broad vertical markets, including retail, healthcare and manufacturing.
During today's event, IBM announced that 5th Gen Intel Xeon processors achieved up to 2.7x better query throughput on its watsonx.data platform compared to previous-generation Xeon processors during testing 10. Google Cloud, which will deploy 5th Gen Xeon next year, noted that Palo Alto Networks experienced a 2x performance boost in its threat detection deep learning models by using built-in acceleration in 4th Gen Xeon through Google Cloud. And indie game studio Gallium Studios turned to Numenta's AI platform running on Xeon processors to improve inference performance by 6.5x over a GPU-based cloud instance, saving cost and latency in its AI-based game, Proxi.
This kind of performance unlocks new possibilities for advanced AI - not only in the data center and cloud, but across the world's networks and edge applications.
As important, Intel is partnering with more than 100 software vendors to bring several hundred AI-boosted applications to the PC market—a wide array of highly creative, productive and fun applications that will change the PC experience. For consumer and commercial customers, this means a larger and more extensive set of AI-enhanced applications will run great on Intel Core Ultra, particularly compared to competing platforms. For example, content creators working in Adobe Premiere Pro will enjoy 40% better performance versus the competition.
Intel Core Ultra-based AI PCs are available now from select U.S. retailers for the holiday season. Over the next year, Intel Core Ultra will bring AI to more than 230 designs from laptop and PC makers worldwide. AI PCs will comprise 80% of the PC market by 20284 and will bring new tools to the way we work, learn and create.
AI Acceleration and Solutions Everywhere Developers Need It
Both Intel Core Ultra and 5th Gen Xeon will find their way into places you might not expect. Imagine a restaurant that guides your menu choices based on your budget and dietary needs; a manufacturing floor that catches quality and safety issues at the source; an ultrasound that sees what human eyes might miss; a power grid that manages electricity with careful precision.
These edge computing use cases represent the fastest-growing segment of computing—projected to surge to a $445 billion global market by the end of the decade—within which AI is the fastest-growing workload. In that market, edge and client devices are driving 1.4x more demand for inference than the data center.
In many cases, customers will employ a mix of AI solutions. Take Zoom, which runs AI workloads on Intel Core-based client systems and Intel Xeon based-cloud solutions within its all-in-one communications and collaboration platform to deliver best user experience and costs. Zoom uses AI to suppress the neighbor's barking dog and blur your cluttered home office, and to generate a meeting summary and email.
To make AI hardware technologies as accessible and easy-to-use as possible, Intel builds optimizations into the AI frameworks developers use (like PyTorch and TensorFlow) and offers foundational libraries (through oneAPI) to make software portable and highly performant across different types of hardware.
Advanced developer tools, including Intel's oneAPI and OpenVINO toolkit, help developers harness hardware acceleration for AI workloads and solutions and quickly build, optimize and deploy AI models across a wide variety of inference targets.
Sneak Peek: Intel Gaudi AI Accelerator
Wrapping up the event, Gelsinger provided an update on Intel Gaudi, coming next year. He showed for the first time the next-generation AI accelerator for deep learning and large-scale generative AI models. Intel has seen a rapid expansion of its Gaudi pipeline due to growing and proven performance advantages combined with highly competitive TCO and pricing. With increasing demand for generative AI solutions, Intel expects to capture a larger portion of the accelerator market in 2024 with its suite of AI accelerators led by Gaudi.
With partners and a broad ecosystem, Intel is unlocking new growth opportunities fueled by AI, bringing AI everywhere. Today.
20 Comments on Intel Accelerates AI Everywhere with Launch of Powerful Next-Gen Products
Intel is requiring all "Arc"-branded laptops to have at least 16GB of dual-channel memory, which I think is a great requirement. That's pretty much perfect as a minimum for good iGPU performance.
Most of the lower-power models have 1/2 the GPU resources of the top models, which seems like a bigger cut than older Intel generations. But it's better than the 1/3 GPU resources of lower end AMD models.
videocardz.com/169099/intel-core-ultra-100h-review-roundup
Marketing painted itself in a corner here basically. Pushing thin and light, thinking the disadvantages will just vaporize somehow.
www.notebookcheck.net/Intel-Meteor-Lake-Analysis-Core-Ultra-7-155H-only-convinces-with-GPU-performance.783320.0.html
Making laptops thin has become a pain in the ass resulting in:
- nasty edge-lit displays with pitiful backlight uniformity and flimsy lids.
- awful, spongy keyboards with far too little travel
- chassis flex and fragility that requires a bulky padded bag to protect it.
- pitiful cooling that screams along with a miniscule 50mm fan or two being choked through slits the thickness of a couple of credit cards.
- undersized batteries that not only lack runtime, but also die sooner because they're frequently getting deep-discharges where a larger battery would not.
If people want a thin-and-light to travel with they've gone and bought a surface pro or iPad and keyboard cover. No clamshell laptop can compete with that in terms of dimensions or weight, nor should it!Give me a 14" laptop that's 50% thicker and use that extra dimension to give me a non-spongy keyboard, nice build quality, 16H battery life and quiet cooling for 35W. Most laptop bags can accomodate 2" thick laptops so why are we trying to get clamshell laptops down to 15mm thick and ruining them for everyone?!
MTL isn't having the smoothest launch, is it...
Nobody games (e.g. CPU-intensive and 3D stuff) on battery when using gaming laptops, since CPUs (and GPUs, which is more important for 3D gaming) from both camps will be forced into their lower power state. The only exception are the handheld PCs which use the sub-30W variants of those same CPUs, which even then still has low battery runtime even when limited to 15W.
If you take those same gaming laptops and use them for non-gaming purposes, you can get good battery runtime out of them with a bit of tweaking. 13700H for around 9 hours is pretty good for light work (2023 Lenovo Legion Slim 7i, amazingly without any tweaks). Very much possible to get 13 hours on a Ryzen 7 6800U hard-limited to 15W or with half the cores disabled (not parked, 2022 Lenovo ThinkBook 14 G3).
On-topic, most likely after a few BIOS/UEFI updates MTL would be at a more optimal state. Windows 11 still needs to be updated to deal with that weird 6P+8E+2LP configuration that's different from AL and RPL. If Lenovo can get a 12700H and 13700H to get almost good battery life like a Ryzen monolithic CPU, then its really just software stuff that needs to be kinked out.
My new gaming lappy is only 1-1/4" thick and has a darn good cooling system
Not to mention bitching battery life as some said, who travels with gaming lappy's ? I do
I might not game on battery but the lower battery mode I can still do may intensive tasks
All the bs about whom is better at intensive tasks nobody would notice same as best gaming but all this is the whom is best bs Intel always spouts.
My personal laptop is a Legion S7 and despite being a "thin" gaming laptop, it's not thin by these subnotebook/ultrabooks standards and has robust build quality, decent keyboard travel without significant flex, plenty of cooling, a huge 99WH battery, and full-size ports.
Wow
Yeah I was surprised to find my acer lappy which came with 1-usb2 lol/ 2-usb3.2/ 2-usb-c and 1 is thunderbolt/ sd-card reader/ ethernet port/ 1-hdmi.
saw lot that were very skimpy of ports.
Not sure what a kensington lock is but it has one of those to I have to search that one lol :confused: