• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

More than 500 AI Models Run Optimized on Intel Core Ultra Processors

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,771 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Today, Intel announced it surpassed 500 AI models running optimized on new Intel Core Ultra processors - the industry's premier AI PC processor available in the market today, featuring new AI experiences, immersive graphics and optimal battery life. This significant milestone is a result of Intel's investment in client AI, the AI PC transformation, framework optimizations and AI tools including OpenVINO toolkit. The 500 models, which can be deployed across the central processing unit (CPU), graphics processing unit (GPU) and neural processing unit (NPU), are available across popular industry sources, including OpenVINO Model Zoo, Hugging Face, ONNX Model Zoo and PyTorch. The models draw from categories of local AI inferencing, including large language, diffusion, super resolution, object detection, image classification/segmentation, computer vision and others.

"Intel has a rich history of working with the ecosystem to bring AI applications to client devices, and today we celebrate another strong chapter in the heritage of client AI by surpassing 500 pre-trained AI models running optimized on Intel Core Ultra processors. This unmatched selection reflects our commitment to building not only the PC industry's most robust toolchain for AI developers, but a rock-solid foundation AI software users can implicitly trust."
-Robert Hallock, Intel vice president and general manager of AI and technical marketing in the Client Computing Group




Why It Matters: Surpassing 500 AI models is a landmark moment for Intel's efforts to nurture and support the AI PC transformation. Not only is the Intel Core Ultra processor the fastest-growing AI PC processor to date—selling more units in a single quarter than competing processors in all of 2023—it is also the most robust platform for AI PC development, with more AI models, frameworks and runtimes enabled than any other processor vendor.

Models form the backbone of AI-enhanced software features like object removal, image super resolution or text summarization. There is a direct link between the number of enabled/optimized models and the breadth of user-facing AI features that can be brought to market. Without a model, the feature cannot be designed. Without runtime optimization, the feature cannot reach its best performance.

How AI Models Work: AI models are one of many critical layers in the software stack that determine the ultimate performance, stability and capabilities of an AI-driven application. AI models are trained to analyze large quantities of data, draw conclusions and take actions based on such inferences. Developers creating new AI PC features can utilize these models and build on them. The more AI models there are, the more AI PC features are enabled.

AI models can act on text, speech, audio, images and other audiovisual sources common to the PC experience. AI models form the foundation of AI-enhanced features developed for users to enjoy, such as automatic text summarization, reducing energy consumption during teleconferencing or removing unwanted objects from a picture. OpenVINO optimizes for Intel Core Ultra by load-balancing across all the compute units, compressing the models to run efficiently in an AI PC, and optimizing the runtime to take advantage of memory bandwidth and core architecture within Intel Core Ultra.

Continuous efforts to enable an unmatched set of high-performance models on Intel Core Ultra offer a wide field of innovation for software developers and simplifies the delivery of AI PC applications and features to users.

About Additional Features and Benefits: Features and benefits of the more than 500 optimized AI models:
  • Facilitates development and deployment.
  • Spans more than 20 categories of AI, including large language, diffusion, super resolution, object detection and computer vision.
  • Includes Phi-2, Mistral, Llama, Bert, Whisper and Stable Diffusion 1.5.
  • Improves system stability, reliability and performance.
About Intel's AI PC Developer Program: Developers in Intel's AI PC Developer Program can access tools, workflows, AI-deployment frameworks for Intel Core Ultra processors. Developers can also utilize Intel's software tools for optimizing AI, multiarchitecture programming, gaming, media and rendering on the AI PC.

View at TechPowerUp Main Site | Source
 
Joined
Sep 6, 2013
Messages
3,391 (0.82/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 7600 / Ryzen 5 4600G / Ryzen 5 5500
Motherboard X670E Gaming Plus WiFi / MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2)
Cooling Aigo ICE 400SE / Segotep T4 / Νoctua U12S
Memory Kingston FURY Beast 32GB DDR5 6000 / 16GB JUHOR / 32GB G.Skill RIPJAWS 3600 + Aegis 3200
Video Card(s) ASRock RX 6600 + GT 710 (PhysX) / Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes / NVMes, SATA Storage / NVMe, SATA, external storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) / 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
Intel posts press releases like the above.
Nvidia posts press releases about Premium AI PCs.
AMD's marketing department is having a pajama party.
 
Joined
Sep 17, 2014
Messages
22,673 (6.05/day)
Location
The Washing Machine
System Name Tiny the White Yeti
Processor 7800X3D
Motherboard MSI MAG Mortar b650m wifi
Cooling CPU: Thermalright Peerless Assassin / Case: Phanteks T30-120 x3
Memory 32GB Corsair Vengeance 30CL6000
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Lexar NM790 4TB + Samsung 850 EVO 1TB + Samsung 980 1TB + Crucial BX100 250GB
Display(s) Gigabyte G34QWC (3440x1440)
Case Lian Li A3 mATX White
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse Steelseries Aerox 5
Keyboard Lenovo Thinkpad Trackpoint II
VR HMD HD 420 - Green Edition ;)
Software W11 IoT Enterprise LTSC
Benchmark Scores Over 9000
Intel posts press releases like the above.
Nvidia posts press releases about Premium AI PCs.
AMD's marketing department is having a pajama party.
Look on the bright side, there isn't much to sell here in reality, at least they're being sensible.

Sense doesn't make money tho
 
Joined
Apr 24, 2020
Messages
2,723 (1.60/day)
"C'mon, guys. AI is real. It's not a fad. Honest. It's going to be the next big thing. It's not wasting space where actual cores could be. Really."

I think you're overestimating the space cost of the vpdpbusd instruction (and all the other AVX512-VNNI instructions, for that matter).
 
Joined
May 3, 2018
Messages
2,881 (1.19/day)
Mediocre Lake slower than Hawk Point in AI (11/34) vs (16/39) TOPS but is the "PREMIERE" AI cpu. In most benchmarks not optimised specifically for Intel it gets beaten by Hawk Point
 
Joined
Jan 2, 2019
Messages
153 (0.07/day)
>>...The models draw from categories of local AI inferencing, including large language, diffusion, super resolution,
>>object detection, image classification/segmentation, computer vision and others...

Take into account that this is for AI inferencing only. It is still Not possible to do large-scale AI training on CPUs.
 
Top