• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

UL Announces the Procyon AI Image Generation Benchmark Based on Stable Diffusion

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,294 (7.53/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
We're excited to announce we're expanding our AI Inference benchmark offerings with the UL Procyon AI Image Generation Benchmark, coming Monday, 25th March. AI has the potential to be one of the most significant new technologies hitting the mainstream this decade, and many industry leaders are competing to deliver the best AI Inference performance through their hardware. Last year, we launched the first of our Procyon AI Inference Benchmarks for Windows, which measured AI Inference performance with a workload using Computer Vision.

The upcoming UL Procyon AI Image Generation Benchmark provides a consistent, accurate and understandable workload for measuring the AI performance of high-end hardware, built with input from members of the industry to ensure fair and comparable results across all supported hardware.



Measuring a rapidly growing range of AI hardware
Our existing AI Inference benchmark, based on an AI Computer Vision workload, made it easy to measure and compare the AI Inference performance of dedicated AI accelerators found in lightweight PCs and compare them against traditional CPUs and integrated GPUs.

As new AI-capable processors allow more device form factors to run AI tasks efficiently, the performance range of consumer AI-capable hardware has become incredibly broad. Like with our ray tracing gaming benchmarks, measuring AI Inference now requires a selection of benchmarks to optimally measure the AI inference performance of all available consumer hardware.

With a new AI Image Generation benchmark being added to the UL Procyon AI Inference Benchmarks family, we're clarifying our previously existing AI Inference Benchmark as the UL Procyon AI Computer Vision Benchmark.

The AI Image Generation Benchmark
Built around the Stable Diffusion AI model, the AI Image Generation Benchmark is considerably heavier than the computer vision benchmark and is designed for measuring and comparing the AI Inference performance of modern discrete GPUs.

To better measure the performance of both mid-range and high-end discrete graphics cards, this benchmark contains two tests built using different versions of the Stable Diffusion model, and we hope to add more tests in the future to support other performance categories.

Test performance across multiple AI Inference Engines
Like our AI Computer Vision Benchmark, you can freely switch between several leading inference engines, letting you compare engine performance differences, hardware using the same engine, or the best-case implementations of AI Inference performance across devices. By default, the benchmark selects the optimal inference engine for the system's hardware.

Currently, the AI Image Generation Benchmark supports the following inference engines. We plan to add support for more inference engines in the future to provide optimal performance for all supported AI hardware.
  • Intel OpenVINO
  • NVIDIA TensorRT
  • ONNX runtime with DirectML
UL Procyon Benchmarking Suite
The UL Procyon benchmark suite offers flexible licensing, letting you choose the benchmarks that best meet your needs. You can buy just one benchmark or add more in any combination.

Find out more about UL Procyon benchmarks.

View at TechPowerUp Main Site
 
Joined
Sep 9, 2017
Messages
244 (0.09/day)
System Name B20221017 Pro SP1 R2 Gaming Edition
Processor AMD Ryzen 7900X3D
Motherboard Asus ProArt X670E-Creator
Cooling NZXT Kraken Z73
Memory G.Skill Trident Z DDR5-6000 CL30 64GB
Video Card(s) NVIDIA RTX 3090 Founders Edition
Storage Samsung 980 Pro 2TB + Samsung 870 Evo 4TB
Display(s) Samsung CF791 Curved Ultrawide
Case NZXT H7 Flow
Power Supply Corsair HX1000i
VR HMD Meta Quest 3
Software Windows 11
A license costs $5,000?

I hope they release a consumer version.
 
Joined
Nov 3, 2014
Messages
267 (0.07/day)
A license costs $5,000?

I hope they release a consumer version.

This is kind of insane, considering that at least one popular frontend, SDNext which has the widest GPU compatibility, has free built-in benchmarking.
 
Joined
Sep 6, 2013
Messages
3,391 (0.82/day)
Location
Athens, Greece
System Name 3 desktop systems: Gaming / Internet / HTPC
Processor Ryzen 5 7600 / Ryzen 5 4600G / Ryzen 5 5500
Motherboard X670E Gaming Plus WiFi / MSI X470 Gaming Plus Max (1) / MSI X470 Gaming Plus Max (2)
Cooling Aigo ICE 400SE / Segotep T4 / Νoctua U12S
Memory Kingston FURY Beast 32GB DDR5 6000 / 16GB JUHOR / 32GB G.Skill RIPJAWS 3600 + Aegis 3200
Video Card(s) ASRock RX 6600 + GT 710 (PhysX) / Vega 7 integrated / Radeon RX 580
Storage NVMes, ONLY NVMes / NVMes, SATA Storage / NVMe, SATA, external storage
Display(s) Philips 43PUS8857/12 UHD TV (120Hz, HDR, FreeSync Premium) / 19'' HP monitor + BlitzWolf BW-V5
Case Sharkoon Rebel 12 / CoolerMaster Elite 361 / Xigmatek Midguard
Audio Device(s) onboard
Power Supply Chieftec 850W / Silver Power 400W / Sharkoon 650W
Mouse CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Keyboard CoolerMaster Devastator III Plus / CoolerMaster Devastator / Logitech
Software Windows 10 / Windows 10&Windows 11 / Windows 10
Tech sites might decide to pay that price, if they intent to publish this kind of benchmarks. Others, why care?
I bet UL will lower the price after 6-12 months, or come up with a much cheaper version.
 
Joined
Jul 13, 2016
Messages
3,328 (1.08/day)
Processor Ryzen 7800X3D
Motherboard ASRock X670E Taichi
Cooling Noctua NH-D15 Chromax
Memory 32GB DDR5 6000 CL30
Video Card(s) MSI RTX 4090 Trio
Storage Too much
Display(s) Acer Predator XB3 27" 240 Hz
Case Thermaltake Core X9
Audio Device(s) Topping DX5, DCA Aeon II
Power Supply Seasonic Prime Titanium 850w
Mouse G305
Keyboard Wooting HE60
VR HMD Valve Index
Software Win 10
This is kind of insane, considering that at least one popular frontend, SDNext which has the widest GPU compatibility, has free built-in benchmarking.

It's really not when you consider what UL charges for certifications. You are paying for the higher level of confidence. For business that demand that, it's very welcome.
 

bug

Joined
May 22, 2015
Messages
13,842 (3.95/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
A license costs $5,000?

I hope they release a consumer version.
Maybe something to consider for users that use ad blockers indiscriminately.
 
Joined
Aug 13, 2010
Messages
5,479 (1.04/day)
I have access to this. Ive started to run some tests and this sure takes its sweet time generating results. There's also some shenanigans with ARC and OpenVINO that needs some debugging.
Important to note that for AMD it does use ONNX and using that, you can expect slower results for an RX 7900 XTX than what typically the RTX 4070 is able to do.
 
Joined
Mar 29, 2014
Messages
496 (0.13/day)
I have access to this. Ive started to run some tests and this sure takes its sweet time generating results. There's also some shenanigans with ARC and OpenVINO that needs some debugging.
Important to note that for AMD it does use ONNX and using that, you can expect slower results for an RX 7900 XTX than what typically the RTX 4070 is able to do.
Important to note for who? Pretty strange unprompted statement. Usually something important would trigger a registering of facts.
 
Top