• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

YouTube Updates Server Infrastructure With Custom ASICs for Video Transcoding

AleksandarK

News Editor
Staff member
Joined
Aug 19, 2017
Messages
2,651 (0.99/day)
Video streaming is looking a bit like magic. The uploader sends a video to one platform in one resolution and encoding format, while the viewer requests a video in a specific resolution and encoding format used by the device the video is streamed on. YouTube knows this best, as it represents the world's largest video platform with over 2 billion users visiting the platform each month. That takes a massive load on the server infrastructure over at Google's data centers that host the service. There is about 500 hours worth of video content uploaded to the platform every minute, and regular hardware isn't being enough anymore to handle everything.

That is why YouTube has developed custom chips, ASICs, that are called VCUs or Video (trans)Coding Units. In Google data centers, there is a large problem with transcoding. Each video needs to adapt to the streaming platform and desired specifications, and doing that on regular hardware is a problem. By using ASIC devices, such as VCUs, Google can keep up with the demand and deliver the best possible quality. Codenamed Argos, the chip can deliver 20-33x improvement in efficiency compared to the regular server platform. In data centers, the VCU is implemented as a regular PCIe card, with two chips under the heatsinks.



Google has provided us with a chip diagram that shows just what the Argos chip has inside. Alongside regular IO and memory controllers, there is a CPU to control the flow of data in the chip. The main highlight of the chip is ten encoder cores, each capable of encoding 2160p resolution at 60 FPS, in real-time using three reference frames. That is all done using off-the-shelf IP, as Google notes. For more details about the chip and its applications, read the whitepaper here and read the YouTube blog post here.

View at TechPowerUp Main Site
 

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,769 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
There are some very detailed pictures of that card in the forums, that were posted back in March.
 
Joined
Jan 6, 2013
Messages
350 (0.08/day)
wonder why google expected so long to do this...it is an obvious choice when you have such a specialized task on such a large scale to use asics.
 
Joined
Feb 10, 2020
Messages
179 (0.10/day)
There are some very detailed pictures of that card in the forums, that were posted back in March.
I also just thought of the post "is this a video card" I read a few weeks ago :D ... thanks for directly linking it :)

Was funny back then reading the speculations and stuff and the explanation in general - but good to now have the official info including the whitepaper :)
 
Joined
Apr 19, 2018
Messages
1,227 (0.50/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
Interesting. This was launched a year ago, and only supports VP9 and H.264 encoding, up to 60Hz 2160p. So legacy video stuff really, but I guess that covers most uploads to YouTube. It was also telling that they think AMD and nVidias consumer hardware encoders offer sub-par quality, which I can certainly agree with, especially AMD's encoder!

V2.0 of this will be interesting, as HDR, AV1 & 8K support should be baked in this time round. We can all hope that this could also bring a much needed improvement in quality.

wonder why google expected so long to do this...it is an obvious choice when you have such a specialized task on such a large scale to use asics.
I think they were using nVidias hardware before, but don't quote me!
 
Last edited:

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,769 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Interesting. This was launched a year ago, and only supports VP9 and H.264 encoding, up to 60Hz 2160p. So legacy video stuff really, but I guess that covers most uploads to YouTube. It was also telling that they think AMD and nVidias consumer hardware encoders offer sub-par quality, which I can certainly agree with, especially AMD's encoder!

V2.0 of this will be interesting, as HDR, AV1 & 8K support should be baked in this time round. We can all hope that this could also bring a much needed improvement in quality.


I think they were using nVidias hardware before, but don't quote me!
Uhm, there's AV1 support in the one that was just announced...
 
Joined
Apr 19, 2018
Messages
1,227 (0.50/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
Uhm, there's AV1 support in the one that was just announced...
Strange, as it's not mentioned in the whitepaper. They also only show test results for H.264 and VP9.

"And one of the key things that we're doing in the next-generation chip is adding in AV1" - From Youtubes Blog post April 21st 2021

To me, that implies this chip does not support the AV1 codec.
 
Last edited:

TheLostSwede

News Editor
Joined
Nov 11, 2004
Messages
17,769 (2.42/day)
Location
Sweden
System Name Overlord Mk MLI
Processor AMD Ryzen 7 7800X3D
Motherboard Gigabyte X670E Aorus Master
Cooling Noctua NH-D15 SE with offsets
Memory 32GB Team T-Create Expert DDR5 6000 MHz @ CL30-34-34-68
Video Card(s) Gainward GeForce RTX 4080 Phantom GS
Storage 1TB Solidigm P44 Pro, 2 TB Corsair MP600 Pro, 2TB Kingston KC3000
Display(s) Acer XV272K LVbmiipruzx 4K@160Hz
Case Fractal Design Torrent Compact
Audio Device(s) Corsair Virtuoso SE
Power Supply be quiet! Pure Power 12 M 850 W
Mouse Logitech G502 Lightspeed
Keyboard Corsair K70 Max
Software Windows 10 Pro
Benchmark Scores https://valid.x86.fr/yfsd9w
Strange, as it's not mentioned in the whitepaper. They also only show test results for H.264 and VP9.

"And one of the key things that we're doing in the next-generation chip is adding in AV1" - From Youtubes Blog post April 21st 2021

To me, that implies this chip does not support the AV1 codec.
I guess they misread then. Odd, oh well.
 
Joined
Sep 28, 2012
Messages
982 (0.22/day)
System Name Poor Man's PC
Processor Ryzen 7 9800X3D
Motherboard MSI B650M Mortar WiFi
Cooling Thermalright Phantom Spirit 120 with Arctic P12 Max fan
Memory 32GB GSkill Flare X5 DDR5 6000Mhz
Video Card(s) XFX Merc 310 Radeon RX 7900 XT
Storage XPG Gammix S70 Blade 2TB + 8 TB WD Ultrastar DC HC320
Display(s) Xiaomi G Pro 27i MiniLED
Case Asus A21 Case
Audio Device(s) MPow Air Wireless + Mi Soundbar
Power Supply Enermax Revolution DF 650W Gold
Mouse Logitech MX Anywhere 3
Keyboard Logitech Pro X + Kailh box heavy pale blue switch + Durock stabilizers
VR HMD Meta Quest 2
Benchmark Scores Who need bench when everything already fast?
Youtube will now spawn more ads to cover this expense.
 
Joined
Jul 13, 2016
Messages
3,329 (1.08/day)
Processor Ryzen 7800X3D
Motherboard ASRock X670E Taichi
Cooling Noctua NH-D15 Chromax
Memory 32GB DDR5 6000 CL30
Video Card(s) MSI RTX 4090 Trio
Storage Too much
Display(s) Acer Predator XB3 27" 240 Hz
Case Thermaltake Core X9
Audio Device(s) Topping DX5, DCA Aeon II
Power Supply Seasonic Prime Titanium 850w
Mouse G305
Keyboard Wooting HE60
VR HMD Valve Index
Software Win 10
Interesting. This was launched a year ago, and only supports VP9 and H.264 encoding, up to 60Hz 2160p. So legacy video stuff really, but I guess that covers most uploads to YouTube. It was also telling that they think AMD and nVidias consumer hardware encoders offer sub-par quality, which I can certainly agree with, especially AMD's encoder!

V2.0 of this will be interesting, as HDR, AV1 & 8K support should be baked in this time round. We can all hope that this could also bring a much needed improvement in quality.


I think they were using nVidias hardware before, but don't quote me!

I don't think YouTube can cast stones here, their quality is pretty poor. Particularly black detail performance. It's not better than NVENC IMO.
 
Joined
Apr 19, 2018
Messages
1,227 (0.50/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
I don't think YouTube can cast stones here, their quality is pretty poor. Particularly black detail performance. It's not better than NVENC IMO.
NVENC is terrible on motion detail.
 
Top