• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

New NVIDIA Broadcast AI Features Now Streaming With GeForce RTX 50 Series GPUs

GFreeman

News Editor
Staff member
Joined
Mar 6, 2023
Messages
1,681 (2.41/day)
New GeForce RTX 5090 and RTX 5080 GPUs - built on the NVIDIA Blackwell architecture - are now available to power generative AI content creation and accelerate creative performance. GeForce RTX 5090 and RTX 5080 GPUs feature fifth-generation Tensor Cores with support for FP4, reducing the VRAM requirements to run generative AI models while doubling performance. For example, Black Forest Labs' FLUX models - available on Hugging Face this week - at FP4 precision require less than 10 GB of VRAM, compared with over 23 GB at FP16. With a GeForce RTX 5090 GPU, the FLUX.1 [dev] model can generate images in just over five seconds, compared with 15 seconds on FP16 or 10 seconds on FP8 on a GeForce RTX 4090 GPU.

GeForce RTX 50 Series GPUs also come equipped with ninth-generation encoders and sixth-generation decoders that add support for 4:2:2 and increase encoding quality for HEVC and AV1. Fourth-generation RT Cores paired with DLSS 4 provide creators with super-smooth 3D rendering viewports. The GeForce RTX 5090 GPU includes 32 GB of ultra-fast GDDR7 memory and 1,792 GB/sec of total memory bandwidth - a 77% bandwidth increase over the GeForce RTX 4090 GPU. It also includes three encoders and two decoders, reducing export times by a third compared with the prior generation.



The GeForce RTX 5080 GPU features 16 GB of GDDR7 memory, providing up to 960 GB/sec of total memory bandwidth - a 34% increase over the GeForce RTX 4080 GPU. And it includes two encoders and two decoders to boost video editing workloads.

"The NVIDIA GeForce RTX 5080 FE is notable on its own as a viable powerhouse option for any creative pro…" - Creative Bloq

The latest version of the NVIDIA Broadcast app is now available, adding two new beta AI effects - Studio Voice and Virtual Key Light - and improvements to existing ones, along with an updated user interface for better usability.

In addition, the January NVIDIA Studio Driver with support for the GeForce RTX 5090 and 5080 GPUs is ready for installation today. For automatic Studio Driver notifications, download the NVIDIA app, including an update for RTX Video Super Resolution - expanding the lineup of GeForce RTX GPUs that can run RTX Video Super Resolution for higher-quality video.

Use the GeForce RTX graphics card product finder to pick up GeForce RTX 5090 and RTX 5080 GPUs or a prebuilt system today.

Lights, Camera, Broadcast
The latest NVIDIA Broadcast app release features two new AI effects - Studio Voice and Virtual Key Light - both currently in beta.

Studio Voice enhances a user's microphone to match that of a high-quality microphone. Virtual Key Light relights subjects to deliver even lighting, as if a physical key light was defining the form and dimension of an individual. The new effects require a GeForce RTX 4080 or 5080 GPU or higher, and are designed for chatting streams and podcasts - these are not recommended for gaming.

The app update also improves voice quality with the Background Noise Removal feature, adds gaze stability and subtle random eye movements for a more natural appearance with Eye Contact, and improves foreground and background separation with Virtual Background.

There's also an updated user interface that allows users to apply more effects simultaneously and includes a side-by-side camera preview option, a GPU utilization meter and more.

Developers can integrate these effects directly into applications with NVIDIA Maxine Windows software development kits (SDKs) or by accessing them as an NVIDIA NIM microservice.

The updated NVIDIA Broadcast app is available for download today.



Accelerating Creative Workflows
For video editors, all GeForce RTX 50 Series GPUs include 4:2:2 hardware support and can decode a single video source at up to 8K at 75 frames per second (FPS) or nine video sources at 4K at 30 FPS per decoder, enabling smooth multi-camera video editing.

The GeForce RTX 5090 is equipped with three encoders and two decoders. These multi-encoder and -decoder setups enable the GeForce RTX 5090 GPU to export video 40% faster than the GeForce RTX 4090 GPU and at 4x speed compared with the GeForce RTX 3090 GPU.

GeForce RTX 50 Series GPUs also feature the ninth-generation NVIDIA Encoder (NVENC) with a 5% improvement in video quality on HEVC and AV1 encoding. The new AV1 Ultra Quality mode achieves 5% more compression at the same quality versus the previous generation, and the sixth-generation NVIDIA decoder achieves 2x decode speeds for H.264 over the prior version. The AV1 Ultra Quality mode will also be available to GeForce RTX 40 Series users.

Video editing applications Blackmagic Design's DaVinci Resolve and Wondershare Filmora have integrated these technologies.


Livestreamers also benefit from the ninth-generation NVENC with a 5% video quality improvement for HEVC and AV1 - meaning that video quality looks like it used 5% more bitrate - in Twitch with the Twitch Enhanced Broadcasting beta, YouTube or Discord. This improvement is measured using BD-BR PSNR, the standard for measuring video quality by comparing what bitrate matches the same video quality between two encoders.

3D artists benefit from the 32 GB of memory in GeForce RTX 5090 GPUs, allowing them to work on massive 3D projects and across multiple platforms simultaneously with smooth viewport movement. GeForce RTX 50 Series GPUs with fourth-generation RT Cores run 3D applications 40% faster.


DLSS 4 is now available in D5 Render and is coming in February to Chaos Vantage, two popular professional-grade 3D apps for architects, animators and designers. D5 Render will support DLSS 4's new Multi Frame Generation feature to boost frame rates by using AI to generate up to three frames per rendered frame. This enables animators to smoothly navigate a scene with 4x as many frames, or render 3D content at 60 FPS or more.

Developers can learn more about integrating these new tools into their apps via SDKs.

Stay tuned for more updates on the GeForce RTX 50 Series, app performance and compatibility, and emerging AI technologies.

View at TechPowerUp Main Site | Source
 
Joined
Feb 11, 2009
Messages
5,657 (0.97/day)
System Name Cyberline
Processor Intel Core i7 2600k -> 12600k
Motherboard Asus P8P67 LE Rev 3.0 -> Gigabyte Z690 Auros Elite DDR4
Cooling Tuniq Tower 120 -> Custom Watercoolingloop
Memory Corsair (4x2) 8gb 1600mhz -> Crucial (8x2) 16gb 3600mhz
Video Card(s) AMD RX480 -> RX7800XT
Storage Samsung 750 Evo 250gb SSD + WD 1tb x 2 + WD 2tb -> 2tb MVMe SSD
Display(s) Philips 32inch LPF5605H (television) -> Dell S3220DGF
Case antec 600 -> Thermaltake Tenor HTCP case
Audio Device(s) Focusrite 2i4 (USB)
Power Supply Seasonic 620watt 80+ Platinum
Mouse Elecom EX-G
Keyboard Rapoo V700
Software Windows 10 Pro 64bit
"are now available to power generative AI content creation and accelerate creative performance"

considering how AI is trained.....ya know...theft....this sentence is beyond disgusting.
 
Joined
Nov 4, 2005
Messages
12,083 (1.72/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
"are now available to power generative AI content creation and accelerate creative performance"

considering how AI is trained.....ya know...theft....this sentence is beyond disgusting.
FP4 vs FP16 resolution as well, how accurate are we trying to be here?????

this is how we end up with AI created six fingered humanoids that are telling the population to eat lead cause it trained on a book and doesn’t understand anything.
 
Joined
Mar 21, 2016
Messages
2,548 (0.79/day)
FP4 vs FP16 resolution as well, how accurate are we trying to be here?????

this is how we end up with AI created six fingered humanoids that are telling the population to eat lead cause it trained on a book and doesn’t understand anything.

Anyone that doesn't see the rapid advancement in AI is blind as a bat. Hallucinations certainly exist and incorrect AI results, but that isn't to say AI training isn't improving, correctly for, and improving inference results over time with continued refinement. It's much easier to get more correct and consistent accuracy on results with the right training and weeding out the bad results. Vehicles were pathetically bad to try to draw a year ago and a piece of cake now.

I think when it comes to some of the copyright issues and concerns it's a bit of a case of where do you draw the line in the sand on these issues? Imitation is the sincerest form of flattery ever recall hearing that phrase? I mean from the day we're born and even before in the womb we're taught to copy and imitate. Just at the genetic DNA level of existence it's inherently true of all living lifeforms. It's a bit more complicated a situation though training off other people's data and bigger part of the overall issue. The litigation side of copyrights can turn into a festering nightmare irrespective of AI and human's and all lifeforms could also be considered and identifiable as a forms of AI inherently. I mean we're procedural generated from the DNA of our ancestry.

I don't have the answers to resolving all these issues like being taught to copy many things and it being fine and being expected to learn them then told we can't in other cases because we'll be litigated against for doing so because of money. I mean Palworlds for example it's obviously not Pokemon, but let's sue anyway because it can be construed as close to Pokemon if you cherry pick enough of the details. Though Pokemon by extension is a copy of nature and sprinkling of other details like geometry if you cherry pick the details. Like have looked at orange thru augmented reality and been like I wonder what Pokemon that is growing on that tree!?
 
Top