New NVIDIA Broadcast App 1.3 Update Improves Noise Removal, Adds Support for More Cameras, and Reduces System Impact

[btarunr]

NVIDIA's tool to enhance both live streaming and video conferencing just got even better. The Broadcast app has transformed the homes, apartments and dorm rooms of millions of content creators, remote students and workers into home studios through the power of AI—all without the need to purchase specialized equipment. The latest upgrade, NVIDIA Broadcast version 1.3, is available to download today and further improves noise removal, adds more camera compatibility, and reduces the impact on overall system performance.

NVIDIA Broadcast's noise removal AI effect has been widely praised for its ability to remove background noise while keeping speech clear and crisp. The exception? When someone speaks with a lot of emotion—typically speaking loudly or at a higher pitch—and their speech is sometimes inadvertently removed. This rarely happens, but is typically at the peak moments of excitement during a livestream. The new update addresses this with dedicated training sound profiles to retain that speech while removing the unwanted background noise.



The community frequently requests more support for video devices. Now many of your favorite professional and virtual cameras, as well as capture cards, are compatible with NVIDIA Broadcast—including Canon EOS Webcam Utility, Nikon Webcam Utility, Sony Webcam Utility, OBS Virtual Camera, and more.

With version 1.2 we added the ability for users to stack effects. VRAM could become limited when multitaskers run AI features for their microphone, speakers and camera simultaneously. Version 1.3 reduces VRAM usage by over 40%, leading to an increase in FPS while gaming.

Finally, we have several new UI elements and bug fixes that round out a better, smoother, NVIDIA Broadcast experience.
NVIDIA Broadcast is an App and an Ecosystem

NVIDIA partners with the top creative app developers to accelerate and enhance content creation using Broadcast technology.

• Live streamers get NVIDIA's noise removal in OBS Studio 27, Streamlabs, XSplit Broadcaster 4.0, or Gamecaster 4, applying effects per audio source, providing more granular control over audio. Add Xaymar's StreamFX plugin for OBS to get NVIDIA's auto frame technology.
• Video editors and podcasters can add NVIDIA noise removal as a VST filter to any compatible apps using Xaymar's VoiceFX. This works in Adobe Premiere Pro, Adobe Audition, or Audacity.
• VFX artists explore Notch's native integration of virtual background, Face Tracking, and 3D Body Tracking, allowing for advanced VFX effects to be seamlessly added.
• Owners of AVerMedia microphones, headsets or cameras get all relevant NVIDIA Broadcast features directly embedded into the device's software. AVerMedia's CamEngine and VoiceEngine software can already enable Broadcast features.

In order to use NVIDIA Broadcast effects in these apps, users must install the NVIDIA Broadcast redistributable package and update apps to the latest version.

And remember, GeForce GPU owners also have direct access to the NVIDIA Encoder (NVENC), an independent section of the GPU where encoding gets offloaded to. It's used by OBS Studio, XSplit, Streamlabs, Discord and more to improve streaming performance.

View at TechPowerUp Main Site

 

[ZoneDymo]

"reduces VRAM usage by over 40%, leading to an increase in FPS while gaming."

but.....why?

apart from that, as cringy as this all may be to read, it is a market where AMD's radeon group should really...be present in

 

[dyonoctis]

"reduces VRAM usage by over 40%, leading to an increase in FPS while gaming."

but.....why?

apart from that, as cringy as this all may be to read, it is a market where AMD's radeon group should really...be present in

I agree, AMD is pretty active when it comes to game tech (TressFX, mantle etc...) but their "direct to consumer" product, and their presence in VFX/editing software is really lacking... their products are great, but the ecosystem doesn't exist, if you are doing anything beyond gaming, there is no added value, when a RTX GPU open the gates to many things to tinker with (like Nvidia omniverse)

 

[ixi]

Well, personally I don't even know one soul who is using this...

Maybe someone from tpu is using this? Is there even a point from this?

 

[Sandbo]

I have been using RTX Voice, when it is being used on its own it's amazing which cuts off background noise so much that my friend sometimes had to ask to see if I am disconnected.
However, if you don't use a headphone of sort and you use speaker, any sound from the PC tends to interfere the RTX voice feature heavily and made the other side unable to hear me.

For other features, I think they are more or less doable by Zoom or Skype without the GPU.
I suppose RTX Voice has alternative too (without GPU) but I haven't compared any.

 

[dyonoctis]

Well, personally I don't even know one soul who is using this...

Maybe someone from tpu is using this? Is there even a point from this?

it depends on where you live, and your setup. If you have a professional room with sound dampening, live in a quite house then sure, you won't get much use from it, but if you are like me and living in a noisy flat, then it's great, since it manages to cancel the sounds of my roommate raging when he plays

The background replacement/blur is also really fast to use, if A.I get good enough, some people won't have to go through the trouble of having a physical green screen. The target is budget streamers, or people who need to look more "professional" for remote work without breaking the bank too much. (Wich is especially true now that even 3050 have tensor cores).

 

[Hyrel]

Well, personally I don't even know one soul who is using this...

Maybe someone from tpu is using this? Is there even a point from this?

I'm that soul! The voice noise cancellation is incredibly good, like miles better than Discord's noise suppression thing or any other software solution I tried. I'm not doing professional recordings or anything, but I play MMOs and online games in voice chat with friends, and my loud mechanical keyboard is really bothersome; Nvidia Broadcast (or former RTX Voice) allows me to not even use Push to Talk and smash the keyboard to my heart's content without anyone hearing nothing but my perfectly clear voice.

 

[Sybaris_Caesar]

I agree, AMD is pretty active when it comes to game tech (TressFX, mantle etc...) but their "direct to consumer" product, and their presence in VFX/editing software is really lacking... their products are great, but the ecosystem doesn't exist, if you are doing anything beyond gaming, there is no added value, when a RTX GPU open the gates to many things to tinker with (like Nvidia omniverse)

Ehh... At this point we shouldn't hold our breath. Direct-to-consumer, direct-to-developer, direct-to-prosumer nothing has AMD presence. You're an impressionable youth whose active on social media, Nvidia got your attention with game and even GPU giveaways. You're an up and coming content creator or professional gamer, Nvidia or Nvidia affiliated brand's will sponsor you. You're an small time game dev with interesting project, Nvidia will happily AND quickly help you if you ask them. Hell, if you're lucky they'll even hook you up with Nvidia gear. You're doing a VFX/ML-AI project, Nvidia might even sponsor your project.

AMD marketing just sucks ass. I'd argue game development is their primary forte since almost all other GPU use cases is dominated by Nvidia and even there loads of devs say AMD either never responds to query or sends half-hazard documentation instead of human contact. Few weeks ago I was watching Prey (2017) credits rolling (cause the songs are banger) and the section of Nvidia and AMD rolled up. Almost a dozen or so people from Nvidia compared to 3-4 from AMD. Either Arkane (the developer) were very versed in AMD hardware and din't need help or it's AMD being the usual.

 

[Franzen4Real]

I have been using RTX Voice, when it is being used on its own it's amazing which cuts off background noise so much that my friend sometimes had to ask to see if I am disconnected.
However, if you don't use a headphone of sort and you use speaker, any sound from the PC tends to interfere the RTX voice feature heavily and made the other side unable to hear me.

I have the exact opposite experience, been using since launch. I use a Yeti Blue mic on my desktop and play through an AVR/speakers (usually quite loudly). The mic sits closer to the speakers than it does to me, and the only thing people I'm playing with can hear is my voice with no issue. The only time that I do get interference is with spoken dialog in game. In those cases I just hit a mute keybind until the NPC's are done talking if I'm playing loud enough for it to pick up. The only thing more I could ask for from Broadcast is if they could someway come up with a filter that is analyzing the sound being output from the pc (in my case in game dialog) and cancel it as well. Other than that, I'm very happy with it.

 

[Slizzo]

Well, personally I don't even know one soul who is using this...

Maybe someone from tpu is using this? Is there even a point from this?

I've been using NVIDIA Broadcast ever since there was integration in Discord.

Now I can eat, pound keys on my clicky keyboard, have a big fan on at my back, and my friend's can't hear any of that except my voice when I'm talking. It's a really helpful program, and having it take up less resources will be very welcome.

 

[cvaldes]

Well, personally I don't even know one soul who is using this...

Maybe someone from tpu is using this? Is there even a point from this?

Well, I use it.

Note that Nvidia Broadcast handles microphone, speaker and video processing and you are not restricted to only one modification.

I primarily use it for video noise reduction since my webcam is a cheapo Logitech C270 model (about $25) that doesn't have the best image quality. It also has a number of useful video effects such as background blur (for more privacy/fewer distractions if you're calling from home) or humorous effects (Oval Office backdrop or the Death Star hangar). The face centering effect is probably handy for people who move their head a lot.

As mentioned above, noise cancellation for the microphone will eliminate distractions like keyboard clicks, the gardener's leaf blower, etc.

 

[Camm]

Discords Krisp works better than RTX Voice/Broadcast afaic, and doesn't need a painfully high GPU clock and utilisation to work.

But Krisp isn't free in the stand alone version, and the virtual camera function is easy to use, so I use it for some things.

Is there better solutions? Incredibly so, but if you paid the Nvidia tax, its free.

 

[Mussels]

I used the old version but found it'd cut my voice out at times, sounds like they found out why

 

[Tsukiyomi91]

might consider trying this out.

 

[dyonoctis]

Discords Krisp works better than RTX Voice/Broadcast afaic, and doesn't need a painfully high GPU clock and utilisation to work.

But Krisp isn't free in the stand alone version, and the virtual camera function is easy to use, so I use it for some things.

Is there better solutions? Incredibly so, but if you paid the Nvidia tax, its free.

Krsip was made to filter out noise that doesn't sound like the human voice (Wich is why people can still hear my roommates talking, even though we aren't in the same room) while RTX is made to filter any background noise, including voice from people "far away". For my use case RTX works better

 

[Tardian]

Where is the link in the article to download the App?

 

[stimpy88]

And the download link?

 

[Slizzo]

Where is the link in the article to download the App?

And the download link?

It's very easy to find this on NVIDIA's own site.

But for the lazy...

Go Live With NVIDIA GeForce RTX

Steal The Show With Incredible Graphics, Powerful AI Effects & Smooth, Stutter-Free Streaming

www.nvidia.com

 

[c2DDragon]

Cries in GTX

RTX 2060 minimum needed meh...

 

[Tardian]

But for the lazy...

I resemble that remark! Thanks anyway.

 

[stimpy88]

It's very easy to find this on NVIDIA's own site.

But for the lazy...

Go Live With NVIDIA GeForce RTX

Steal The Show With Incredible Graphics, Powerful AI Effects & Smooth, Stutter-Free Streaming

www.nvidia.com

Yeah, it's very lazy, and unprofessional of a journalist to publish this kind of article/press release without including a link.

You should learn sarcasm.

 

[Sandbo]

I have the exact opposite experience, been using since launch. I use a Yeti Blue mic on my desktop and play through an AVR/speakers (usually quite loudly). The mic sits closer to the speakers than it does to me, and the only thing people I'm playing with can hear is my voice with no issue. The only time that I do get interference is with spoken dialog in game. In those cases I just hit a mute keybind until the NPC's are done talking if I'm playing loud enough for it to pick up. The only thing more I could ask for from Broadcast is if they could someway come up with a filter that is analyzing the sound being output from the pc (in my case in game dialog) and cancel it as well. Other than that, I'm very happy with it.

I am actually using Audio Technica AT2035 w/ Scarlette Solo, which on their own are very directional and pretty good at shielding background noise, but RTX Voice did help further but interfere in the case I mentioned.

 

[dayne878]

I love the NVIDIA Broadcast software. I sit in cavernous room with a noisy mechanical keyboard and computer fans on in the background and this software makes it so I don't even need to mute my microphone on Teams or Zoom meetings - if I don't talk nothing gets transmitted through the microphone.

I've even used it for recording videos and even a short audiobook and for the most part there was very, very little background noise with this software. With no space/money for me to set up a recording room, this software helps an amateur like myself. I also like the background blur, as instead of having to make sure its set in Teams or Zoom it's "hard-coded" into the video feed as long as I have NVIDIA Broadcast selected as the source. That way no matter what video recording software I'm using I'll always have the blurred background.

My only complaint is sometimes it will stop working (with no warning), so I often will close and re-open it or at least perform a test in Teams or Zoom or in the Broadcast software itself before I go into an important meeting so that I don't run into the embarrassing situation where my microphone isn't working and I have to quickly switch to the default (noisy) microphone without Broadcast.