Thursday, September 2nd 2021
New NVIDIA Broadcast App 1.3 Update Improves Noise Removal, Adds Support for More Cameras, and Reduces System Impact
NVIDIA's tool to enhance both live streaming and video conferencing just got even better. The Broadcast app has transformed the homes, apartments and dorm rooms of millions of content creators, remote students and workers into home studios through the power of AI—all without the need to purchase specialized equipment. The latest upgrade, NVIDIA Broadcast version 1.3, is available to download today and further improves noise removal, adds more camera compatibility, and reduces the impact on overall system performance.
NVIDIA Broadcast's noise removal AI effect has been widely praised for its ability to remove background noise while keeping speech clear and crisp. The exception? When someone speaks with a lot of emotion—typically speaking loudly or at a higher pitch—and their speech is sometimes inadvertently removed. This rarely happens, but is typically at the peak moments of excitement during a livestream. The new update addresses this with dedicated training sound profiles to retain that speech while removing the unwanted background noise.
The community frequently requests more support for video devices. Now many of your favorite professional and virtual cameras, as well as capture cards, are compatible with NVIDIA Broadcast—including Canon EOS Webcam Utility, Nikon Webcam Utility, Sony Webcam Utility, OBS Virtual Camera, and more.
With version 1.2 we added the ability for users to stack effects. VRAM could become limited when multitaskers run AI features for their microphone, speakers and camera simultaneously. Version 1.3 reduces VRAM usage by over 40%, leading to an increase in FPS while gaming.
Finally, we have several new UI elements and bug fixes that round out a better, smoother, NVIDIA Broadcast experience.
NVIDIA Broadcast is an App and an Ecosystem
NVIDIA partners with the top creative app developers to accelerate and enhance content creation using Broadcast technology.
And remember, GeForce GPU owners also have direct access to the NVIDIA Encoder (NVENC), an independent section of the GPU where encoding gets offloaded to. It's used by OBS Studio, XSplit, Streamlabs, Discord and more to improve streaming performance.
NVIDIA Broadcast's noise removal AI effect has been widely praised for its ability to remove background noise while keeping speech clear and crisp. The exception? When someone speaks with a lot of emotion—typically speaking loudly or at a higher pitch—and their speech is sometimes inadvertently removed. This rarely happens, but is typically at the peak moments of excitement during a livestream. The new update addresses this with dedicated training sound profiles to retain that speech while removing the unwanted background noise.
With version 1.2 we added the ability for users to stack effects. VRAM could become limited when multitaskers run AI features for their microphone, speakers and camera simultaneously. Version 1.3 reduces VRAM usage by over 40%, leading to an increase in FPS while gaming.
Finally, we have several new UI elements and bug fixes that round out a better, smoother, NVIDIA Broadcast experience.
NVIDIA Broadcast is an App and an Ecosystem
NVIDIA partners with the top creative app developers to accelerate and enhance content creation using Broadcast technology.
- Live streamers get NVIDIA's noise removal in OBS Studio 27, Streamlabs, XSplit Broadcaster 4.0, or Gamecaster 4, applying effects per audio source, providing more granular control over audio. Add Xaymar's StreamFX plugin for OBS to get NVIDIA's auto frame technology.
- Video editors and podcasters can add NVIDIA noise removal as a VST filter to any compatible apps using Xaymar's VoiceFX. This works in Adobe Premiere Pro, Adobe Audition, or Audacity.
- VFX artists explore Notch's native integration of virtual background, Face Tracking, and 3D Body Tracking, allowing for advanced VFX effects to be seamlessly added.
- Owners of AVerMedia microphones, headsets or cameras get all relevant NVIDIA Broadcast features directly embedded into the device's software. AVerMedia's CamEngine and VoiceEngine software can already enable Broadcast features.
And remember, GeForce GPU owners also have direct access to the NVIDIA Encoder (NVENC), an independent section of the GPU where encoding gets offloaded to. It's used by OBS Studio, XSplit, Streamlabs, Discord and more to improve streaming performance.
22 Comments on New NVIDIA Broadcast App 1.3 Update Improves Noise Removal, Adds Support for More Cameras, and Reduces System Impact
but.....why?
apart from that, as cringy as this all may be to read, it is a market where AMD's radeon group should really...be present in
Maybe someone from tpu is using this? Is there even a point from this?
However, if you don't use a headphone of sort and you use speaker, any sound from the PC tends to interfere the RTX voice feature heavily and made the other side unable to hear me.
For other features, I think they are more or less doable by Zoom or Skype without the GPU.
I suppose RTX Voice has alternative too (without GPU) but I haven't compared any.
The background replacement/blur is also really fast to use, if A.I get good enough, some people won't have to go through the trouble of having a physical green screen. The target is budget streamers, or people who need to look more "professional" for remote work without breaking the bank too much. (Wich is especially true now that even 3050 have tensor cores).
AMD marketing just sucks ass. I'd argue game development is their primary forte since almost all other GPU use cases is dominated by Nvidia and even there loads of devs say AMD either never responds to query or sends half-hazard documentation instead of human contact. Few weeks ago I was watching Prey (2017) credits rolling (cause the songs are banger) and the section of Nvidia and AMD rolled up. Almost a dozen or so people from Nvidia compared to 3-4 from AMD. Either Arkane (the developer) were very versed in AMD hardware and din't need help or it's AMD being the usual.
Now I can eat, pound keys on my clicky keyboard, have a big fan on at my back, and my friend's can't hear any of that except my voice when I'm talking. It's a really helpful program, and having it take up less resources will be very welcome.
Note that Nvidia Broadcast handles microphone, speaker and video processing and you are not restricted to only one modification.
I primarily use it for video noise reduction since my webcam is a cheapo Logitech C270 model (about $25) that doesn't have the best image quality. It also has a number of useful video effects such as background blur (for more privacy/fewer distractions if you're calling from home) or humorous effects (Oval Office backdrop or the Death Star hangar). The face centering effect is probably handy for people who move their head a lot.
As mentioned above, noise cancellation for the microphone will eliminate distractions like keyboard clicks, the gardener's leaf blower, etc.
But Krisp isn't free in the stand alone version, and the virtual camera function is easy to use, so I use it for some things.
Is there better solutions? Incredibly so, but if you paid the Nvidia tax, its free.
But for the lazy...
www.nvidia.com/en-us/geforce/broadcasting/
RTX 2060 minimum needed meh...
You should learn sarcasm.
I've even used it for recording videos and even a short audiobook and for the most part there was very, very little background noise with this software. With no space/money for me to set up a recording room, this software helps an amateur like myself. I also like the background blur, as instead of having to make sure its set in Teams or Zoom it's "hard-coded" into the video feed as long as I have NVIDIA Broadcast selected as the source. That way no matter what video recording software I'm using I'll always have the blurred background.
My only complaint is sometimes it will stop working (with no warning), so I often will close and re-open it or at least perform a test in Teams or Zoom or in the Broadcast software itself before I go into an important meeting so that I don't run into the embarrassing situation where my microphone isn't working and I have to quickly switch to the default (noisy) microphone without Broadcast.