NVIDIA Unveils RTX Voice, AI-based Audio Noise-Cancellation Software

[dyonoctis]

Everyone can read the eula if you unzip the exe with 7zip. It doesn't mention telemetry.
Some people might just feel like everyone are getting paranoid with spying when it's not that hard to stay private if you care that much about it :

And looking at the app requirement along with it's lack of publicity, it's not going to be a mainstream thing where you'll have to ask everyone if they are using it to before going in a call.

Miss? Aren't you mixing things up? How record latency affects that? Dedicated HW is always better that unified AIO for all. The HW route from the microphone array correctly set up eliminates need for such nonsense thing... that mic outputs nice and clean linear out. The solutions are already there, for years... including your mobile devices, that actually sound pretty fine, ain't it?

The market for this app is a bit odd, it's for people who don't care enough to buy dedicated hardware, but wouldn't mind using a free app as a commodity. People who are actually serious about audio recording (seasoned streamers) are not concerned by this. That app is also claiming to "clean" noisy output, it doesn't just stop at recording.

 

[Ferrum Master]

The market for this app is a bit odd, it's for people who don't care enough to buy dedicated hardware, but wouldn't mind using a free app as a commodity. People who are actually serious about audio recording (seasoned streamers) are not concerned by this.

I just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all? making fun of @Chomiq wasn't really a good idea, as there could be a valid point.

 

[Deleted member 50521]

Developer: Here, we got you some nice FREE tools to help your video conferencing.

Some TPU members: Free? What is the catch? Are you transmitting CRISPR protein to my brain via your evil 5G based signal to give me testacle cancer and look at my porn browsing history??

 

[notb]

I just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all?

Hmm... so after 2 of your comments, I must ask. Are you sure that you understand what this software does?

Also, since I'm not into electronics, I have no idea what the parts you've mentioned do. So another question: you expect me to learn that and build a preamp? Or what exactly?
Why do you think utilizing AI is harder to implement than building some circuitry is beyond me.

 

[dyonoctis]

I just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all? making fun of @Chomiq wasn't really a good idea, as there could be a valid point.

The noise cancelling in smartphones is hardware based. Just like the NC headphones They have a second mic besides the one used for calls.

Part of me just don't believe that Nvidia is stupid enough to make a spyware and hide it, when there will be a backlash for doing so. With GPP they already know that people aren't going to get behind every bulls**t that they do.

 

[R0H1T]

Part of me just don't believe that Nvidia is stupid enough to make a spyware and hide it, when there will be a backlash for doing so.

For once I'd like to apply the oft-used phrase ~ don’t attribute to malice what you can attribute to incompetence! Which is to say that while Nvidia may not have malicious intent behind it, though implementation of the tech & total transparency into what or how they're using user data is needed here. Just as was the case with CA & Facebook btw how did that work out for the latter ~ are they bankrupt yet? No, so why do you think Nvidia ~ given what they did in the past with endeavors such as bumpgate or the last one 970-gate, would be punished (user backlash doesn't work much in the real world IMO) to the extent that they don't repeat it?

As far as I'm concerned it's always nice to be skeptical about big govt & megacorps, there's about an even chances that your fears aren't dumbfounded based on the other oft-used phrase ~ Just Because You’re Paranoid Doesn’t Mean They’re Not Out to Get You

 

[Ferrum Master]

Hmm... so after 2 of your comments, I must ask. Are you sure that you understand what this software does?

Also, since I'm not into electronics, I have no idea what the parts you've mentioned do. So another question: you expect me to learn that and build a preamp? Or what exactly?

These parts do exactly what this software does. These are just examples, for your suited MIC, there are plenty of them as specialized IC's after driving any casual MEMS type microphones. Noise cancelling on HW level isn't something complicated... any simple device has it now... the tech is decades old.

If you look into Snapdragon HEXAGON includes custom DSP dedicated to the task, some things taken from Conexant IP. If you remember the HP scandal with Superfish, a keylogger that came in... it resided exactly in the MIC recorder app from Conexant audio driver package and started on such low ring level... Well... khrmm... like it didn't happen before eh?

The most gentle way is to press a damn button on the device - MIC... and everything works... There is no software layer needed, no drivers, no latency, zero issues. RTX? AI? Quit joking people.

And FFS it is snowing outside...

 

[dyonoctis]

These parts do exactly what this software does. These are just examples, for your suited MIC, there are plenty of them as specialized IC's after driving any casual MEMS type microphones. Noise cancelling on HW level isn't something complicated... any simple device has it now... the tech is decades old.

If you look into Snapdragon HEXAGON includes custom DSP dedicated to the task, some things taken from Conexant IP. If you remember the HP scandal with Superfish, a keylogger that came in... it resided exactly in the MIC recorder app from Conexant audio driver package and started on such low ring level... Well... khrmm... like it didn't happen before eh?

The most gentle way is to press a damn button on the device - MIC... and everything works... There is no software layer needed, no drivers, no latency, zero issues. RTX? AI? Quit joking people.

And FFS it is snowing outside...

You are making a huge emphasis on the input part. While i agree that nowadays getting a decent mic with build in NC is simplier, that app is also working on output that are noisy. Like that low budget youtuber who doesn't know what a windshield is for. In theory, you as the watcher won't have to deal with that because the A.I will try to clean the wind. wheither it's effective or not is another question ‍

 

[TheoneandonlyMrK]

I just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all? making fun of @Chomiq wasn't really a good idea, as there could be a valid point.

My first thought seeing it was yay please cancel out my mates kid's while in disco chatting, if it doesn't work it'll be uninstalled and moaned about here later.

 

[Ferrum Master]

You are making a huge emphasis on the input part. While i agree that nowadays getting a decent mic with build in NC is simplier, that app is also working on output that are noisy. Like that low budget youtuber who doesn't know what a windshield is for. In theory, you as the watcher won't have to deal with that because the A.I will try to clean the wind. wheither it's effective or not is another question ‍♂

The HW IC's are intelligent enough... our voice medium isn't anything that special, thus cut out the other unwanted things can be done pretty straightforward and solutions exist for any tastes and needs, you name it. Even simplest iphone airpods have it included as feature set in the amplifier/RF part a combo. So HW solution is there already, that's what I am saying. There are dozens of them... need for another SW one? Makers take care of it already.

For example there's a nuclear solution like Cirrus Logic CS47L85 includes HW algos even for word detection, various filtering etc etc, no RTX, no AI. Actually Apple uses the Cirrus Logic IP and they know what they do as Industry vets.

But other than that... we have usually have it included already... even in the Realtek IC. But the point is the ADC part is made so poorly often, look at mobo reviews, the level is like early 70ties in SNR department, nobody understands the numbers, the implementation, you cannot turn dirt into gold. The ALC's do support all the DSP techniques also. But their drivers... and on top of it another layer...? Windows is already full of rubbish.

Why on earth other consumer device have made proper solutions that work fine? There shouldn't be issues in the first place for nvidia even to bother about it.

 

[TheoneandonlyMrK]

The HW IC's are intelligent enough... our voice medium isn't anything that special, thus cut out the other unwanted things can be done pretty straightforward and solutions exist for any tastes and needs, you name it. Even simplest iphone airpods have it included as feature set in the amplifier/RF part a combo. So HW solution is there already, that's what I am saying. There are dozens of them... need for another SW one? Makers take care of it already.

For example there's a nuclear solution like Cirrus Logic CS47L85 includes HW algos even for word detection, various filtering etc etc, no RTX, no AI. Actually Apple uses the Cirrus Logic IP and they know what they do as Industry vets.

But other than that... we have usually have it included already... even in the Realtek IC. But the point is the ADC part is made so poorly often, look at mobo reviews, the level is like early 70ties in SNR department, nobody understands the numbers, the implementation, you cannot turn dirt into gold. The ALC's do support all the DSP techniques also. But their drivers... and on top of it another layer...? Windows is already full of rubbish.

Why on earth other consumer device have made proper solutions that work fine? There shouldn't be issues in the first place for nvidia even to bother about it.

I have not seen much for cleaning up the output you receive from others though, could be good, hopefully.
It is a shame your other points are right and true , it's a shame so much tech gets poorly used.

 

[DeathtoGnomes]

Developer: Here, we got you some nice FREE tools to help your video conferencing.

Some TPU members: Free? What is the catch? Are you transmitting CRISPR protein to my brain via your evil 5G based signal to give me testacle cancer and look at my porn browsing history??

Common Knowledge, Question EVERYTHING!

 

[Ferrum Master]

I have not seen much for cleaning up the output you receive from others though, could be good, hopefully.
It is a shame your other points are right and true , it's a shame so much tech gets poorly used.

Well, considering the amount of crap that comes opening voice channel in online shooters... There is no hope for humanity at all. You barely can decipher what some are mumbling, just by definition. No AI can help with that. We are trying to fix things from the wrong side. The PC HW MIC recording part is at poor state and gimped versus other platforms. That should be fixed once and for all.

 

[Turmania]

If you want privacy. You buy another pc and make sure it is not connected to anything even your own modem and network.

 

[champsilva]

If you want privacy. You buy another pc and make sure it is not connected to anything even your own modem and network.

Well, you can't even have monitor because:

Have fun!

 

[TheoneandonlyMrK]

Well, you can't even have monitor because:

Have fun!

Fascinating use of technology that.

So extreme it doesn't concern you unless you are a drug baron, alt right extremist or terrorist, but dammmmnn still.

 

[semantics]

Well, considering the amount of crap that comes opening voice channel in online shooters... There is no hope for humanity at all. You barely can decipher what some are mumbling, just by definition. No AI can help with that. We are trying to fix things from the wrong side. The PC HW MIC recording part is at poor state and gimped versus other platforms. That should be fixed once and for all.

People just need to buy decent mics and ditch things like wireless headsets which just don't have the bandwidth to do both and stay low latency. This kind of software is probably good for filtering out more static background noise which is a good piece of tech to develop.

Developer: Here, we got you some nice FREE tools to help your video conferencing.

Some TPU members: Free? What is the catch? Are you transmitting CRISPR protein to my brain via your evil 5G based signal to give me testacle cancer and look at my porn browsing history??

It's more of narcissism, no body cares to specifically spy on you. It's all incidental in order to get large data sets to train their AI or w.e. I image if nvidia is gathering this stuff it's for development of software for noise cancellation that allows speech though but blocks everything else. Something that might be valued with more active noise cancellation wireless earbuds and just general industrial use.

 

[notb]

If you want privacy. You buy another pc and make sure it is not connected to anything even your own modem and network.

Which changes absolutely nothing. The stuff that need you to access the Internet would have to be performed on the connected PC anyway.

These parts do exactly what this software does. These are just examples, for your suited MIC, there are plenty of them as specialized IC's after driving any casual MEMS type microphones. Noise cancelling on HW level isn't something complicated... any simple device has it now... the tech is decades old.

So if you're so sure that the hardware you said does the same stuff, would you finally say what the software does - according to you?

Also, you're throwing more and more information about noise cancelling hardware and so on. About buying better microphones and preamps. Seriously. Do you expect people to get all that stuff for work?
I'm sure many gamers decide to burn some more money on streaming equipment after they fill saturated with fps, but what Nvidia skunkworks provided works with any microphone. That's its second biggest strength. The first one is what it's actually doing and what you don't understand.

 

[champsilva]

Fascinating use of technology that.

So extreme it doesn't concern you unless you are a drug baron, alt right extremist or terrorist, but dammmmnn still.

It's what i say, some people are so concern about their privacy, but today privacy is something trick.
I bet this guy doesnot even use VPN 24/7 with kill switch.

 

[Ferrum Master]

Do you expect people to get all that stuff for work?

You don't understand that it HAS to work by default already without any additional skunk work.

 

[notb]

You don't understand that it HAS to work by default already without any additional skunk work.

I don't understand, honestly.
I have a laptop, I use it for meeings. Tell me how I can make all the unwanted sound disappear without software and "skunk work".

And once again, whatever the hardware you suggested does, it surely doesn't replicate what can be done with software. Not possible.

 

[Cheeseball]

There are no outbound network packets from the software unless you click on the Send Feedback link on the bottom of the app.

You can also run the app offline, in case anyone was wondering. It looks like its going through the Core Audio API in Windows 10.

 

[Steevo]

So it listens to both ends of the conversation. What's the privacy policy? Is it sending anything back to NV servers?

Works best with Zoom, the new China based conference software.....

 

[TheoneandonlyMrK]

Works alright turned down to half way.

Muting your own output works really stupidly, it doesn't tidy up your mic output it muted your whole PC's sound output, kinda useless.
But it was configurable to only work on incoming sound, like this it works well, though I turned it down half way to reduce vocal cutouts.

This was using discord.

 

[Prince Valiant]

Why do so many people have a problem with someone caring about their personal privacy?

I don't understand, honestly.
I have a laptop, I use it for meeings. Tell me how I can make all the unwanted sound disappear without software and "skunk work".

And once again, whatever the hardware you suggested does, it surely doesn't replicate what can be done with software. Not possible.

Buy a headset and adjust the volume.