Friday, April 17th 2020

NVIDIA Unveils RTX Voice, AI-based Audio Noise-Cancellation Software

Perhaps the biggest gripe about attending office calls and meetings from home these days is the background noise - everyone's home. NVIDIA developed an interesting new piece of free software that can help those on desktops cut out background noise in the audio, called RTX Voice, released to web as a beta. The app uses AI to filter out background audio noise not just at your end, but also from the audio of others in your meeting as you receive it (they don't need the app running on their end). The app leverages tensor cores, and requires an NVIDIA GeForce RTX 20-series GPU, Windows 10, and GeForce drivers R410 or later. RTX Voice runs in conjunction with your meetings software. Among the supported ones are Cisco Webex, Zoom, Skype, Twitch, XSplit, OBS, Discord, and Slack. For more information and FAQs, visit the download link.

DOWNLOAD: NVIDIA RTX Voice beta
NVIDIA RTX Voice
Add your own comment

57 Comments on NVIDIA Unveils RTX Voice, AI-based Audio Noise-Cancellation Software

#26
Ferrum Master
dyonoctisThe market for this app is a bit odd, it's for people who don't care enough to buy dedicated hardware, but wouldn't mind using a free app as a commodity. People who are actually serious about audio recording (seasoned streamers) are not concerned by this.
I just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all? making fun of @Chomiq wasn't really a good idea, as there could be a valid point.
Posted on Reply
#27
xkm1948
Developer: Here, we got you some nice FREE tools to help your video conferencing.

Some TPU members: Free? What is the catch? Are you transmitting CRISPR protein to my brain via your evil 5G based signal to give me testacle cancer and look at my porn browsing history??
Posted on Reply
#28
notb
Ferrum MasterI just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all?
Hmm... so after 2 of your comments, I must ask. Are you sure that you understand what this software does? :)

Also, since I'm not into electronics, I have no idea what the parts you've mentioned do. So another question: you expect me to learn that and build a preamp? Or what exactly?
Why do you think utilizing AI is harder to implement than building some circuitry is beyond me.
Posted on Reply
#29
dyonoctis
Ferrum MasterI just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all? making fun of @Chomiq wasn't really a good idea, as there could be a valid point.
The noise cancelling in smartphones is hardware based. Just like the NC headphones They have a second mic besides the one used for calls.

Part of me just don't believe that Nvidia is stupid enough to make a spyware and hide it, when there will be a backlash for doing so. With GPP they already know that people aren't going to get behind every bulls**t that they do.
Posted on Reply
#30
R0H1T
dyonoctisPart of me just don't believe that Nvidia is stupid enough to make a spyware and hide it, when there will be a backlash for doing so.
For once I'd like to apply the oft-used phrase ~ don’t attribute to malice what you can attribute to incompetence! Which is to say that while Nvidia may not have malicious intent behind it, though implementation of the tech & total transparency into what or how they're using user data is needed here. Just as was the case with CA & Facebook btw how did that work out for the latter ~ are they bankrupt yet? No, so why do you think Nvidia ~ given what they did in the past with endeavors such as bumpgate or the last one 970-gate, would be punished (user backlash doesn't work much in the real world IMO) to the extent that they don't repeat it?

As far as I'm concerned it's always nice to be skeptical about big govt & megacorps, there's about an even chances that your fears aren't dumbfounded based on the other oft-used phrase ~ Just Because You’re Paranoid Doesn’t Mean They’re Not Out to Get You :toast:
Posted on Reply
#31
Ferrum Master
notbHmm... so after 2 of your comments, I must ask. Are you sure that you understand what this software does? :)

Also, since I'm not into electronics, I have no idea what the parts you've mentioned do. So another question: you expect me to learn that and build a preamp? Or what exactly?
These parts do exactly what this software does. These are just examples, for your suited MIC, there are plenty of them as specialized IC's after driving any casual MEMS type microphones. Noise cancelling on HW level isn't something complicated... any simple device has it now... the tech is decades old.

If you look into Snapdragon HEXAGON includes custom DSP dedicated to the task, some things taken from Conexant IP. If you remember the HP scandal with Superfish, a keylogger that came in... it resided exactly in the MIC recorder app from Conexant audio driver package and started on such low ring level... Well... khrmm... like it didn't happen before eh?

The most gentle way is to press a damn button on the device - MIC... and everything works... There is no software layer needed, no drivers, no latency, zero issues. RTX? AI? Quit joking people.

And FFS it is snowing outside...
Posted on Reply
#32
dyonoctis
Ferrum MasterThese parts do exactly what this software does. These are just examples, for your suited MIC, there are plenty of them as specialized IC's after driving any casual MEMS type microphones. Noise cancelling on HW level isn't something complicated... any simple device has it now... the tech is decades old.

If you look into Snapdragon HEXAGON includes custom DSP dedicated to the task, some things taken from Conexant IP. If you remember the HP scandal with Superfish, a keylogger that came in... it resided exactly in the MIC recorder app from Conexant audio driver package and started on such low ring level... Well... khrmm... like it didn't happen before eh?

The most gentle way is to press a damn button on the device - MIC... and everything works... There is no software layer needed, no drivers, no latency, zero issues. RTX? AI? Quit joking people.

And FFS it is snowing outside...
You are making a huge emphasis on the input part. While i agree that nowadays getting a decent mic with build in NC is simplier, that app is also working on output that are noisy. Like that low budget youtuber who doesn't know what a windshield is for. In theory, you as the watcher won't have to deal with that because the A.I will try to clean the wind. wheither it's effective or not is another question ‍
Posted on Reply
#33
TheoneandonlyMrK
Ferrum MasterI just wanted to point... well maybe @notb, he has a RTX GPU in his mobile phone... magic you know... yet somehow it works totally fine no questions are really asked. The need of an AI, RTX for such simple thing, it just makes me laugh... its an overkill in any department, thus it leaves the question open, why in hell it is needed in the first place at all? making fun of @Chomiq wasn't really a good idea, as there could be a valid point.
My first thought seeing it was yay please cancel out my mates kid's while in disco chatting, if it doesn't work it'll be uninstalled and moaned about here later.
Posted on Reply
#34
Ferrum Master
dyonoctisYou are making a huge emphasis on the input part. While i agree that nowadays getting a decent mic with build in NC is simplier, that app is also working on output that are noisy. Like that low budget youtuber who doesn't know what a windshield is for. In theory, you as the watcher won't have to deal with that because the A.I will try to clean the wind. wheither it's effective or not is another question ‍♂
The HW IC's are intelligent enough... our voice medium isn't anything that special, thus cut out the other unwanted things can be done pretty straightforward and solutions exist for any tastes and needs, you name it. Even simplest iphone airpods have it included as feature set in the amplifier/RF part a combo. So HW solution is there already, that's what I am saying. There are dozens of them... need for another SW one? Makers take care of it already.

For example there's a nuclear solution like Cirrus Logic CS47L85 includes HW algos even for word detection, various filtering etc etc, no RTX, no AI. Actually Apple uses the Cirrus Logic IP and they know what they do as Industry vets.

But other than that... we have usually have it included already... even in the Realtek IC. But the point is the ADC part is made so poorly often, look at mobo reviews, the level is like early 70ties in SNR department, nobody understands the numbers, the implementation, you cannot turn dirt into gold. The ALC's do support all the DSP techniques also. But their drivers... and on top of it another layer...? Windows is already full of rubbish.

Why on earth other consumer device have made proper solutions that work fine? There shouldn't be issues in the first place for nvidia even to bother about it.
Posted on Reply
#35
TheoneandonlyMrK
Ferrum MasterThe HW IC's are intelligent enough... our voice medium isn't anything that special, thus cut out the other unwanted things can be done pretty straightforward and solutions exist for any tastes and needs, you name it. Even simplest iphone airpods have it included as feature set in the amplifier/RF part a combo. So HW solution is there already, that's what I am saying. There are dozens of them... need for another SW one? Makers take care of it already.

For example there's a nuclear solution like Cirrus Logic CS47L85 includes HW algos even for word detection, various filtering etc etc, no RTX, no AI. Actually Apple uses the Cirrus Logic IP and they know what they do as Industry vets.

But other than that... we have usually have it included already... even in the Realtek IC. But the point is the ADC part is made so poorly often, look at mobo reviews, the level is like early 70ties in SNR department, nobody understands the numbers, the implementation, you cannot turn dirt into gold. The ALC's do support all the DSP techniques also. But their drivers... and on top of it another layer...? Windows is already full of rubbish.

Why on earth other consumer device have made proper solutions that work fine? There shouldn't be issues in the first place for nvidia even to bother about it.
I have not seen much for cleaning up the output you receive from others though, could be good, hopefully.
It is a shame your other points are right and true , it's a shame so much tech gets poorly used.
Posted on Reply
#36
DeathtoGnomes
xkm1948Developer: Here, we got you some nice FREE tools to help your video conferencing.

Some TPU members: Free? What is the catch? Are you transmitting CRISPR protein to my brain via your evil 5G based signal to give me testacle cancer and look at my porn browsing history??
Common Knowledge, Question EVERYTHING! :toast:
Posted on Reply
#37
Ferrum Master
theoneandonlymrkI have not seen much for cleaning up the output you receive from others though, could be good, hopefully.
It is a shame your other points are right and true , it's a shame so much tech gets poorly used.
Well, considering the amount of crap that comes opening voice channel in online shooters... There is no hope for humanity at all. You barely can decipher what some are mumbling, just by definition. No AI can help with that. We are trying to fix things from the wrong side. The PC HW MIC recording part is at poor state and gimped versus other platforms. That should be fixed once and for all.
Posted on Reply
#38
Turmania
If you want privacy. You buy another pc and make sure it is not connected to anything even your own modem and network.
Posted on Reply
#39
champsilva
TurmaniaIf you want privacy. You buy another pc and make sure it is not connected to anything even your own modem and network.
Well, you can't even have monitor because:


Have fun!
Posted on Reply
#40
TheoneandonlyMrK
champsilvaWell, you can't even have monitor because:


Have fun!
Fascinating use of technology that.

So extreme it doesn't concern you unless you are a drug baron, alt right extremist or terrorist, but dammmmnn still.
Posted on Reply
#41
semantics
Ferrum MasterWell, considering the amount of crap that comes opening voice channel in online shooters... There is no hope for humanity at all. You barely can decipher what some are mumbling, just by definition. No AI can help with that. We are trying to fix things from the wrong side. The PC HW MIC recording part is at poor state and gimped versus other platforms. That should be fixed once and for all.
People just need to buy decent mics and ditch things like wireless headsets which just don't have the bandwidth to do both and stay low latency. This kind of software is probably good for filtering out more static background noise which is a good piece of tech to develop.
xkm1948Developer: Here, we got you some nice FREE tools to help your video conferencing.

Some TPU members: Free? What is the catch? Are you transmitting CRISPR protein to my brain via your evil 5G based signal to give me testacle cancer and look at my porn browsing history??
It's more of narcissism, no body cares to specifically spy on you. It's all incidental in order to get large data sets to train their AI or w.e. I image if nvidia is gathering this stuff it's for development of software for noise cancellation that allows speech though but blocks everything else. Something that might be valued with more active noise cancellation wireless earbuds and just general industrial use.
Posted on Reply
#42
notb
TurmaniaIf you want privacy. You buy another pc and make sure it is not connected to anything even your own modem and network.
Which changes absolutely nothing. The stuff that need you to access the Internet would have to be performed on the connected PC anyway.
Ferrum MasterThese parts do exactly what this software does. These are just examples, for your suited MIC, there are plenty of them as specialized IC's after driving any casual MEMS type microphones. Noise cancelling on HW level isn't something complicated... any simple device has it now... the tech is decades old.
So if you're so sure that the hardware you said does the same stuff, would you finally say what the software does - according to you? :)

Also, you're throwing more and more information about noise cancelling hardware and so on. About buying better microphones and preamps. Seriously. Do you expect people to get all that stuff for work?
I'm sure many gamers decide to burn some more money on streaming equipment after they fill saturated with fps, but what Nvidia skunkworks provided works with any microphone. That's its second biggest strength. The first one is what it's actually doing and what you don't understand. :)
Posted on Reply
#43
champsilva
theoneandonlymrkFascinating use of technology that.

So extreme it doesn't concern you unless you are a drug baron, alt right extremist or terrorist, but dammmmnn still.
It's what i say, some people are so concern about their privacy, but today privacy is something trick.
I bet this guy doesnot even use VPN 24/7 with kill switch.
Posted on Reply
#44
Ferrum Master
notbDo you expect people to get all that stuff for work?
You don't understand that it HAS to work by default already without any additional skunk work.
Posted on Reply
#45
notb
Ferrum MasterYou don't understand that it HAS to work by default already without any additional skunk work.
I don't understand, honestly.
I have a laptop, I use it for meeings. Tell me how I can make all the unwanted sound disappear without software and "skunk work". :)

And once again, whatever the hardware you suggested does, it surely doesn't replicate what can be done with software. Not possible.
Posted on Reply
#46
Cheeseball
Not a Potato
There are no outbound network packets from the software unless you click on the Send Feedback link on the bottom of the app.

You can also run the app offline, in case anyone was wondering. It looks like its going through the Core Audio API in Windows 10.
Posted on Reply
#47
Steevo
ChomiqSo it listens to both ends of the conversation. What's the privacy policy? Is it sending anything back to NV servers?
Works best with Zoom, the new China based conference software.....
Posted on Reply
#48
TheoneandonlyMrK
Works alright turned down to half way.

Muting your own output works really stupidly, it doesn't tidy up your mic output it muted your whole PC's sound output, kinda useless.
But it was configurable to only work on incoming sound, like this it works well, though I turned it down half way to reduce vocal cutouts.

This was using discord.
Posted on Reply
#49
Prince Valiant
Why do so many people have a problem with someone caring about their personal privacy?
notbI don't understand, honestly.
I have a laptop, I use it for meeings. Tell me how I can make all the unwanted sound disappear without software and "skunk work". :)

And once again, whatever the hardware you suggested does, it surely doesn't replicate what can be done with software. Not possible.
Buy a headset and adjust the volume.
Posted on Reply
#50
Vayra86
New audio solutions always give me that typical middle-aged man in the attic doing hobbies feeling. The point of it is always questionable, but hey, why not.
Posted on Reply
Add your own comment
Apr 25th, 2024 23:49 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts