Method And System For Audio Adjustment

Abstract

A monoscopic camera comprising one or more image sensors and a depth sensor may generate video based on two-dimensional image data captured via the one or more image sensors and corresponding depth information captured via the depth sensor. The camera may process corresponding audio for the generated video based on the captured depth information. The audio processing may comprise mitigating noise in the corresponding audio, enhancing voice quality in the corresponding audio, and/or enhancing audio quality of the corresponding audio. The camera may be operable to determine, based on the captured depth information, one or more sound paths between a source of the corresponding audio and a microphone utilized to capture the corresponding audio emanating from the source. The processing of the audio may comprise removing portions of the captured audio arriving at the microphone via one or more reflection paths.

What is claimed is: 
     
         1 . A method, comprising:
 in a monoscopic camera comprising one or more image sensors and a depth sensor:
 generating video based on two-dimensional image data captured via the one or more image sensors and corresponding depth information captured via the depth sensor; 
 receiving audio from a microphone corresponding to the video; and 
 adjusting, based on the depth information, a gain of the microphone. 
   
     
     
         2 . The method according to  claim 1 , further comprising determining, based on the depth information, a distance to a source of the audio. 
     
     
         3 . The method according to  claim 2 , further comprising increasing the gain in response to an increase in the distance to the source. 
     
     
         4 . The method according to  claim 2 , further comprising decreasing the gain in response to an decrease in the distance to the source. 
     
     
         5 . The method according to  claim 1 , further comprising adjusting the gain to maintain a constant audio amplitude. 
     
     
         6 . The method according to  claim 1 , wherein the adjusting of the gain occurs in a feedback loop that monitors amplitude of the audio. 
     
     
         7 . The method according to  claim 1 , wherein the audio is continuously adjusted based on a distance to a source including when the source is not making sound. 
     
     
         8 . The method according to  claim 1 , further comprising mitigating noise in the audio based on the depth information. 
     
     
         9 . The method according to  claim 1 , further comprising enhancing voice quality in the audio based on the depth information. 
     
     
         10 . A system comprising:
 one or more circuits for use in a monoscopic camera, the one or more circuits comprising one or more image sensors, a microphone, and a depth sensor, the one or more circuits being operable to:
 generate video based on two-dimensional image data captured via the one or more image sensors and corresponding depth information captured via the depth sensor; 
 receive audio by the microphone corresponding to the video and emanating from a source; and 
 adjust a gain of the microphone based on the depth information. 
   
     
     
         11 . The system according to  claim 10 , wherein the one or more circuits is configured to determine, based on the depth information, a distance to the source of the audio. 
     
     
         12 . The system according to  claim 11 , wherein the one or more circuits is configured to increase the gain in response to an increase in the distance to the source. 
     
     
         13 . The system according to  claim 11 , wherein the one or more circuits is configured to decrease the gain in response to an decrease in the distance to the source. 
     
     
         14 . The system according to  claim 10 , wherein the one or more circuits is configured to adjust the gain to maintain a constant audio amplitude. 
     
     
         15 . The system according to  claim 10 , wherein the one or more circuits is configured to adjust the gain in a feedback loop that monitors amplitude of the audio. 
     
     
         16 . The system according to  claim 10 , wherein the audio is continuously adjusted based on a distance to the source including when the source is not making sound. 
     
     
         17 . The system according to  claim 10 , further comprising mitigating noise in the audio based on the depth information. 
     
     
         18 . The system according to  claim 10 , further comprising enhancing voice quality in the audio based on the depth information. 
     
     
         19 . A method, comprising:
 in a monoscopic camera comprising one or more image sensors, a microphone, and a depth sensor:
 generating video based on two-dimensional image data captured via said one or more image sensors and corresponding depth information captured via the depth sensor; 
 receiving, by the microphone, audio corresponding to the video and emanating from a source in the video; 
 determining a distance from the monoscopic camera to the source based on the depth information; and 
 adjusting, based on the distance to the source, a gain of the microphone thereby maintaining an amplitude of the audio. 
   
     
     
         20 . The method according to  claim 19 , wherein the adjusting of the gain occurs in a feedback loop that monitors the amplitude of the audio.