Adaptive noise cancellation for multiple audio endpoints in a shared space

Abstract

Techniques for adaptive noise cancellation for multiple audio endpoints in a shared space are described. According to one example, a method includes detecting, by a first audio endpoint, one or more audio endpoints co-located with the first audio endpoint at a first location. A selected audio endpoint of the one or more audio endpoints is identified as a target noise source. The method includes obtaining, from the selected audio endpoint, a loudspeaker reference signal associated with a loudspeaker of the selected audio endpoint and removing the loudspeaker reference signal from a microphone signal associated with a microphone of the first audio endpoint. The method also includes providing the microphone signal from the first audio endpoint to at least one of a voice user interface (VUI) or a second audio endpoint, wherein the second audio endpoint is located remotely from the first location.

What is claimed is: 
     
       1. A method comprising:
 detecting, by a first audio endpoint, one or more a second audio endpoints endpoint co-located with the first audio endpoint at a first location; 
 identifying a selected audio endpoint of the one or more audio endpoints as a target noise source; 
 obtaining, from the selected second audio endpoint, a loudspeaker reference signal associated with a loudspeaker of the selected second audio endpoint; 
 removing the loudspeaker reference signal from a microphone signal associated with a microphone of the first audio endpoint to generate an adjusted microphone signal; and 
 providing the adjusted microphone signal from the first audio endpoint to at least one of a voice user interface (VUI) or a second third audio endpoint, wherein the second third audio endpoint is located remotely from the first location. 
 
     
     
       2. The method of  claim 1 , wherein detecting the one or more second audio endpoints endpoint comprises obtaining an ultrasonic signal from the one or more second audio endpoints endpoint. 
     
     
       3. The method of  claim 1 , further comprising: 
 removing an echo from the microphone signal. 
 
     
     
       4. The method of  claim 1 , wherein identifying the selected second audio endpoint is detected as the a target noise source comprises based at least in part upon obtaining from the one or more audio endpoints at least one of a decibel level, an ultrasonic receive level, an indication of a distance and/or a direction, or metadata from the second audio endpoint. 
     
     
       5. The method of  claim 4 , further comprising:
 using a microphone array to determine the a distance to and/or a direction of the one or more second audio endpoints endpoint from the first audio endpoint in the first location; and 
 using the obtained distance and/or direction to identify the selected second audio endpoint as the target noise source. 
 
     
     
       6. The method of  claim 1 , further comprising:
 obtaining an audio stream from, from the second audio endpoint, a microphone reference signal associated with at least one microphone associated with of the selected second audio endpoint, wherein the microphone reference signal corresponds to an audio stream that is input to the at least one microphone, and the adjusted microphone signal is also based at least in part upon the microphone reference signal. 
 
     
     
       7. The method of  claim 6 , further comprising:
 providing the audio stream as a microphone reference signal to an adaptive filter at the first audio endpoint to remove the audio stream from the microphone signal of the first audio endpoint.   
     
     
       8. An apparatus comprising:
 a microphone; 
 a loudspeaker; 
 a processor in communication with the microphone and the loudspeaker, the processor configured to:
 detect one or more an audio endpoints endpoint co-located with the apparatus at a first location; 
 identify a selected audio endpoint of the one or more audio endpoints as a target noise source; 
 obtain, from the selected audio endpoint, a loudspeaker reference signal associated with a loudspeaker of the selected audio endpoint; 
 remove the loudspeaker reference signal from a microphone signal associated with the microphone to generate an adjusted microphone signal; and 
 provide the adjusted microphone signal to at least one of a voice user interface (VUI) or a remote audio endpoint, wherein the remote audio endpoint is located remotely from the first location. 
 
 
     
     
       9. The apparatus of  claim 8 , wherein the processor is configured to detect the one or more audio endpoints by endpoint is detected based at least in part upon obtaining an ultrasonic signal from the one or more audio endpoints endpoint. 
     
     
       10. The apparatus of  claim 8 , wherein the processor is further configured to: 
 remove an echo from the microphone signal. 
 
     
     
       11. The apparatus of  claim 8 , wherein the processor is configured to identify the selected audio endpoint is detected as the a target noise source by based at least in part upon obtaining from the one or more audio endpoints at least one of a decibel level, an ultrasonic receive level, an indication of a distance and/or a direction, or metadata from the audio endpoint. 
     
     
       12. The apparatus of  claim 11 , wherein the processor is further configured to:
 use a microphone array to determine the a distance to and/or a direction of the one or more audio endpoints endpoint from the apparatus in the first location; and 
 use the obtained distance and/or direction to identify the selected audio endpoint as the target noise source. 
 
     
     
       13. The apparatus of  claim 8 , wherein the processor is further configured to obtain an audio stream from a microphone reference signal associated with at least one microphone associated with of the selected audio endpoint, wherein the microphone reference signal corresponds to an audio stream that is input to the at least one microphone, and the adjusted microphone signal is also based at least in part upon the microphone reference signal. 
     
     
       14. The apparatus of  claim 13 , wherein the processor is further configured to:
 provide the audio stream as a microphone reference signal to an adaptive filter to remove the audio stream from the microphone signal.   
     
     
       15. One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor of a first audio endpoint, cause the processor to:
 detect one or more a second audio endpoints endpoint co-located with the a first audio endpoint at a first location; 
 identify a selected audio endpoint of the one or more audio endpoints as a target noise source; 
 obtain, from the selected second audio endpoint, a loudspeaker reference signal associated with a loudspeaker of the selected second audio endpoint; 
 remove the loudspeaker reference signal from a microphone signal associated with a microphone of the first audio endpoint to generate an adjusted microphone signal; and 
 provide the adjusted microphone signal from the first audio endpoint to at least one of a voice user interface (VUI) or a second third audio endpoint, wherein the second third audio endpoint is located remotely from the first location. 
 
     
     
       16. The one or more non-transitory computer readable storage media of  claim 15 , wherein the instructions further cause the processor to detect the one or more audio endpoints by second audio endpoint is detected based at least in part upon obtaining an ultrasonic signal from the one or more second audio endpoints endpoint. 
     
     
       17. The one or more non-transitory computer readable storage media of  claim 15 , wherein the instructions further cause the processor to: 
 remove an echo from the microphone signal. 
 
     
     
       18. The one or more non-transitory computer readable storage media of  claim 15 , wherein the instructions further cause the processor to identify the selected second audio endpoint is detected as the a target noise source by based at least in part upon obtaining from the one or more audio endpoints at least one of a decibel level, an ultrasonic receive level, an indication of a distance and/or a direction, or metadata from the second audio endpoint. 
     
     
       19. The one or more non-transitory computer readable storage media of  claim 18 , wherein the instructions further cause the processor to:
 use a microphone array to determine the a distance to and/or a direction of the one or more second audio endpoints endpoint from the first audio endpoint in the first location; and 
 use the obtained distance and/or direction to identify the selected second audio endpoint as the target noise source. 
 
     
     
       20. The one or more non-transitory computer readable storage media of  claim 15 , wherein the instructions further cause the processor to:
 obtain an audio stream from a microphone reference signal associated with at least one microphone associated with of the selected second audio endpoint; and 
 provide the audio stream as a microphone reference signal to an adaptive filter to remove the audio stream from the microphone signal, wherein the microphone reference signal corresponds to an audio stream that is input to the at least one microphone, and the adjusted microphone signal is also based at least in part upon the microphone reference signal. 
 
     
     
       21. The method of claim 1, wherein the first audio endpoint and the second audio endpoint are connected to a common local area network (LAN). 
     
     
       22. The method of claim 1, wherein clock synchronization is established between the first audio endpoint and the second audio endpoint. 
     
     
       23. The apparatus of claim 8, wherein the apparatus and the audio endpoint are connected to a common local area network (LAN). 
     
     
       24. The apparatus of claim 8, wherein clock synchronization is established between the apparatus and the audio endpoint. 
     
     
       25. The one or more non-transitory computer readable storage media of claim 15, wherein the first audio endpoint and the second audio endpoint are connected to a common local area network (LAN). 
     
     
       26. The one or more non-transitory computer readable storage media of claim 15, wherein clock synchronization is established between the first audio endpoint and the second audio endpoint.