Integrated camera and hearing interface device

Abstract

A hearing interface device for generating processed audio signals is disclosed. In one implementation, the hearing interface device may include a housing configured to be at least partially inserted into an ear of a user, a microphone, a camera, and a processor included in the housing. The processor may be configured to receive a captured audio signal representative of sounds captured by the microphone; receive an image captured by the camera; generate a processed audio signal based on analysis of at least one of the captured audio signal or the image; and cause at least a portion of the processed audio signal to be presented to the ear of the user.

What is claimed is: 
     
         1 . A hearing interface device for generating processed audio signals, the hearing interface device comprising:
 a housing configured to be at least partially inserted into an ear of a user of the hearing interface device;   at least one microphone associated with the housing, the at least one microphone being configured to capture sounds from an environment of the hearing interface device;   at least one camera associated with the housing, the at least one camera being configured to capture a plurality of images from the environment of the hearing interface device; and   at least one processor included in the housing, the at least one processor being programmed to:
 receive a captured audio signal representative of the sounds captured by the at least one microphone; 
 receive at least one image of the plurality of images captured by the at least one camera; 
 generate a processed audio signal based on analysis of at least one of the captured audio signal or the at least one image; and 
 cause at least a portion of the processed audio signal to be presented to the ear of the user. 
   
     
     
         2 . The hearing interface device of  claim 1 , wherein the at least one processor is further programmed to cause an insertion indication to be presented to the ear of the user when at least a portion of the housing is inserted into the ear of the user. 
     
     
         3 . The hearing interface device of  claim 2 , wherein the at least one processor is further programmed to determine whether the housing is correctly inserted into the ear of the user, and wherein the insertion indication comprises a first sound when the housing is correctly inserted into the ear of the user and a second sound when the housing is not correctly inserted into the ear of the user. 
     
     
         4 . The hearing interface device of  claim 3 , wherein the determination whether the housing is correctly inserted into the ear of the user is based on an indication received from an accelerometer included in the housing. 
     
     
         5 . The hearing interface device of  claim 1 , wherein the at least one camera has an angle of view between 50 degrees to 120 degrees. 
     
     
         6 . The hearing interface device of  claim 1 , wherein generating the processed audio signal includes amplifying a voice of an individual represented in the captured audio signal relative to at least one additional sound. 
     
     
         7 . The hearing interface device of  claim 6 , wherein amplifying the voice of the individual includes separating the voice of the individual from the at least one additional sound. 
     
     
         8 . The hearing interface device of  claim 6 , wherein the at least one additional sound includes a background noise, and wherein amplifying the voice of the individual relative to the at least one additional sound includes attenuating the background noise. 
     
     
         9 . The hearing interface device of  claim 6 , wherein amplifying the voice of the individual includes identifying the individual based on the at least one image. 
     
     
         10 . The hearing interface device of  claim 6 , wherein amplifying the voice of the individual includes tracking a lip movement of the individual represented in the at least one image. 
     
     
         11 . The hearing interface device of  claim 6 , wherein amplifying the voice of the individual includes identifying the individual based on a voice signature associated with the individual. 
     
     
         12 . The hearing interface device of  claim 1 , wherein the at least one processor is further programmed to:
 receive, from an external source, a request to provide information for locating the hearing interface device;   cause locating information to be captured from the environment of the hearing interface device based on the received request, the locating information including at least one of a locating image captured using the at least one camera or a locating audio signal obtained using the at least one microphone; and   transmit the locating information to a predetermined destination.   
     
     
         13 . The hearing interface device of  claim 1 , wherein the at least one processor is further programmed to:
 detect a condition associated with the hearing interface device; and   cause a status indication to be presented to the ear of the user based on the detected condition.   
     
     
         14 . The hearing interface device of  claim 13 , wherein the condition includes an obstruction of a field of view of the at least one camera and wherein the condition is detected based on analysis of the at least one image. 
     
     
         15 . The hearing interface device of  claim 1 , wherein the at least one processor is further programmed to receive data obtained from an associated hearing interface device configured to be at least partially inserted into an additional ear of the user and wherein the processed audio signal is further generated based on analysis of the received data. 
     
     
         16 . The hearing interface device of  claim 15 , wherein the associated hearing interface device is configured to:
 capture an additional captured audio signal from the environment of the associated hearing interface device; and   capture an additional image from the environment of the associated hearing interface; and   wherein the received data is generated by the associated hearing interface device based on at least one of the additional captured audio signal or the additional image.   
     
     
         17 . The hearing interface device of  claim 16 , wherein the received data includes at least one of a voice signature or a facial feature of an individual in the environment of the user, the voice signature or the facial feature being determined by the associated hearing interface device based on at least one of the additional captured audio signal or the additional image. 
     
     
         18 . The hearing interface device of  claim 17 , wherein the at least one processor is further configured to determine at least one of an additional facial feature or an additional voice signature of an additional individual based on at least one of the captured audio signal or the at least one image, the additional individual being different from the individual. 
     
     
         19 . The hearing interface device of  claim 16 , wherein generating the processed audio signal includes determining a direction of at least one audio source represented in the captured audio signal, the direction being determined based on:
 a first indication of direction of the audio source determined based on the captured audio signal; and   a second indication of direction of the audio source included in the received data.   
     
     
         20 . A method for generating processed audio signals by at least one processor included in a housing of a hearing interface device, method comprising:
 receiving a captured audio signal representative of sounds captured from an environment of the hearing interface device by at least one microphone associated with the housing;   receiving at least one image captured from the environment of the hearing interface device by at least one camera associated with the housing;   generating a processed audio signal based on analysis of at least one of the captured audio signal or the at least one image; and   causing at least a portion of the processed audio signal to be presented to the ear of the user.