Apparatus and method for augmenting sight

Abstract

A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.

What is claimed is: 
     
       1. A method of improving the visual function of a user comprising the steps of:
 storing within a non-volatile non-transitory memory associated with an electronic processor of a first electronic device first data relating to a determined vision loss relating to degradation in a predetermined portion of a visual field of view of the user; 
 configuring within the non-volatile non-transitory memory a plurality of sets of second data; each set of second data relating to configuring a mode of operation of a plurality of modes of operation is established in dependence upon the first data and relates to a predetermined subset of a plurality of image processing algorithms applied by the electronic processor; 
 obtaining image data from a second electronic device; 
 modifying a predetermined portion of the obtained image data with the electronic processor to generate modified image data established in dependence upon applying the predetermined subset of the plurality of image processing algorithms associated with a selected mode of operation of the plurality of modes of operation to the predetermined portion of the obtained image data, the predetermined portion of the obtained image data relating to the predetermined portion of the visual field of view of the user; 
 generating combined image data by digitally replacing a portion of data relating to the visual field of view of the user with the modified predetermined portion of the obtained image data; and 
 projecting the combined image data onto the user's retina via a display forming part of a head mounted device coupled to the first electronic device; wherein 
 the selected mode of operation is established by the electronic processor either:
 by receiving input data established by the user via an input interface of a portable electronic device coupled to the first electronic device, the input data relating to the selection by the user of a mode of operation of the plurality of modes of operation; or 
 in dependence upon the visual field of view of the user; 
 
 user generated adjustments to at least one of configure and revise the mode of operation of a plurality of modes of operation up to a predetermined level of change are employed by the first electronic device without professional oversight; and 
 above the predetermined level of change a professional ophthalmic clinician is required to approve the user adjustments. 
 
     
     
       2. The method of  claim 1 , wherein
 the vision loss relates to at least one of a higher level processing error in the user's brain. 
 
     
     
       3. The method according to  claim 1 , wherein
 the portable electronic device is coupled to the first electronic device by at least one of a wired interface and wireless interface; and 
 the input interface of the portable electronic device is at least one of a microphone, a touchpad, a keypad, and a motion sensor. 
 
     
     
       4. The method according to  claim 1 , wherein
 the second electronic device is at least one of a digital image acquisition device, a source of video data being displayed upon another display within the field of view of the user, and a third electronic device associated with the user. 
 
     
     
       5. The method according to  claim 1 , wherein
 modifying a predetermined portion of the image data comprises at least one of enhancing edges of objects within the predetermined portion of the image data, modifying the predetermined portion of the image data spectrally, and modifying the predetermined portion of the image data spatially. 
 
     
     
       6. The method according to  claim 1 , wherein
 the predetermined portion of the obtained image data to be modified is determined in dependence upon data acquired tracking the user's eye movement and the first data. 
 
     
     
       7. The method according to  claim 1 , wherein
 the head mounted device further comprises a corrective lens; and 
 the corrective lens relates to another vision loss relating to a degradation in another predetermined portion of the visual field of view of the user other than the determined vision loss relating to the degradation in the predetermined portion of the visual field of view of the user. 
 
     
     
       8. The method according to  claim 1 , wherein
 modifying the predetermined portion of the image data with an electronic processor to generate modified image data in dependence upon the established mode of operation of the plurality of modes of operation relates to increasing a visual contrast of the predetermined portion of the image data within the predetermined portion of the visual field of view of the user; wherein 
 the increased visual contrast within the predetermined portion of the visual field of view of the user comprises a first portion based upon applying a first image modification to the visual field of view and a second portion based upon applying a second image modification to the predetermined portion of the obtained image data. 
 
     
     
       9. The method according to  claim 1 , wherein
 the characteristic of the vision loss of the user relates to at least one of:
 an element the user's optical imaging system selected from the group comprising cornea, pupil, lens, iris, and vitreous gel; and 
 a neural component of the user's vision. 
 
 
     
     
       10. The method according to  claim 1 , wherein
 the first data relating to the determined vision loss stored within the non-volatile non-transitory memory is acquired by the first electronic device via at least one of a wireless interface and a wired interface; and 
 the first data is generated by at least one of an ophthalmologist and a healthcare professional. 
 
     
     
       11. The method according to  claim 1 , wherein
 the characteristic of the vision loss of the user relates to either an environmental condition and a higher level processing error; wherein 
 the higher level processing error is selected from the group comprising:
 compensating for missing portions of the user's field of view; 
 correcting a problem with the user's eye tracking; 
 improving mental focus; and 
 removing peripheral distractions. 
 
 
     
     
       12. The method according to  claim 1 , further comprising alternately projecting to the user the visual field of view and the combined image data. 
     
     
       13. The method according to  claim 1 , wherein
 each mode of operation of the plurality of modes of operation relates to a different task performed by the user; and 
 the predetermined subset of a plurality of image processing algorithms associated with each mode of operation of the plurality of modes of operation is established by the user. 
 
     
     
       14. The method according to  claim 1 , wherein
 the data relating to the visual field of view of the user prior to being combined with the modified predetermined portion of the image data is modified in dependence upon a second vision loss relating to a general degradation in the user's visual field of view. 
 
     
     
       15. The method according to  claim 1 , wherein
 generating the combined image data by digitally replacing a portion of data relating to the visual field of view of the user with the modified predetermined portion of the obtained image data comprises manipulating the obtained image data from the second electronic device in order to enhance delivery of the information to the user and reduce disturbance of the modified predetermined portion of the obtained image data to the user's field of view. 
 
     
     
       16. A method of improving the visual function of a user comprising the steps of:
 storing within a non-volatile non-transitory memory associated with an electronic processor of a first electronic device first data relating to a determined vision loss relating to degradation in a predetermined portion of a visual field of view of the user; 
 configuring within the non-volatile non-transitory memory a plurality of sets of second data; each set of second data relating to configuring a mode of operation of a plurality of modes of operation is established in dependence upon the first data and relates to a predetermined subset of a plurality of image processing algorithms applied by the electronic processor; 
 obtaining image data from a second electronic device; 
 modifying a predetermined portion of the obtained image data with the electronic processor to generate modified image data established in dependence upon applying the predetermined subset of the plurality of image processing algorithms associated with a selected mode of operation of the plurality of modes of operation to the predetermined portion of the obtained image data, the predetermined portion of the obtained image data relating to the predetermined portion of the visual field of view of the user; 
 generating combined image data by digitally replacing a portion of data relating to the visual field of view of the user with the modified predetermined portion of the obtained image data; and 
 projecting the combined image data onto the user's retina via a display forming part of a head mounted device coupled to the first electronic device; wherein 
 the selected mode of operation is established by the electronic processor either:
 by receiving input data established by the user via an input interface of a portable electronic device coupled to the first electronic device, the input data relating to the selection by the user of a mode of operation of the plurality of modes of operation; or 
 in dependence upon the visual field of view of the user; and 
 
 the predetermined subset of a plurality of image processing algorithms associated with each mode of operation of the plurality of modes of operation is established by the user; and 
 at least one of:
 user generated adjustments to at least one of configure and revise the mode of operation of a plurality of modes of operation above a predetermined level require approval of a professional ophthalmic clinician and the at least one of the configuration and revision of the mode of operation of a plurality of modes of operation cannot be employed by the first electronic device until approved; and 
 user generated adjustments to at least one of configure and revise the mode of operation of a plurality of modes of operation up to a predetermined level of change are employed by the first electronic device without professional oversight and above the predetermined level of change a professional ophthalmic clinician is required to approve the user adjustments. 
 
 
     
     
       17. A method of improving the visual function of a user comprising the steps of:
 storing within a non-volatile non-transitory memory associated with an electronic processor of a first electronic device first data relating to a determined vision loss relating to degradation in a predetermined portion of a visual field of view of the user; 
 configuring within the non-volatile non-transitory memory a plurality of sets of second data; each set of second data relating to configuring a mode of operation of a plurality of modes of operation is established in dependence upon the first data and relates to a predetermined subset of a plurality of image processing algorithms applied by the electronic processor; 
 obtaining image data from a second electronic device; 
 modifying a predetermined portion of the obtained image data with the electronic processor to generate modified image data established in dependence upon applying the predetermined subset of the plurality of image processing algorithms associated with a selected mode of operation of the plurality of modes of operation to the predetermined portion of the obtained image data, the predetermined portion of the obtained image data relating to the predetermined portion of the visual field of view of the user; 
 generating combined image data by digitally replacing a portion of data relating to the visual field of view of the user with the modified predetermined portion of the obtained image data; and 
 projecting the combined image data onto the user's retina via a display forming part of a head mounted device coupled to the first electronic device; wherein 
 the selected mode of operation is established by the electronic processor either:
 by receiving input data established by the user via an input interface of a portable electronic device coupled to the first electronic device, the input data relating to the selection by the user of a mode of operation of the plurality of modes of operation; or 
 in dependence upon the visual field of view of the user; 
 
 user generated adjustments to at least one of configure and revise the mode of operation of a plurality of modes of operation above a predetermined level require approval of a professional ophthalmic clinician; and 
 the at least one of the configuration and revision of the mode of operation of a plurality of modes of operation cannot be employed by the first electronic device until approved.