Eye-based activation and tool selection systems and methods

Abstract

Presented are eye-controlled user-machine interaction systems and methods that, based on input variables that comprise orientation and motion of an electronic contact lens, assist the wearer of the contact lens carrying a femtoprojector to control and navigate a virtual scene that may be superimposed onto the real-world environment. Various embodiments provide for smooth, intuitive, and naturally flowing eye-controlled, interactive operations between the wearer and a virtual environment. In certain embodiments, eye motion information is used to wake a smart electronic contact lens, activate tools in a virtual scene, or any combination thereof without the need for blinking, winking, hand gestures, and use of buttons.

What is claimed is: 
     
         1 . A method for activating a contact lens virtual display, the method comprising:
 tracking an orientation of a contact lens based on tracking data generated by at least one sensor disposed within the contact lens;   analyzing the tracking data to identify when the orientation of the contact lens crosses an activation threshold; and   in response to the orientation of the contact lens crossing the activation threshold, activating the contact lens virtual display by projecting at least one virtual tool onto a user retina resulting in the at least one virtual tool becoming visible to the user within the contact lens virtual display.   
     
     
         2 . The method of  claim 1  wherein the step of tracking the orientation of the contact lens comprises angular measurements of pitch and roll relative to a first reference. 
     
     
         3 . The method of  claim 2  wherein the first reference is defined in relation to a gravitational field of the earth. 
     
     
         4 . The method of  claim 3  wherein the at least one sensor comprises an accelerometer that enables the angular measurements of pitch and roll. 
     
     
         5 . The method of  claim 1  wherein the step of tracking the orientation of the contact lens comprises measurements of yaw relative to a second reference. 
     
     
         6 . The method of  claim 5  wherein the second reference is defined in relation to magnetic north and the at least one sensor comprises a magnetometer. 
     
     
         7 . The method of  claim 1  wherein the at least one sensor comprises at least two sensors selected from a group consisting of an accelerometer, a magnetometer, and a gyroscope. 
     
     
         8 . The method of  claim 1  wherein the tracking data is adjusted to compensate for movement of a user during the step of tracking. 
     
     
         9 . The method of  claim 8  wherein the at least one sensor comprises a gyroscope that generates user motion data that is used to adjust the tracking data, the user motion data related to at least one of user acceleration, user velocity, and user rotation. 
     
     
         10 . The method of  claim 1  wherein the at least one virtual tool is visible relative to a boundary shape that partitions the contact lens virtual display into an inner area and an outer area. 
     
     
         11 . The method of  claim 10  wherein the boundary shape is a ring on which the at least one virtual tool is displayed. 
     
     
         12 . The method of  claim 10  further comprising the step of displaying a second virtual tool related to the at least one virtual tool within the activated contact lens virtual display, the second virtual tool being displayed in response to an analysis of the tracking data relative to the at least one virtual tool. 
     
     
         13 . A method for activating a contact lens virtual display, the method comprising:
 tracking a motion of a contact lens based on tracking data generated by at least one sensor disposed within the contact lens;   analyzing the tracking data to identify when the motion of the contact lens crosses an activation threshold;   in response to the motion of the contact lens crossing the activation threshold, activating the contact lens virtual display by projecting at least one virtual tool onto a user retina resulting in the at least one virtual tool becoming visible to the user within the contact lens virtual display.   
     
     
         14 . The method of  claim 13  wherein the step of tracking the motion of the contact lens comprises a distance measurement relative to a first location of the contact lens and a second location of the contact lens. 
     
     
         15 . The method of  claim 14  wherein the distance measurement at least partially relates to a saccade movement of a user eye between the first location and the second location. 
     
     
         16 . The method of  claim 13  wherein the at least one sensor comprises at least two sensors selected from a group consisting of an accelerometer, a magnetometer, and a gyroscope. 
     
     
         17 . The method of  claim 13  wherein the at least one virtual tool is visible relative to a boundary shape that partitions the contact lens virtual display into an inner area and an outer area. 
     
     
         18 . The method of  claim 17  wherein the boundary shape is a ring on which the at least one virtual tool is displayed. 
     
     
         19 . The method of  claim 17  further comprising the step of displaying a second virtual tool related to the at least one virtual tool within the activated contact lens virtual display, the second virtual tool being displayed in response to an analysis of the tracking data relative to the at least one virtual tool. 
     
     
         20 . A contact lens comprising:
 a plurality of sensors that generates tracking data related to an orientation of the contact lens;   an activation threshold detector coupled to receive the tracking data, the activation threshold detector detects the contact lens crossing an activation threshold based at least in part on the tracking data; and   a femtoprojector coupled within the contact lens, the femtoprojector being activated in response to the contact lens crossing the activation threshold, the activated femtoprojector projecting at least one virtual tool onto a user retina resulting in the at least one virtual tool becoming visible to a user within an activated contact lens virtual display.