Two Step Gaze Interaction

Abstract

A computer system can be controlled with non-contact inputs, such as eye-tracking devices. A computer can enlarge a portion of a display adjacent a first gaze target in response to detecting a first action (e.g., pressing a touchpad). The computer can then allow a user to position a second gaze target in the enlarged portion (e.g., by looking at the desired location) and perform a second action in order to perform a computer function at that location. The enlarging can allow a user to identify a desired location for a computer function (e.g., selecting an icon) with greater precision.

1 . A system, comprising:
 a computer including a display device for presenting a display;   an eye-tracking device for detecting eye indications;   a processor operably connected to the eye-tracking device and the display device; and   programming stored in a memory that, when executed by the processor, configures the processor to:
 determine from the eye indications, a gaze point representing a location on the display at which a user's gaze is focused, wherein the gaze point has a geometric area of a predetermined size relative to the display device; 
 detect a first action performed by the user; 
 determine that a plurality of elements displayed on the display are located within the geometric area of the gaze point; 
 in response to determining that the plurality of elements are located within the geometric area of the gaze point, rearrange the plurality of elements on the display such that the plurality of elements are spaced apart from each other greater than a predetermined distance without enlarging any of the plurality of elements; 
 determine a new gaze point from the eye indications; 
 determine that the new gaze point identifies a targeted element: 
 detect a second action performed by the user indicating the targeted element has been correctly identified; and 
 perform a computer function associated with the targeted element in response to the detection of the second action. 
   
     
     
         2 . The system of  claim 1 , wherein the first action is depressing a button. 
     
     
         3 . The system of  claim 1 , wherein the second action is depressing a button. 
     
     
         4 . The system of  claim 1 , wherein the first action is depressing a button and the second action is releasing the button. 
     
     
         5 . The system of  claim 1 , wherein the predetermined distance is determined based on sue and layout of the plurality of elements relative to each other. 
     
     
         6 . The system of  claim 1 , wherein, prior to rearrangement of the plurality of elements, the plurality of elements are displayed relative to each other in a first configuration; and wherein, after rearrangement of the plurality of elements, the plurality of elements are displayed relative to each other in a second configuration. 
     
     
         7 . The system of  claim 6 , wherein the first configuration comprises a two dimensional configuration; and wherein, the second arrangement comprises a linear formation. 
     
     
         8 . The system of  claim 1 , further comprising highlighting the targeted element prior to detecting the second action. 
     
     
         9 . The system of  claim 1 , wherein the predefined distance is determined based on a user-set parameter. 
     
     
         10 . A method for controlling a computer, comprising:
 determining, by a processor, from eye indications detected by an eye-tracking device, a gaze point representing a location on a display at which a user's gaze is focused, wherein the display is displayed on a display device operably coupled to the processor, and wherein the gaze point has a geometric area of a predetermined size relative to the display device;   detecting, by the processor, a first action performed by the user;   determining, by the processor, that a plurality of elements displayed on the display are located within the geometric area of the gaze point;   in response to determining that the plurality of elements are located within the geometric area of the gaze point, rearranging the plurality of elements on the display such that the plurality of elements are spaced apart from each other greater than a predetermined distance without enlarging any of the plurality of elements;   determining, by the processor, a new gaze point from the eye indications;   determining, by the processor, that the new gaze point identifies a targeted element;   detect determining, by the processor, a second action performed by the user indicating the targeted element has been correctly identified; and   performing, by the processor, a computer function associated with the targeted element in response to the detection of the second action.   
     
     
         11 . The method of  claim 10 , wherein the first action is depressing a button. 
     
     
         12 . The method of  claim 10 , wherein the second action is depressing a button. 
     
     
         13 . The method of  claim 10 , wherein the first action is depressing a button and the second action is releasing the button. 
     
     
         14 . The method of  claim 10 , wherein the predetermined distance is determined based on size and layout of the plurality of elements relative to each other. 
     
     
         15 . The method of  claim 10 , wherein, prior to rearrangement of the plurality of elements, the plurality of elements are displayed relative to each other in a first configuration; and wherein, after rearrangement of the plurality of elements, the plurality of elements are displayed relative to each other in a second configuration. 
     
     
         16 . The method of  claim 15 , wherein the first configuration comprises a two dimensional configuration; and wherein, the second arrangement comprises a linear formation. 
     
     
         17 . The method of  claim 10 , further comprising highlighting the targeted element prior to detecting the second action. 
     
     
         18 . The method of  claim 10 , wherein the predefined distance is determined based on a user-set parameter. 
     
     
         19 . A non-transitory computer-readable medium having stored thereon programming instructions that, when executed by a processor, configure the processor for performing operations comprising:
 determining, by the processor, from eye indications detected by an eye-tracking device, a gaze point representing a location on a display at which a user's gaze is focused, wherein the display is displayed on a display device operably coupled to the processor, and wherein the gaze point has a geometric area of a predetermined size relative to the display device;   detecting, by the processor, a first action performed by the user;   determining, by the processor, that a plurality of elements displayed on the display are located within the geometric area of the gaze point;   in response to determining that the plurality of elements are located within the geometric area of the gaze point, rearranging the plurality of elements on the display such that the plurality of elements are spaced apart from each other greater than a predetermined distance without enlarging any of the plurality of elements;   determining, by the processor, a new gaze point from the eye indications;   determining, by the processor, that the new gaze point identifies a targeted element;   detect determining, by the processor, a second action performed by the user indicating the targeted element has been correctly identified; and   performing, by the processor, a computer function associated with the targeted element in response to the detection of the second action.   
     
     
         20 . The method of  claim 19 , wherein the predetermined distance is determined based on size and layout of the plurality of elements relative to each other.