Gaze detection system, gaze point detection method, and gaze point detection program

Abstract

A gaze detection system includes a head mounted display including a gaze detection device detecting a gaze of a user; and a tracking unit that determines a gaze point of the user in the three-dimensional image on the basis of the gaze directions of the right and left eyes, in which the first detection unit calculates a right eye gaze vector indicating the gaze direction of the right eye, and the second detection unit calculates a left eye gaze vector indicating the gaze direction of the left eye, wherein a display unit displays a three-dimensional image consisting of a plurality of layers in a depth direction, and a tracking unit identifies the layer that the user is gazing at by selecting the layer having a shortest distance between intersection points of the right eye gaze vector and the left eye gaze vector with each layer.

1 . A gaze detection system comprising:
 a head mounted display, mounted on a user's head for use, comprising,   a first image capturing device imaging the right eye;   a second image capturing device imaging the left eye; and   a display unit displaying a three-dimensional image, and   a gaze detection device detecting a gaze of the user comprising,   a first detection unit detecting a gaze direction of a user's right eye based on an image captured by the first image capturing device;   a second detection unit detecting a gaze direction of a user's left eye based on an image captured by the second image capturing device; and   a tracking unit that determines a gaze point of the user in the three-dimensional image on the basis of the gaze direction of the right eye and the gaze direction of the left eye,   in which the first detection unit calculates a right eye gaze vector indicating the gaze direction of the right eye, and the second detection unit calculates a left eye gaze vector indicating the gaze direction of the left, eye,   wherein the display unit displays a three-dimensional image consisting of a plurality of layers in a depth direction, and the tracking unit identifies the layer that the user is gazing at by selecting the layer having a shortest distance between intersection points of the right eye gaze vector and the left eye gaze vector with each layer.   
     
     
         2 . The gaze detection system of  claim 1 , wherein the tracking unit identifies the user's gaze location based on the intersection point between the right eye gaze vector and the left eye gaze vector. 
     
     
         3 . The gaze detection system of  claim 1 , wherein the tracking unit identifies the user's gaze location based on the intersection region of a cylinder with a given radius, centered on the right eye gaze vector and a cylinder with a given radius, centered on the right eye gaze vector. 
     
     
         4 . The gaze detection system according to  claim 1 , wherein the tracking unit identifies the gaze location of the user based on the intersection points of the first plurality of parallel vectors parallel to the right eye gaze vector and the second plurality of parallel vectors parallel to the left eye gaze vector. 
     
     
         5 . A method of determining a gaze point of a user in a gaze detection system comprising a head mounted display worn on the head of the user and a gaze detection device determining the gaze point of the user, comprising:
 displaying a three-dimensional image on the head mounted display;   acquiring images of a user's right eye and left eye;   transferring an acquired image data to the gaze detection device;   determining in the gaze detection device a user's right eye gaze direction vector showing the gaze direction of the user's right eye based on an acquired image of the right eye;   determining in the gaze detection device a user's left eye gaze direction vector showing the gaze direction of the user's left eye based on the acquired image of the left eye; and   determining a location that the user is gazing at in the three-dimensional image based on the right eye gaze direction and the left eye gaze direction,   in which the head mounted display displays a three-dimensional image consisting of a plurality of layers in the depth direction, wherein   the detection device identifies a layer the user is gazing at by selecting the layer having a shortest distance between the intersection points of the right eye gaze vector and the left eye gaze vector with each layer.   
     
     
         6 . A gaze detection program executing on a computer that determines a gaze point of a user wearing a head mounted display that displays a three-dimensional image, wherein the computer comprises:
 a function of obtaining the image data of a right eye and a left eye of the user wearing the head mounted display;   a function of detecting a right eye gaze direction of the right eye based on the image data of e right eye;   a function of detecting a left eye gaze direction of the left eye based on the image data of the left eye;   a function of determining a gaze point of the user in the three-dimensional image based on the right eye gaze direction and the left eye gaze direction;   a function of calculating a right eye gaze vector indicating the gaze direction of the right eye;   a function of calculating a left eye gaze vector indicating the gaze direction of the left eye; and   a function of displaying a three-dimensional image consisting of a plurality of layers in a depth direction, wherein   the function of detecting the gaze direction identifies the layer that the user is gazing at by selecting the layer having a shortest distance between intersection points of the right eye gaze vector and the left eye gaze vector with each layer.