User interface device and display object operating method

Abstract

A user interface device includes: a display unit which displays a two-dimensional or a three-dimensional display object in a display space; a sensor unit which measures 3D coordinates of fingers of a user in the display space; a motion detecting unit which detects motion of the fingers of the user relative to the display object based on the 3D coordinates of the fingers of the user measured by the sensor unit; and a display control unit which changes display content displayed by the display unit, according to a detection result obtained by the motion detecting unit.

The invention claimed is: 
     
       1. A user interface device comprising:
 a non-transitory computer-readable recording medium configured to store a program; and 
 a user interface processor configured to execute the program and cause the user interface device to: 
 display an object in a display space, the object being either a two-dimensional (2D) object or a three-dimensional (3D) object; 
 measure 3D coordinates of fingers of a user in the display space; 
 detect motion of the fingers of the user relative to the object, based on the 3D coordinates of the fingers of the user measured; and 
 change display content displayed, according to a detection result obtained, 
 wherein when an enlarging motion is detected in which the user enlarges the object while pinching two points of the object, the user interface device enlarges the object, and 
 when a reducing motion in which the user reduces the object while pinching two points of the object is detected, the user interface device reduces the object, and 
 wherein the user interface device detects a pinching motion in which the user pinches the target object which is the object, based on the 3D coordinates of the fingers of the user measured, and 
 generates a finger motion model by determining portions of a part of the user which are narrower than a predetermined threshold to be the fingers, and detects the pinching motion based on the finger motion model. 
 
     
     
       2. A display object operating method comprising:
 displaying an object in a display space, the object being either a two-dimensional (2D) object or a three-dimensional (3D) object; 
 measuring 3D coordinates of fingers of a user in the display space; 
 detecting motion of the fingers of the user relative to the object, based on the 3D coordinates of the fingers of the user measured in the measuring; and 
 changing display content according to a detection result obtained in the detecting, 
 wherein, when enlarging motion in which the user enlarges the object while pinching two points of the object is detected in the detecting, the object is enlarged in the changing, and when reducing motion in which the user reduces the object while pinching two points of the object is detected in the detecting, the object is reduced in the changing, and 
 wherein the detecting of the motion of the fingers includes detecting a pinching motion in which the user pinches the target object which is the object, based on the 3D coordinates of the fingers of the user measured by the sensor, generating a finger motion model by determining portions of a part of the user which are narrower than a predetermined threshold to be the fingers, and detecting the pinching motion based on the finger motion model. 
 
     
     
       3. A non-transitory computer-readable recording medium for use in a computer, the recording medium having a computer program recorded thereon for causing the computer to execute steps comprising:
 displaying an object in a display space, the object being either a two-dimensional (2D) object or a three-dimensional (3D) object; 
 measuring 3D coordinates of fingers of a user in the display space; 
 detecting motion of the fingers of the user relative to the object, based on the 3D coordinates of the fingers of the user measured in the measuring; and 
 changing display content according to a detection result obtained in the detecting, 
 wherein, when enlarging motion in which the user enlarges the object while pinching two points of the object is detected in the detecting, the object is enlarged in the changing, and when reducing motion in which the user reduces the object while pinching two points of the object is detected in the detecting, the object is reduced in the changing, and 
 wherein the detecting of the motion of the fingers includes detecting a pinching motion in which the user pinches the target object which is the object, based on the 3D coordinates of the fingers of the user measured by the sensor, generating a finger motion model by determining portions of a part of the user which are narrower than a predetermined threshold to be the fingers, and detecting the pinching motion based on the finger motion model. 
 
     
     
       4. An integrated circuit comprising:
 a non-transitory computer-readable recording medium configured to store a program; and 
 a user interface processor configured to execute the program and cause the integrated circuit to: 
 display an object in a display space, the object being either a two-dimensional (2D) object or a three-dimensional (3D) object; 
 measure 3D coordinates of fingers of a user in the display space; 
 detect motion of the fingers of the user relative to the object, based on the 3D coordinates of the fingers of the user measured; and 
 change display content displayed, according to a detection result obtained, 
 wherein when an enlarging motion in which the user enlarges the object while pinching two points of the object is detected, the integrated circuit enlarges the object, and 
 when a reducing motion in which the user reduces the object while pinching two points of the object is detected, the integrated circuit reduces the object, and 
 wherein the integrated circuit detects a pinching motion in which the user pinches the target object which is the object, based on the 3D coordinates of the fingers of the user measured, and 
 generates a finger motion model by determining portions of a part of the user which are narrower than a predetermined threshold to be the fingers, and detects the pinching motion based on the finger motion model.