US10216357B2ActiveUtilityA1

Apparatus and method for controlling the apparatus

43
Assignee: SONY CORPPriority: Jul 16, 2014Filed: Jul 16, 2015Granted: Feb 26, 2019
Est. expiryJul 16, 2034(~8 yrs left)· nominal 20-yr term from priority
Inventors:Alexander Gatto
G02B 27/017G06F 3/04815G06F 3/017G02B 2027/0187G06F 3/0304G06F 3/011
43
PatentIndex Score
0
Cited by
13
References
20
Claims

Abstract

An apparatus including a processor configured to: obtain image data representing an object for being displayed to a user, wherein the object is displayed on the basis of left eye image data and right eye image data obtained on the basis of the image data; obtain user eye position data representing a left pupil position and a right pupil position of the user; and generate a left eye image position for the left eye image data and a right eye image position for the right eye image data on the basis of the user eye position data.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. An apparatus comprising a processor configured to:
 obtain image data representing an object, which object is displayed to a user at an object perception position in front of a three-dimensional display, wherein the object is displayed on the basis of left eye image data and right eye image data on the three-dimensional display, each of the left eye image data and the right eye image data including the image data representing the object; 
 obtain user eye position data representing a left pupil position and a right pupil position of the user; and 
 generate a left eye image position for the left eye image data and a right eye image position for the right eye image data on the basis of the user eye position data and the perception position of the object. 
 
     
     
       2. The apparatus according to  claim 1 , wherein
 the left eye image position and the right eye image position are such generated so that the object is perceived by the user at a fixed object perception position independent of the user's left pupil position and the user's right pupil position. 
 
     
     
       3. The apparatus according to  claim 1 , wherein
 the user eye position data include at least one of distance information, view angle information and shift information of the left pupil position and the right pupil position. 
 
     
     
       4. The apparatus according to  claim 1 , wherein
 the processor is configured to generate the left eye image position and the right eye image position on the basis of the following equations:
     x   IL   =x   O   −z   O ( x   EL   −x   O )/( z   EL   −z   O ) 
     y   IL   =y   O   −z   O ( y   EL   −x   O )/( z   EL   −z   O ) 
     x   IR   =x   O   −z   O ( x   ER   −x   O )/( z   ER   −z   O ) 
     y   IR   =y   O   −z   O ( y   ER   −x   O )/( z   ER   −z   O ), 
 
 
       wherein in three dimensions an object perception position of the object is defined by the coordinates x O , y O  and z O , the left pupil position by the coordinates x EL , y EL  and z EL , the right pupil position by the coordinates x ER , y ER  and z ER , the left eye image position by the coordinates x IL , y IL , and Z IL , and the right eye image position by the coordinates x IR , y IR  and z IR . 
     
     
       5. The apparatus according to  claim 1 , wherein
 the processor is further configured to perform determining the left pupil position and the right pupil position and generating the user eye position data on the basis of the determined left pupil position and the determined right pupil position. 
 
     
     
       6. The apparatus according to  claim 1 , wherein
 the processor is further configured to perform gesture determination for detecting a gesture of the user. 
 
     
     
       7. The apparatus according to  claim 6 , wherein
 the processor is further configured to generate a feedback signal if the gesture of the user approaches to or overlaps with the fixed object perception position of the object. 
 
     
     
       8. The apparatus according to  claim 1 , wherein
 the object includes at least one of an icon, a virtual keyboard, a virtual numeric keypad, a virtual key panel and any other virtual object to be handled by the user. 
 
     
     
       9. The apparatus according to  claim 1 , further comprising a display for displaying the left eye image data at the left eye image position and the right eye image data at the right eye image position. 
     
     
       10. The apparatus according to  claim 1 , further comprising an acceleration sensor for detecting a movement of the apparatus, wherein the apparatus is further configured to display the image data representing the object to the user in response to a predetermined movement detected by the acceleration sensor. 
     
     
       11. A method comprising:
 obtaining image data representing an object, which object is displayed to a user at an object perception position in front of a three-dimensional display, wherein the object is displayed on the basis of left eye image data and right eye image data on the three-dimensional display, each of the left eye image data and the right eye image data including the image data representing the object; 
 obtaining user eye position data representing a left pupil position and a right pupil position of the user; and 
 generating a left eye image position for the left eye image data and a right eye image position for the right eye image data on the basis of the user eye position data and the perception position of the object. 
 
     
     
       12. The method according to  claim 11 , wherein
 the left eye image position and the right eye image position are such generated so that the object is perceived by the user at a fixed object perception position independent of the user's left pupil position and the user's right pupil position. 
 
     
     
       13. The method according to  claim 11 , wherein
 the user eye position data include at least one of a distance information, view angle information and a shift information. 
 
     
     
       14. The method according to  claim 11 , wherein
 the left eye image position and the right eye image position are generated on the basis of the following equations:
     x   IL   =x   O   −z   O ( x   EL   −x   O )/( z   EL   −z   O ) 
     y   IL   =y   O   −z   O ( y   EL   −x   O )/( z   EL   −z   O ) 
     x   IR   =x   O   −z   O ( x   ER   −x   O )/( z   ER   −z   O ) 
     y   IR   =y   O   −z   O ( y   ER   −x   O )/( z   ER   −z   O ), 
 
 
       wherein in three dimensions an object perception position of the object is defined by the coordinates x O , y O  and z O , the left pupil position by the coordinates x EL , y EL  and z EL , the right pupil position by the coordinates x ER , y ER  and z ER , the left eye image position by the coordinates x IL , y IL , and Z IL , and the right eye image position by the coordinates x IR , y IR  and z IR . 
     
     
       15. The method according to  claim 11 , wherein
 the left pupil position and the right pupil position are determined and the user eye position data is generated on the basis of the determined left pupil position and the determined right pupil position. 
 
     
     
       16. The method according to  claim 11 , further comprising detecting a gesture of the user. 
     
     
       17. The method according to  claim 16 , further comprising generating a feedback signal if the gesture of the user approaches to or overlaps with the fixed object perception position of the object. 
     
     
       18. The method according to  claim 11 , wherein
 the object includes at least one of an icon, a virtual keyboard, a virtual numeric keypad, a virtual key panel and any other virtual object to be handled by the user. 
 
     
     
       19. The method according to  claim 11 , further comprising displaying the left eye image data at the left eye image position and the right eye image data at the right eye image position. 
     
     
       20. The method according to  claim 11 , further comprising detecting a movement of the user and displaying the image data representing the object to the user in response to a detected predetermined movement of the user.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.