Virtual Reality System with Head-Mounted Display, Camera and Hand-Held Controllers

Abstract

A method is performed in a virtual-reality system that includes a head-mounted display (HMD), a camera, and a hand-held controller having a plurality of illumination sources to provide light that is detectable by the camera. The method includes displaying, on the HMD, an image of a hand and using the camera to detect movement of the hand-held controller by tracking positions of respective illumination sources of the plurality of illumination sources. The method further includes displaying, on the HMD, motion of the image of the hand corresponding to the detected movement.

What is claimed is: 
     
         1 . A method comprising,
 in a virtual-reality system comprising a head-mounted display (HMD), a camera, and a hand-held controller having a plurality of illumination sources to provide light that is detectable by the camera:
 displaying, on the HMD, an image of a hand; 
 using the camera to detect movement of the hand-held controller, comprising tracking positions of respective illumination sources of the plurality of illumination sources; and 
 displaying, on the HMD, motion of the image of the hand corresponding to the detected movement. 
   
     
     
         2 . The method of  claim 1 , wherein:
 the detected movement of the hand-held controller results from a user waving a hand holding the hand-held controller while the user is wearing the HMD; and   displaying the motion of the image of the hand comprises showing the image of the hand waving on the HMD.   
     
     
         3 . The method of  claim 1 , wherein:
 the detected movement of the hand-held controller results from a user swinging an arm corresponding to a hand holding the hand-held controller while the user is wearing the HMD; and   displaying the motion of the image of the hand comprises showing the image of the hand moving in accordance with the swinging.   
     
     
         4 . The method of  claim 1 , wherein:
 the detected movement of the hand-held controller results from a user punching with a hand holding the hand-held controller while the user is wearing the HMD; and   displaying the motion of the image of the hand comprises showing the image of the hand throwing a punch.   
     
     
         5 . The method of  claim 1 , wherein:
 the detected movement of the hand-held controller results from shaking of a user's hand holding the hand-held controller while the user is wearing the HMD; and   displaying the motion of the image of the hand comprises showing the image of the hand shaking.   
     
     
         6 . The method of  claim 1 , wherein the camera is mounted on the HMD. 
     
     
         7 . The method of  claim 1 , wherein the camera is external to the HMD and communicatively coupled to the HMD. 
     
     
         8 . The method of  claim 1 , wherein:
 the plurality of illumination sources comprises a plurality of LEDs; and   the tracking comprises tracking positions of light emitted by respective LEDs of the plurality of LEDs.   
     
     
         9 . The method of  claim 1 , wherein:
 the plurality of illumination sources comprises a plurality of passive reflectors; and   the tracking comprises tracking positions of light reflected by respective passive reflectors of the plurality of passive reflectors.   
     
     
         10 . The method of  claim 9 , wherein:
 the camera comprises an illumination source; and   the method further comprises using the illumination source to provide light to the passive reflectors.   
     
     
         11 . The method of  claim 1 , wherein:
 the detected movement of the hand-held controller corresponds to a command in a virtual-reality simulation; and   displaying the motion of the image of the hand comprises showing an action corresponding to the command.