Generating position information using a video camera

Abstract

Some implementations may receive image information from a video camera and receive supplemental positioning information from a sensor of a user-manipulated device. The supplemental positioning information may be used to compensate for blind spots in the image information received from the video camera. Position information based at least in part on the image information and the supplemental positioning information may be generated. The position information may express a position and/or orientation of the user-manipulated device relative to the video camera. An application may be controlled using the generated position information.

1 .- 20 . (canceled) 
     
     
         21 . A method comprising:
 receiving image information from a video camera;   receiving supplemental positioning information from a sensor of a user-manipulated device;   generating position information based at least in part on the image information and the supplemental positioning information, the position information expressing a position of the user-manipulated device relative to the video camera, the supplemental positioning information to compensate for blind spots identified in the image information received from the video camera; and   controlling an application based on the generated position information.   
     
     
         22 . The method of  claim 21 , wherein the user-manipulated device is pointed toward a display device. 
     
     
         23 . The method of  claim 21 , wherein the sensor of the user-manipulated device comprises an inertial sensor. 
     
     
         24 . The method of  claim 23 , wherein receiving the supplemental positioning information from the sensor comprises:
 receiving inertial sensor information from the inertial sensor of the user-manipulated device.   
     
     
         25 . The method of  claim 21 , further comprising receiving the image information from the video camera in response to the user-manipulated device being positioned to point at a particular object presented by the display device. 
     
     
         26 . The method of  claim 21 , wherein the user-manipulated device comprises a game controller. 
     
     
         27 . The method of  claim 21 , wherein the user-manipulated device comprises one or more of a data glove device, a wristband device, a headband device, or a shoe-borne device. 
     
     
         28 . The method of  claim 21 , wherein:
 the video camera is stationary; and   a field of view of the video camera encompasses an area in which a user is expected to operate the user-manipulated device.   
     
     
         29 . The method of  claim 21 , wherein the video camera sweeps back and forth to encompass an area in which a user is expected to operate the user-manipulated device. 
     
     
         30 . An electronic device comprising:
 a processor; and   one or more computer readable storage media storing instructions that are executable by the processor to perform acts comprising:   receiving image information from a video camera;   receiving supplemental positioning information from a sensor of a user-manipulated device;   generating position information based at least partly on the image information and the supplemental positioning information, the position information identifying an orientation of the user-manipulated device relative to the video camera, the supplemental positioning information compensating for blind spots detected in the image information; and   providing the position information to a software application.   
     
     
         31 . The electronic device of  claim 30 , wherein the user-manipulated device includes one or more control actuators. 
     
     
         32 . The electronic device of  claim 31 , wherein the one or more control actuators comprise at least one of a button actuator, a joystick actuator, a knob actuator, or a steering mechanism actuator. 
     
     
         33 . The electronic device of  claim 30 , wherein the acts further comprise:
 determining that a gesture has been performed using the user-manipulated device;   comparing the gesture with one or more predetermined patterns;   recognizing the gesture in response to determining that the gesture matches at least one of the one or more predetermined patterns; and   performing an operation associated with the recognized gesture.   
     
     
         34 . The electronic device of  claim 30 , wherein the position information is generated via one or more geometrical mapping equations based at least partly on the image information and the supplemental positioning information. 
     
     
         35 . The electronic device of  claim 30 , wherein the sensor of the user-manipulated device comprises an inertial sensor. 
     
     
         36 . The electronic device of  claim 30 , wherein the position information identifies a position of the user-manipulated device relative to the video camera. 
     
     
         37 . A system comprising:
 a gaming console comprising a memory including instructions and a processor to execute the instructions to perform acts comprising:
 receiving image information from multiple video cameras, the multiple video cameras capturing the image information from multiple respective angles; 
 receiving supplemental positioning information from a sensor of a user-manipulated device; 
 based on the image information and the supplemental positioning information, generating position information that identifies a position of the user-manipulated device relative to the multiple video cameras, the supplemental positioning information compensating for blind spots associated with the image information; and 
 controlling an application based on the position information. 
   
     
     
         38 . The system of  claim 37 , wherein the sensor comprises an inertial sensor. 
     
     
         39 . The system of  claim 37 , wherein the position information describes an orientation of the user-manipulated device relative to the multiple video cameras. 
     
     
         40 . The system of  claim 37 , the acts further comprising:
 determining that a gesture has been performed using the user-manipulated device; and   performing an operation based on a type of the gesture.