Apparatus for controlling contents of a computer-generated image using 3d measurements

Abstract

A method for controlling a computer display cursor in an interaction region includes projecting an image of the computer display to create the interaction region. A distance is established between a first point and a second point. The first point has a predetermined relation to the projection device, and the second point has a predetermined relation to the interaction region. At least one of an orientation and a position of a pointing line is measured. The pointing line has a predetermined relation to a pointing device. The established distance and the at least one of measured position and orientation are used to control the cursor position on the interaction region.

What is claimed is: 
     
         1 . A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling the contents of a computer-generated image in conjunction with an enclosure comprising a plurality of sensors and configured to generate a pattern of light representing the image,
 the plurality of sensors comprising:
 an accelerometer; 
 a gyro; 
 an image capturing device; 
 a magnetometer; and 
 a sensing device that is sensitive to a position of the enclosure and orientation of the enclosure; 
   the method comprising the steps of:   receiving data that is dependent on an output of at least one of the plurality of sensors; and   controlling the contents of the computer-generated image based on the data.   
     
     
         2 . The non-transitory computer-readable medium or media according to  claim 1 , wherein the plurality of sensors further comprises a user input device configured to allow the user to manually provide two dimensional input, the user input device being insensitive to position and orientation of the enclosure. 
     
     
         3 . The non-transitory computer-readable medium or media according to  claim 2 , wherein the plurality of sensors further comprises a pressure sensor. 
     
     
         4 . The non-transitory computer-readable medium or media according to  claim 2 , wherein the pattern of light is generated by a display for displaying said image, the display being part of the enclosure. 
     
     
         5 . The non-transitory computer-readable medium or media according to  claim 2 , wherein the enclosure further comprises a laser configured to project a light spot in a direction that lies at a non-zero angle with the optical axis of the image capturing device. 
     
     
         6 . The non-transitory computer-readable medium or media according to  claim 5 , wherein
 the laser is configured to project infrared light, and   the enclosure contains a computer-readable identification code that distinguishes the enclosure among a plurality of like enclosures.   
     
     
         7 . The non-transitory computer-readable medium or media according to  claim 1 , wherein the sensing device comprises the accelerometer, the gyro, the image capturing device and the magnetometer. 
     
     
         8 . An apparatus for generating first data and second data for use in controlling a computer-generated image, the first data being dependent on a position of a first device relative to a second device, the second data being dependent on a position of the second device, the first device configured to be handheld and wielded in mid-air by a user, the second device configured to be taken along by the user, the apparatus comprising:
 a first sensing device for generating the first data, the first sensing device being sensitive to a position of the first device relative to the second device; and   a second sensing device for generating the second data, the second sensing device being sensitive to a posit ion of the second device;   wherein the first device contains at least one element of the first sensing device.   
     
     
         9 . The apparatus according to  claim 8 , wherein the first data is dependent on an orientation of the first device, and the second data is dependent on an orientation of the second device. 
     
     
         10 . The apparatus according to  claim 9 , wherein
 the first sensing device is sensitive to three independent positional coordinates of the first device relative to the second device and three independent orientational coordinates of the first device, and   the second sensing device comprises a magnetometer and is sensitive to three independent positional coordinates of the second device and three independent orientational coordinates of the second device.   
     
     
         11 . The apparatus according to  claim 10 , wherein
 the first sensing device comprises a first accelerometer and a first gyro, and   the second sensing device comprises a second accelerometer and a second gyro and is sensitive to three independent positional coordinates of the second device relative to a point external to the first device and to the second device.   
     
     
         12 . The apparatus according to  claim 11 , wherein the first sensing device comprises a digital camera. 
     
     
         13 . A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling the contents of a computer-generated image in conjunction with an enclosure that contains a plurality of sensors and that contains a projection device,
 the plurality of sensors comprising
 an accelerometer and 
 a gyro and 
 a magnetometer and 
 an image capturing device and 
 a sensing device that is sensitive to a position of the enclosure and orientation of the enclosure; 
   the method comprising the steps of:
 causing the projection device to project a plurality of distinct points, 
 causing the image capturing device to capture a first image, 
 receiving data that is dependent on an output of at least one of the plurality of sensors, and 
 using the data to control the contents of the computer-generated image when the data depends on at least a part of the first image and the first image contains a second image of at least one of the plurality of distinct points. 
   
     
     
         14 . The non-transitory computer-readable medium or media according to  claim 13 , wherein each of the plurality of distinct points is projected substantially simultaneously with the plurality of distinct points. 
     
     
         15 . The non-transitory computer-readable medium or media according to  claim 13 , wherein each of the plurality of distinct points is projected in a direction that has a non-zero angle relative to the optical axis of the image capturing device. 
     
     
         16 . The non-transitory computer-readable medium or media according to  claim 15 , wherein the projection device comprises a laser. 
     
     
         17 . The non-transitory computer-readable medium or media according to  claim 16 , wherein
 the laser is for projecting infrared light, and   the enclosure contains a computer-readable identification code that distinguishes the enclosure among a plurality of like enclosures.   
     
     
         18 . The non-transitory computer-readable medium or media according to  claim 13 , wherein
 the enclosure contains a computer-readable identification code that distinguishes the enclosure among a plurality of like enclosures, and   the plurality of sensors comprises a pressure sensor.   
     
     
         19 . The non-transitory computer-readable medium or media according to  claim 13 , wherein the sensing device is sensitive to two independent positional coordinates of the enclosure and three independent orientational coordinates of the enclosure. 
     
     
         20 . The non-transitory computer-readable medium or media according to  claim 13 , wherein the sensing device is sensitive to three independent positional coordinates of the enclosure and three independent orientational coordinates of the enclosure.