Device for interfacing with a computing program using a projected pattern

Abstract

A device for interfacing with an interactive program, including: a housing, including, an IR projector for projecting an IR pattern into an interactive environment; a camera for capturing images of the projected IR pattern; an image processor configured to process the captured images for identification of the projected IR pattern; a transceiver configured to communicate with a computing device that executes the interactive program, the transceiver configured to transmit data generated by the image processor to the computing device, such that a position of the device in the interactive environment is determined based on the captured images of the IR pattern, the determined position of the device being utilized to update a state of the executing interactive program at the computing device.

The invention claimed is: 
     
       1. A device for interfacing with an interactive program, comprising:
 a housing, including,
 an IR projector for projecting an IR pattern into an interactive environment; 
 a camera for capturing images of the projected IR pattern; 
 an image processor configured to process the captured images for identification of the projected IR pattern; 
 a transceiver configured to communicate with a computing device that executes the interactive program, the transceiver configured to transmit data generated by the image processor to the computing device, such that a position of the device in the interactive environment is determined based on the captured images of the IR pattern, the determined position of the device being utilized to update a state of the executing interactive program at the computing device. 
 
 
     
     
       2. The device of  claim 1 , wherein the position of the device in the interactive environment is further determined by processing the captured images of the IR pattern to analyze reflections of the projected IR pattern when striking surfaces in the interactive environment. 
     
     
       3. The device of  claim 2 , wherein the position of the device is determined relative to the surfaces in the interactive environment. 
     
     
       4. The device of  claim 2 , wherein processing the captured images includes determining distance of the device from the surfaces in the interactive environment. 
     
     
       5. The device of  claim 1 , wherein the position of the device includes a location or orientation of the device in the interactive environment. 
     
     
       6. The device of  claim 1 , further comprising:
 a harness, connected to the housing, for attaching the device to a user. 
 
     
     
       7. The device of  claim 1 , wherein the camera is an IR camera. 
     
     
       8. The device of  claim 1 , wherein the camera is substantially aligned with the IR projector. 
     
     
       9. The device of  claim 1 , wherein the position of the device is determined based on a location of one or more trackable features in the captured images. 
     
     
       10. The device of  claim 9 , wherein the trackable features include one or more of a reflective object, a display, a portion of a display, or a rendering on a display. 
     
     
       11. The device of  claim 1 , further comprising:
 at least one inertial sensor; 
 wherein the position of the device is determined based on data from the at least one inertial sensor. 
 
     
     
       12. The device of  claim 11 , wherein the at least one inertial sensor includes one or more of an accelerometer, gyroscope or magnetometer. 
     
     
       13. The device of  claim 1 , further comprising one or more of a display screen, a speaker, a microphone, a light emitter, or a button. 
     
     
       14. A device for interfacing with an interactive program, comprising:
 a housing, including,
 an IR projector for projecting an IR pattern into an interactive environment; 
 an IR camera for capturing images of the projected IR pattern; 
 an image processor configured to process the captured images for identification of the projected IR pattern; 
 a transceiver configured to communicate with a computing device that executes the interactive program, the transceiver configured to transmit data generated by the image processor to the computing device, such that a position of the device in the interactive environment is determined based on the captured images of the IR pattern, the determined position of the device being utilized to update a state of the executing interactive program at the computing device; 
 a harness, connected to the housing, for attaching the device to a user. 
 
 
     
     
       15. The device of  claim 14 , wherein the position of the device in the interactive environment is further determined by processing the captured images of the IR pattern to analyze distortion of the projected IR pattern when striking surfaces in the interactive environment. 
     
     
       16. The device of  claim 15 , wherein the position of the device is determined relative to the surfaces in the interactive environment. 
     
     
       17. The device of  claim 15 , wherein processing the captured images includes determining distance of the device from the surfaces in the interactive environment. 
     
     
       18. The device of  claim 14 , wherein the position of the device is determined based on a location of one or more trackable features in the captured images. 
     
     
       19. The device of  claim 18 , wherein the trackable features include one or more of a reflective object, a display, a portion of a display, or a rendering on a display. 
     
     
       20. A device for interfacing with an interactive program, comprising:
 a housing, including,
 an IR projector for projecting an IR pattern into an interactive environment; 
 an IR camera for capturing images of the projected IR pattern; 
 an image processor configured to process the captured images for identification of the projected IR pattern; 
 a computing device that executes the interactive program, the transceiver configured to transmit data generated by the image processor to the computing device, such that a position of the device in the interactive environment is determined based on the captured images of the IR pattern, the determined position of the device being utilized to update a state of the executing interactive program at the computing device; 
 wherein the position of the device in the interactive environment is further determined by processing the captured images of the IR pattern to analyze distortion of the projected IR pattern when striking surfaces in the interactive environment.