Advanced video gaming methods for education and play using camera based inputs

Abstract

This application discloses active movement based and other video games which may be played over the internet as well in the home or elsewhere. One or two or more persons can play, generally using one or more cameras to determine the relation of an object or a part of a person to a video display on which game related graphics are displayed. Determination of object position and orientation in up to 6 degrees of freedom is disclosed, at data rates sufficient to make game play rewarding.

We claim: 
     
         1 . A method for a person to control an element in a 3D computer game by moving a 3D object that represents the said element within a space in front of one or more electro-optical sensors, comprising the steps of:
 providing one or more targets on the said 3D object;   using at least one electro-optical sensor, to track the physical interaction of said person with said object;   analyzing the output of at least one of said sensors to determine the target location to arrive at a location and orientation of said object and its component parts;   identifying the 3D object by a unique combination of targets of given color, size, shape, and optical intensity; and   sending the computer game instructions to make corresponding movement and orientation changes of the said game element;   
     
     
         2 . A method according to  claim 1  wherein multiple players can interact with each other over internet linked systems each with their own electro-optical sensors and displays. 
     
     
         3 . A method according to  claim 1  wherein a database of natural motions associated with the said 3D object are applied once the said object and its path motion are identified.