System and method for a 3d computer game with true vector of gravity

Abstract

A computer interaction system includes an augmented interaction device and a computer. The augmented interaction device includes a display device that displays augmented reality or virtual reality images, a first tracking mechanism that tracks a position of a physical object relative to the first tracking mechanism and an orientation of the physical object relative to the first tracking mechanism, and a second tracking mechanism that tracks a position of the second tracking mechanism relative to a reference and an orientation of the second tracking mechanism relative to the reference. The computer includes a processor and a memory, and processes position and orientation information received from the first tracking mechanism, and position and orientation information received from the second tracking mechanism. The computer can be configured to compensate for movement relative to the physical object of the first and second tracking mechanisms, and to output augmented reality or virtual reality information to the display.

1 . An interaction delivery device comprising:
 a display device configured to display virtual objects;   a first tracking mechanism configured to track one or more of a position of a physical object relative to the first tracking mechanism and an orientation of the physical object relative to the first tracking mechanism; and   a second tracking mechanism configured to track one or more of a position of the second tracking mechanism relative to a reference and an orientation of the second tracking mechanism relative to the reference,   wherein one or more of position information received from the first tracking mechanism and orientation information received from the first tracking mechanism is used to generate motion data for the physical object,   wherein one or more of position information received from the second tracking mechanism and orientation information received from the second tracking mechanism is used to generate adjusted motion data for the physical object,   wherein the adjusted motion data for the physical object compensates for movement relative to the physical object of at least one of the first tracking mechanism and the second tracking mechanism, and   wherein the adjusted motion data for the physical object is used to generate virtual object information, and   wherein the virtual object information is received by the display.   
     
     
         2 . An interaction processing device comprising:
 a processor;   a memory;   an input unit configured to receive information; and   an output unit configured to output information,   wherein the input unit is configured to receive at least one of physical object position information, physical object orientation information, tracking mechanism position information, and tracking mechanism orientation information,   wherein the processor is configured to generate motion data for a physical object using at least one of the physical object position information and the physical object orientation information,   wherein the processor is configured to generate adjusted motion data for the physical object using at least one of tracking mechanism position information and tracking mechanism orientation information,   wherein the adjusted motion data for the physical object compensates for movement of a tracking mechanism relative to the physical object,   wherein the processor is configured to generate virtual object information using the adjusted motion data for the physical object, and   wherein the output unit is configured to output the virtual object information.   
     
     
         3 . A computer interaction system, comprising:
 an interaction delivery device comprising:
 a display device configured to display virtual objects, 
 a first tracking mechanism configured to track one or more of a position of a physical object relative to the first tracking mechanism and an orientation of the physical object relative to the first tracking mechanism, and 
 a second tracking mechanism configured to track one or more of a position of the second tracking mechanism relative to a reference and an orientation of the second tracking mechanism relative to the reference; and 
   a computer comprising:
 a processor, and 
 a memory, 
   wherein the computer is configured to process at least one of position information received from the first tracking mechanism, orientation information received from the first tracking mechanism, position information received from the second tracking mechanism, and orientation information received from the second tracking mechanism,   wherein the computer is further configured to compensate for movement relative to the physical object of at least one of the first tracking mechanism and the second tracking mechanism, and   wherein the computer is further configured to output virtual object information to the display device.   
     
     
         4 . The computer interaction system of  claim 3 , wherein the first tracking mechanism is an optical tracking mechanism. 
     
     
         5 . The computer interaction system of  claim 4 , wherein the interaction delivery device is configured to be head-worn and to display see-through video. 
     
     
         6 . The computer interaction system of  claim 3 , wherein the second tracking mechanism comprises a three-axis accelerometer. 
     
     
         7 . The computer interaction system of  claim 3 , wherein the second tracking mechanism comprises a six-degree-of-freedom tracker configured to determine a three-dimensional position of the second tracking mechanism relative to the reference and a three-dimensional orientation of the second tracking mechanism relative to the reference. 
     
     
         8 . The computer interaction system of  claim 7 , wherein the reference is earth or is fixed to earth. 
     
     
         9 . The computer interaction system of  claim 7 , wherein the reference is fixed to an object moving relative to earth. 
     
     
         10 . The computer interaction system of  claim 3 , wherein the second tracking mechanism is configured to determine a true direction of a natural force vector. 
     
     
         11 . The computer interaction system of  claim 10 , wherein the computer is configured to simulate motion of virtual objects based on a true direction of a natural force and based on at least one of position information received from the first tracking mechanism, orientation information received from the first tracking mechanism, position information received from the second tracking mechanism, and orientation information received from the second tracking mechanism. 
     
     
         12 . The computer interaction system of  claim 10 , wherein the computer is configured to simulate motion of virtual objects based on a direction of force that is different from the true direction of the natural force and based on at least one of position information received from the first tracking mechanism, orientation information received from the first tracking mechanism, position information received from the second tracking mechanism, and orientation information received from the second tracking mechanism. 
     
     
         13 . The computer interaction system of  claim 3 ,
 wherein the computer further comprises a physics engine, and   wherein the computer is configured to simulate virtual objects.   
     
     
         14 . The computer interaction system of  claim 13 ,
 wherein the computer is configured to simulate natural forces acting, in the true direction, on the virtual objects based on at least one of the position information received from the first tracking mechanism, the orientation information received from the first tracking mechanism, the position information received from the second tracking mechanism, and the orientation information received from the second tracking mechanism,   wherein the position information received from the first tracking mechanism comprises a first position of the physical object relative to the first tracking mechanism at a first time and a second position of the physical object relative to the first tracking mechanism at a second time,   wherein the orientation information received from the first tracking mechanism comprises a first orientation of the physical object relative to the first tracking mechanism at the first time and a second orientation of the physical object relative to the first tracking mechanism at the second time,   wherein the position information received from the second tracking mechanism comprises a first position of the second tracking mechanism relative to the reference at the first time and a second position of the second tracking mechanism relative to the reference at the second time, and   wherein the orientation information received from the second tracking mechanism comprises a first orientation of the second tracking mechanism relative to the reference at the first time and a second orientation of the second tracking mechanism relative to the reference at the second time.   
     
     
         15 . The computer interaction system of  claim 14 ,
 wherein the second tracking mechanism has a position rigidly fixed relative to the first tracking mechanism,   wherein a predetermined time exists between the first time and the second time,   wherein the computer is configured to determine a physical object movement vector between the first position of the physical object and the second position of the physical object,   wherein the computer is configured to determine a second tracking mechanism movement vector between the first position of the second tracking mechanism and the second position of the second tracking mechanism,   wherein the computer is configured to calculate an adjusted physical object movement vector if a magnitude of the second tracking mechanism movement vector is greater than or equal to a predetermined threshold distance, and to simulate natural forces acting on the virtual objects based on at least the adjusted physical object movement vector if the magnitude of the second tracking mechanism movement vector is greater than or equal to the predetermined threshold distance, and   wherein the computer is configured to simulate natural forces acting on the virtual objects based on at least the physical object movement vector if the magnitude of the second tracking mechanism movement vector is less than the predetermined threshold distance.   
     
     
         16 . The computer interaction system of  claim 14 ,
 wherein the computer is configured to determine a physical object rotation tensor between the first orientation of the physical object and the second orientation of the physical object,   wherein the computer is configured to determine a second tracking mechanism rotation tensor between the first orientation of the second tracking mechanism and the second orientation of the second tracking mechanism,   wherein the computer is configured to calculate an adjusted physical object rotation tensor if a resultant rotation of the second tracking mechanism is greater than or equal to a predetermined threshold rotation value,   wherein the computer is configured to simulate natural forces acting on the virtual objects based on at least the adjusted physical object rotation tensor if the resultant rotation of the second tracking is greater than or equal to the predetermined threshold rotation value, and   wherein the computer is configured to simulate natural forces acting on the virtual objects based on at least the physical object rotation tensor if the resultant rotation of the second tracking mechanism is less than the predetermined threshold rotation value.   
     
     
         17 . A non-transitory computer readable medium having computer readable instructions stored thereon, which, when executed by a computer having a processor to execute a plurality of processes, are configured to cause the processor to:
 obtain first tracking mechanism information;   obtain second tracking mechanism information;   determine a physical object movement vector using the first tracking mechanism information;   determine a second tracking mechanism movement vector using the second tracking mechanism information;   determine a direction of a true physical gravity vector relative to the second tracking mechanism;   simulate motion data of a virtual object using:
 an adjusted physical object movement vector if a magnitude of the second tracking mechanism movement vector is greater than or equal to a predetermined threshold distance, 
 the physical object movement vector if the magnitude of the second tracking mechanism movement vector is less than the predetermined threshold distance, and 
 the direction of a true physical gravity vector relative to the second tracking mechanism; and 
   output the motion data of the virtual object to a display.   
     
     
         18 . The non-transitory computer readable medium having computer readable instructions stored thereon of  claim 17 , which, when executed by a computer having a processor to execute a plurality of processes, are configured further to cause the processor to:
 determine a physical object rotation tensor using the first tracking mechanism information;   determine a second tracking mechanism rotation tensor using the second tracking mechanism information; and   simulate motion data of an a virtual object using additionally:
 an adjusted physical object rotation tensor if a resultant rotation of the second tracking mechanism is greater than or equal to a predetermined threshold rotation value, and 
 the physical object rotation tensor if the resultant rotation of the second tracking mechanism is less than the predetermined threshold rotation value. 
   
     
     
         19 . The non-transitory computer readable medium having computer readable instructions stored thereon according to  claim 18 , wherein:
 the first tracking mechanism information comprises:
 a first position of a physical object relative to a first tracking mechanism and a first orientation of the physical object at a first time, and 
 a second position of the physical object relative to the first tracking mechanism and a second orientation of the physical object at a second time; and 
   the second tracking mechanism information comprises:
 a first position of a second tracking mechanism relative to a reference and a first orientation of the second tracking mechanism at the first time, and 
 a second position of the second tracking mechanism relative to the reference and a second orientation of the second tracking mechanism at the second time. 
   
     
     
         20 . A method of facilitating interaction between an interaction delivery device and a physical object in an environment, the method comprising:
 generating one or more virtual objects in the environment;   detecting a change in the physical object;   determining whether the change in the physical object is based on a change in the state of the virtual objects and the physical object, or both a force applied to the interaction delivery device and a change in the state of the virtual objects and the physical object;   measuring a direction and effect of a natural force interacting with the environment; and   updating the virtual objects based on a result of the determining and the measuring.   
     
     
         21 . The method of facilitating interaction between an interaction delivery device and a physical object in an environment of  claim 20 ,
 wherein the detecting further comprises:
 detecting a change in position of the physical object over a given time, and 
 detecting a change in position of the interaction delivery device over the given time; 
   wherein the determining further comprises:
 determining whether a magnitude of the change in position of the interaction delivery device over the given time is greater than or equal to a threshold value, 
 determining that the detected change in the physical object is based on a change in the state of the virtual objects and the physical object if the change in position of the interaction delivery device over the given time is less than the threshold value, and 
 determining that the detected change in the physical object is based on both a force applied to the interaction delivery device and a change in the state of the virtual objects and the physical object if the change in position of the interaction delivery device over the given time is greater than or equal to the threshold value; and 
   wherein the updating further comprises:
 updating positions of the virtual objects to simulate motion consistent with the natural force and the detected change in position of the physical object over the given time if the detected change in the physical object is based on a change in the state of the virtual objects and the physical object, and 
 updating positions of the virtual objects to simulate motion consistent with the natural force and the detected change in position of the physical object and adjusted to remove effects caused by the force applied to the interaction delivery device over the given time if the detected change in the physical object is based on both a force applied to the interaction delivery device and a change in the state of the virtual objects and the physical object. 
   
     
     
         22 . An interaction system comprising:
 a physical object;   at least one virtual object;   an interaction delivery device comprising:
 a tracking mechanism configured to track at least one of a position of the physical object relative to the first tracking mechanism and an orientation of the physical object relative to the first tracking mechanism, 
 a detecting mechanism configured to detect motion of the detecting mechanism, wherein a position of the detecting mechanism relative to a position of the tracking mechanism is predetermined, and 
 a display configured to display the at least one virtual object; and 
   a processing device,   wherein the processing device is configured to receive physical object position information from the tracking mechanism,   wherein the processing device is configured to receive detecting mechanism motion information from the detecting mechanism,   wherein the processing device is configured to perform at least one of:
 determining if a magnitude of acceleration of the detecting mechanism is greater than a predetermined acceleration threshold value and generating adjusted physical object position information if the magnitude of acceleration of the detecting mechanism is greater than the predetermined acceleration threshold value, and 
 determining if a magnitude of velocity of the detecting mechanism is greater than a predetermined velocity threshold value and generating adjusted physical object position information if the magnitude of velocity of the detecting mechanism is greater than the predetermined velocity threshold value, 
   wherein the processing device is configured to generate motion information for the at least one virtual object based on the adjusted physical object position information if the processing device generates the adjusted physical object position information, and   wherein the processing device is configured to generate the motion information for the at least one virtual object based on the physical object position information if the processing device does not generate the adjusted physical object position information, and   wherein the processing device is configured to output the motion information for the at least one virtual object to the display.   
     
     
         23 . The interaction system of  claim 22 ,
 wherein the detecting mechanism is further configured to detect a correct direction and magnitude of a physical gravity vector, and   wherein the processing device is further configured to generate the motion information for the at least one virtual object additionally based on the correct direction and magnitude of the physical gravity vector.   
     
     
         24 . The interaction system of  claim 23 ,
 wherein the at least one virtual object is configured to move according to a virtual gravity vector, and   wherein the virtual gravity vector is substantially identical to the physical gravity vector.   
     
     
         25 . The interaction system of  claim 23 ,
 wherein the at least one virtual object is configured to move according to a virtual gravity vector, and   wherein the virtual gravity vector is different from the physical gravity vector.   
     
     
         26 . The interaction system of  claim 22 ,
 wherein the tracking mechanism is an optical tracking device and the physical object does not include attached or embedded electronic devices or components.   
     
     
         27 . An interaction delivery system comprising:
 a first tracking mechanism rigidly attached to a display device configured to track the position and orientation of a physical object relative to the display device;   a second tracking mechanism rigidly attached to the display device, configured to track the absolute orientation of the display device relative to the earth; and   a processing device configured to process tracking information output from the first tracking mechanism and tracking information output from the second tracking mechanism,   wherein the processing device is configured to simulate motion information of at least one virtual object from the tracking information output from the first tracking mechanism and tracking information output from the second tracking mechanism,   wherein the processing device is configured to output the simulated motion information of the at least one virtual object to the display,   wherein the display is configured to display the at least one virtual object disposed relative to the physical object, and   wherein the at least one virtual object is configured to behave as if acted on by a virtual gravity vector in a same direction as a physical gravity vector acting on the physical object.