Method and apparatus for providing realistic gun motion input to a video game

Abstract

A method and apparatus for providing realistic gun motion input to a video game. In one embodiment, a plastic enclosure houses a video camera, PCB, microcontroller processor, and many buttons for controlling various aspects of a video game. The processor examines images from the video camera using various feature tracking algorithms and determines the direction and magnitude of motion of the video camera, and hence the motion of plastic gun shaped enclosure in which the video camera is mounted, and that the game player is wielding. This motion data is translated into motion data that a video game running on a video game console can understand, and transmitted to the video game console. The end result is that a user pointing and moving the plastic gun will cause the in game character of the video game to move and point its gun in concert with the game player, thereby providing an intuitive and fun aiming mechanism for playing video games. The button presses that the game player initiates on the apparatus are also reported to the video game and also affect various actions therein.

1 . An apparatus for providing realistic gun input to a video game, comprising: 
 A housing that is shaped like a firearm;    A camera;    An image processing means that processes images from said camera and produces camera motion information;    A means for translating said camera motion information into motion information for a video game;    A means for transmitting said motion information for a video game to a video game;    A plurality of buttons for controlling various functions of a video game;    Whereby moving said housing shaped like a firearm causes corresponding motion displayed by said video game.    
   
   
       2 . An apparatus as recited in  claim 1  further comprising a means for adjusting the sensitivity of said motion information, wherein the magnitude of said motion information can be amplified and can be reduced.  
   
   
       3 . An apparatus as recited in  claim 1  further comprising a means for mapping the function of button within said plurality of buttons to any other button within said plurality of buttons.  
   
   
       4 . An apparatus as recited in  claim 1  further comprising: 
 a means for simulating the recoil action force of a firearm;    an expandable rifle stock.    
   
   
       5 . The apparatus of  claim 1  further comprising a means of measuring the angle of rotation of said housing that is shaped like a firearm about an axis of rotation that is approximately parallel to the axis of rotation that runs longitudinally from the back to the front of said housing that is shaped like a firearm.  
   
   
       6 . The apparatus of  claim 1  further comprising: 
 a second camera that is aimed toward said housing that is shaped like a firearm;    a means for processing images from said second camera and detecting motions of a game player;    whereby motions of said game player can detected and then translated into actions within said video game.    
   
   
       7 . The apparatus of  claim 1  further comprising: 
 a pressure sensitive pad that a game player stands on and generates foot step information;    a means of reading said foot step information from said pressure sensitive pad;    a means of producing actions within said video game based on foot step information from said pressure sensitive pad.    
   
   
       8 . The apparatus of  claim 1  further comprising a pulse rate sensor whereby the pulse of the game player can be monitored and displayed.  
   
   
       9 . The apparatus of  claim 1  further comprising a thumbstick located on the upper portion of the pistol grip of said housing that is shaped like a firearm.  
   
   
       10 . The apparatus of  claim 1  further comprising a beacon that is used to give said image processor a point of reference in the environment.  
   
   
       11 . The apparatus of  claim 10  wherein said beacon is selected from the group consisting of: a reflector, and a light source, and a television.  
   
   
       12 . An apparatus as recited in  claim 1  further comprising a plurality of buttons on the side of the fore grip of said housing that is shaped like a firearm.  
   
   
       13 . An apparatus as recited in  claim 1  further comprising a button on the side of the trigger guard of said housing that is shaped like a firearm, and wherein said button is positioned such that said button is pressed with underside of the knuckle area of the trigger finger of a person's right hand.  
   
   
       14 . An apparatus as recited in  claim 1  further comprising a button positioned on the interior of the trigger guard of said housing that is shaped like a firearm such that said button is above the trigger finger of a person's right hand, whereby the game player can press the button with the side of their trigger finger by moving their trigger finger in an upward direction.  
   
   
       15 . An apparatus as recited in  claim 1  further comprising a means to store and recall a set of button mappings in non-volatile memory, whereby a user is able to select a different set of button mappings depending upon which video game is being played.  
   
   
       16 . The apparatus of  claim 1  further comprising a button selected from the group consisting of: 
 a pump action button which is pressed by a pump action motion like on a shotgun,    and a clip reload button which is pressed by pushing on the bottom of the pistol grip of said gun shaped like a firearm,    and a button for selecting between fully automatic and semi automatic ammunition firing modes,    and a button which causes said apparatus to cease updating said video game with said motion information,    and a button which causes a change in the magnitude of said motion information reported to said video game,    and a DPAD button,    and a button located in the trigger location of said housing that is shaped like a firearm,    and a second button located in the trigger area of said housing that is shaped like a firearm,    and a third button located in the trigger area of said housing that is shaped like a firearm,    and a button on the side of the fore grip of said housing that is shaped like a firearm,    and a button positioned on the interior of the trigger guard of said housing that is shaped like a firearm such that said button is below the trigger finger of a person's right hand,    and a button positioned on the interior of the trigger guard of said housing that is shaped like a firearm such that said button is above the trigger finger of a person's right hand, and such that said button can be pressed with the side of a person's right hand index finger,    and a button on the side of the trigger guard of said housing that is shaped like a firearm and wherein said button is positioned such that said button is pressed with underside of the knuckle area of the trigger finger of a person's right hand,    and a button on the side of the fore grip of said housing that is shaped like a firearm that is pressed with the underside of the knuckle area of a finger of a person's left hand,    and a button used to map buttons within said plurality of buttons to other functions,    and a button used to create a macro command,    and a button used to alter the sensitivity of the gun motion that is reported to said video game,    and a button used to define and recall a collection of button mappings known as a profile,    and a button on the side of the trigger guard of said housing that is shaped like a firearm wherein said button is positioned such that it is easily pressed with underside of the knuckle area of the trigger finger of a person's right hand,    and a button on the side of the fore grip of said housing that is shaped like a firearm wherein said button is positioned such that it can be easily pressed with underside of the knuckle area of the thumb of a person's left hand,    and a button on the side of the pistol grip of said housing that is shaped like a firearm wherein said button is positioned such that it is pressed with underside of the knuckle area of a finger of a person's right hand,    and a button on the side of the pistol grip of said housing that is shaped like a firearm wherein said button is positioned such that it is pressed with underside of the knuckle area of the thumb of a person's right hand,    and a button mounted on the left hand side of the pistol grip for operation by the fingers of the users right hand,    and a button that is similar in location to the safety button of a firearm,    and a button that is pressed by a slide action actuator similar the slide action actuator of a semi-automatic pistol.    
   
   
       17 . An apparatus as recited in  claim 1  further comprising a means of temporarily diminishing the magnitude of said motion information transmitted to said video game, whereby a game player can reposition and adjust the aim of said apparatus to a new position without causing significant movement in said video game.  
   
   
       18 . The apparatus of  claim 17  further comprising a button selected from the group consisting of: 
 a pump action button which is pressed by a pump action motion like on a shotgun,    and a clip reload button which is pressed by pushing on the bottom of the pistol grip of said gun shaped like a firearm,    and a button for selecting between fully automatic and semi automatic ammunition firing modes,    and a button which causes said apparatus to cease updating said video game with said motion information,    and a button which causes a change in the magnitude of said motion information reported to said video game,    and a DPAD button,    and a button located in the trigger location of said housing that is shaped like a firearm,    and a second button located in the trigger area of said housing that is shaped like a firearm,    and a third button located in the trigger area of said housing that is shaped like a firearm,    and a button on the side of the fore grip of said housing that is shaped like a firearm,    and a button positioned on the interior of the trigger guard of said housing that is shaped like a firearm such that said button is below the trigger finger of a person's right hand,    and a button positioned on the interior of the trigger guard of said housing that is shaped like a firearm such that said button is above the trigger finger of a person's right hand, and such that said button can be pressed with the side of a person's right hand index finger,    and a button on the side of the trigger guard of said housing that is shaped like a firearm and wherein said button is positioned such that said button is pressed with underside of the knuckle area of the trigger finger of a person's right hand,    and a button on the side of the fore grip of said housing that is shaped like a firearm that is pressed with the underside of the knuckle area of a finger of a person's left hand,    and a button used to map buttons within said plurality of buttons to other functions,    and a button used to create a macro command,    and a button used to alter the sensitivity of the gun motion that is reported to said video game,    and a button used to define and recall a collection of button mappings known as a profile,    and a button on the side of the trigger guard of said housing that is shaped like a firearm wherein said button is positioned such that it is easily pressed with underside of the knuckle area of the trigger finger of a person's right hand,    and a button on the side of the fore grip of said housing that is shaped like a firearm wherein said button is positioned such that it can be easily pressed with underside of the knuckle area of the thumb of a person's left hand,    and a button on the side of the pistol grip of said housing that is shaped like a firearm wherein said button is positioned such that it is pressed with underside of the knuckle area of a finger of a person's right hand,    and a button on the side of the pistol grip of said housing that is shaped like a firearm wherein said button is positioned such that it is pressed with underside of the knuckle area of the thumb of a person's right hand,    and a button mounted on the left hand side of the pistol grip for operation by the fingers of the users right hand,    and a button that is similar in location to the safety button of a firearm,    and a button that is pressed by a slide action actuator similar the slide action actuator of a semi-automatic pistol.    
   
   
       19 . A method for adapting realistic gun motion input to a video game, the method comprising the steps of: 
 generating a plurality of images from a camera;    comparing images from said plurality of images to each other and detecting motion by calculating displacement of a subset of pixels from one image from said plurality of images to a subsequent image in said plurality of images;    using said displacement of said subset of pixels to calculate motion data;    update said video game with said motion data;    whereby moving said camera causes corresponding motion displayed by said video game.    
   
   
       20 . The method of  claim 19  further comprising the steps of: 
 determining if a game player would like to recalibrate the location of said camera that will correspond to causing no motion within said video game;    reporting motion values to said video game that cause no motion within said video game if has been determined that said game player has selected to recalibrate the zero location of said camera;    whereby a game player can reposition and adjust said camera to a new position without causing significant movement in said video game.    
   
   
       21 . The method of  claim 19  further comprising the step of choosing a subset of pixels to track from within an image from said plurality of images that has a high degree of dissimilarity with neighboring subsets of pixels.  
   
   
       22 . The method of  claim 19  further comprising the step of searching for said subset of pixels in a lower resolution version of an image from said plurality of images; 
 whereby computation time is decreased.    
   
   
       23 . The method of  claim 19  further comprising the steps of: 
 altering said subset of pixels so that it resembles a subset of pixels that would be generated if said camera were shifted less than one pixel distance in a chosen direction, thereby producing a shifted subset of pixels;    compare said shifted subset of pixels to a second subset of pixels within an image from said plurality of images;    using the magnitude of degree of shift of said shifted subset of pixels to calculate the degree of movement of said camera;    whereby camera movements smaller than one pixel can be detected and used to provide higher resolution motion information to said video game.