Sports simulation system

Abstract

A sports simulation system includes a projectile tracking apparatus having a display surface on which a visually apparent three-dimensional sports scene is presented. The projectile tracking apparatus captures images of a projectile tracking region disposed in front of the display surface to detect a launched projectile traveling through the projectile tracking region towards the display surface. At least one processing stage communicates with the projectile tracking apparatus and is responsive to the data received from camera devices to determine the three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through the projectile tracking region. The determined three-dimensional positions, velocity, acceleration and spin are used by the at least one processing stage to calculate a trajectory of the launched projectile into the visually apparent three-dimensional sports scene. Updated image data is generated by the at least one processing stage that includes a simulation of the launched projectile into the visually apparent three-dimensional sports scene following the calculated trajectory. A projection unit coupled to the at least one processing stage receives the image data from the at least one processing stage and presents the visually apparent three-dimensional sports scene, including the simulation, on the display surface.

1 . A sports simulation system comprising: 
 a projectile tracking apparatus including a display surface on which a visually apparent three-dimensional sports scene is presented, and at least one pair of camera devices capturing images of a projectile tracking region disposed in front of said display surface to detect a launched projectile traveling through said projectile tracking region towards said display surface, each camera device including processing capabilities processing captured images to detect the presence of a launched projectile therein; and    at least one processing stage receiving data from the camera devices relating to images in which a launched projectile exists and determining the three-dimensional positions, velocity, deceleration/acceleration and spin of a detected projectile traveling through said projectile tracking region, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into said visually apparent three-dimensional sports scene.    
     
     
         2 . A sports simulation system according to  claim 1  wherein said at least one processing stage uses said calculated trajectory to generate updated image data including a simulation of said launched projectile into said visually apparent three-dimensional sports scene following said calculated trajectory.  
     
     
         3 . A sports simulation system according to  claim 2  further comprising a projection device coupled to said at least one processing stage, said projection device receiving image data from said at least one processing stage and presenting said visually apparent three-dimensional sports scene including said simulation on said display surface.  
     
     
         4 . A sports simulation system according to  claim 3  wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said at least one processing stage updating said image data so that said at least one foreground action element responds to the simulation of said launched projectile.  
     
     
         5 . A sports simulation system according to  claim 3  wherein said projectile tracking apparatus includes a frame and at least one pair of camera devices mounted on said frame adjacent opposite top corners thereof, said camera devices having overlapping fields of view looking downwardly, across and in front of said display surface and capturing images of said projectile tracking region.  
     
     
         6 . A sports simulation system according to  claim 5  wherein said camera devices have generally perpendicular fields of view looking downwardly, across and in front of said display surface from adjacent opposite top corners of said frame.  
     
     
         7 . A sports simulation system according to  claim 3  wherein each camera device examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.  
     
     
         8 . A sports simulation system according to  claim 7  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.  
     
     
         9 . A sports simulation system according to  claim 3  further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation.  
     
     
         10 . A sports simulation system according to  claim 3  wherein said three-dimensional sports scene is developed from a combination of ground level and overhead images of a real life sports environment.  
     
     
         11 . A sports simulation system according to  claim 10  wherein said overhead images include at least one of satellite and aerial photographs.  
     
     
         12 . A sports simulation system according to  claim 3  wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images.  
     
     
         13 . A sports simulation system according to  claim 12  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.  
     
     
         14 . A sports simulation system comprising: 
 a projectile tracking apparatus including a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented; at least one pair of digital camera devices mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region, each of said digital camera devices including a first processor for processing image data and generating two-dimensional projectile coordinates when a projectile travels through said projectile tracking region and is captured in images acquired by said digital camera devices; and an audio system to broadcast audio accompanying said video sequence;    a host processor communicating with said digital camera devices and said audio system, said host processor calculating a three-dimensional trajectory of said projectile using the two-dimensional projectile coordinates received from each first processor and outputting image data including said calculated three-dimensional trajectory; and    a display unit receiving said image data and presenting said video sequence including a simulation of said calculated trajectory on said display surface.    
     
     
         15 . A sports simulation system according to  claim 14  wherein said visually apparent three-dimensional scene includes at least one foreground action element overlying and moveable over a background image, said host processor updating said image data so that said at least one foreground action element responds to the calculated trajectory of said projectile.  
     
     
         16 . A sports simulation system according to  claim 14  wherein said host processor executes sports simulation software including at least two of a training mode, a practice mode and a game play mode, the video sequence being consistent with the selected mode.  
     
     
         17 . A sports simulation system according to  claim 14  wherein each said first processor examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images.  
     
     
         18 . A sports simulation system according to  claim 17  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.  
     
     
         19 . A sports simulation system according to  claim 17  wherein said frame encompasses a rectangular region and wherein said digital camera devices are positioned at opposite top corners of said frame.  
     
     
         20 . A sports simulation system according to  claim 14  wherein the background of said video sequence is developed from a combination of ground level and overhead images of a real life sports environment.  
     
     
         21 . A sports simulation system according to  claim 20  wherein said overhead images include at least one of satellite and aerial photographs.  
     
     
         22 . A sports simulation system according to  claim 14  wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images.  
     
     
         23 . A sports simulation system according to  claim 22  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed.  
     
     
         24 . A sports simulation system comprising: 
 at least one pair of digital camera devices having overlapping fields of view looking across and in front of a display surface;    at least one processing stage processing image data from the camera devices relating to images in which a launched projectile exists and determining the three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through said overlapping fields of view, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into a visually apparent three-dimensional sports scene projected onto said display surface; and    a projection unit presenting said three-dimensional sport scene on said display surface including a simulation of said projectile following said calculated trajectory, said three-dimensional sports scene including image frames developed from a three-dimensional terrain model generated from images of a real life sports environment.    
     
     
         25 . A sports simulation system according to  claim 24  wherein said three-dimensional terrain model is generated from a combination of ground level and overhead images.  
     
     
         26 . A sports simulation system according to  claim 25  wherein said overhead photographs include at least one of satellite and aerial photographs.