Sports simulation system

Abstract

A sports simulation system includes a projectile tracking apparatus having a display surface on which a visually apparent three-dimensional sports scene is presented. The projectile tracking apparatus captures images of a projectile tracking region disposed in front of the display surface to detect a launched projectile traveling through the projectile tracking region towards the display surface. A projectile launch area sensing unit captures images of the projectile launch area. At least one processing stage communicates with the projectile tracking apparatus and the projectile launch area sensing unit and is responsive to the data received therefrom to determine the three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through the projectile tracking region. The determined three-dimensional positions, velocity, acceleration and spin are used by the at least one processing stage to calculate a trajectory of the launched projectile into the visually apparent three-dimensional sports scene. Updated image data is generated by the at least one processing stage that includes a simulation of the launched projectile into the visually apparent three-dimensional sports scene following the calculated trajectory. A projection unit coupled to the at least one processing stage receives the image data from the at least one processing stage and presents the visually apparent three-dimensional sports scene, including the simulation, on the display surface.

1 . A sports simulation system comprising:
 a projectile tracking apparatus including a display surface on which a visually apparent three-dimensional sports scene is presented, and at least one pair of camera devices capturing images of a projectile tracking region disposed in front of said display surface to detect a launched projectile traveling through said projectile tracking region towards said display surface;   a launch area sensing unit capturing images of a region in which contact with said projectile is made; and   at least one processing stage receiving data from the camera devices and said launch area sensing unit and determining the three-dimensional positions, velocity, acceleration and spin of a detected launched projectile traveling through said projectile tracking region, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into said visually apparent three-dimensional sports scene.   
   
   
       2 . A sports simulation system according to  claim 1  wherein said at least one processing stage uses said calculated trajectory to generate updated image data including a simulation of said launched projectile into said visually apparent three-dimensional sports scene following said calculated trajectory. 
   
   
       3 . A sports simulation system according to  claim 2  further comprising a projection device coupled to said at least one processing stage, said projection device receiving image data from said at least one processing stage and presenting said visually apparent three-dimensional sports scene including said simulation on said display surface. 
   
   
       4 . A sports simulation system according to  claim 3  wherein said projectile tracking apparatus includes a frame and at least one pair of camera devices mounted on said frame adjacent opposite top corners thereof, said camera devices having overlapping fields of view looking downwardly, across and in front of said display surface and capturing images of said projectile tracking region. 
   
   
       5 . A sports simulation system according to  claim 4  wherein said camera devices have generally perpendicular fields of view looking downwardly, across and in front of said display surface from adjacent opposite top corners of said frame. 
   
   
       6 . A sports simulation system according to  claim 3  wherein each camera device examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images. 
   
   
       7 . A sports simulation system according to  claim 6  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed. 
   
   
       8 . A sports simulation system according to  claim 3  further including an audio system to broadcast audio accompanying said visually apparent three-dimensional sports scene and simulation. 
   
   
       9 . A sports simulation system according to  claim 3  wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images. 
   
   
       10 . A sports simulation system according to  claim 9  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed. 
   
   
       11 . A sports simulation system according to  claim 2  wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched towards said display surface. 
   
   
       12 . A sports simulation system according to  claim 11  wherein said launch area sensing unit further comprises at least one illuminator to illuminate in said launch area. 
   
   
       13 . A sports simulation system according to  claim 2  wherein said at least one processing stage processes image data received from the launch area sensing unit to determine the angle at which impact with the projectile is made. 
   
   
       14 . A sports simulation system according to  claim 13  wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched towards said display surface. 
   
   
       15 . A sports simulation system according to  claim 14  wherein said launch area sensing unit is above and looks down onto said launch area. 
   
   
       16 . A sports simulation system according to  claim 15  wherein said launch area sensing unit processes captured images to determine if one or more moving objects satisfying specified motion criteria are in the captured images, and if so outputs the captured images to said at least one processing stage. 
   
   
       17 . A sports simulation system comprising:
 a projectile tracking apparatus including a frame encompassing a display surface on which a video sequence portraying a visually apparent three-dimensional sports scene is presented; and at least one pair of digital camera devices mounted on said frame and having fields of view looking across and in front of said display surface that overlap in a generally perpendicular fashion and encompassing a projectile tracking region, each of said digital camera devices including a first processor for processing image data and generating two-dimensional projectile coordinates when a projectile travels through said projectile tracking region and is captured in images acquired by said digital camera devices;   a launch area sensing unit capturing images of a region in which contact with said projectile is made;   a host processor communicating with said digital camera devices and said launch area sensing unit, said host processor calculating a three-dimensional trajectory of said projectile taking into account projectile spin using the two-dimensional projectile coordinates received from each first processor and the image data output of said launch area sensing unit and outputting image data including said calculated three-dimensional trajectory; and   a display unit receiving said image data and presenting said video sequence including a simulation of said calculated trajectory on said display surface.   
   
   
       18 . A sports simulation system according to  claim 17  wherein each said first processor examines captured images to detect pixel clusters resembling a projectile characteristic signature thereby to detect said projectile in said captured images. 
   
   
       19 . A sports simulation system according to  claim 18  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed. 
   
   
       20 . A sports simulation system according to  claim 18  wherein said frame encompasses a rectangular region and wherein said digital camera devices are positioned at opposite top corners of said frame. 
   
   
       21 . A sports simulation system according to  claim 17  wherein during processing, each camera device uses a projectile signature to distinguish a launched projectile from other objects in said captured images. 
   
   
       22 . A sports simulation system according to  claim 21  wherein said projectile characteristic signature defines one or more of projectile size, shape, reflectivity and speed. 
   
   
       23 . A sports simulation system according to  claim 17  wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched toward said display surface. 
   
   
       24 . A sports simulation system according to  claim 23  wherein said launch area sensing unit further comprises at least one illuminator to illuminate in said launch area. 
   
   
       25 . A sports simulation system according to  claim 23  wherein said host processor processes image data received from the launch area sensing unit to determine the angle at which impact with the projectile is made. 
   
   
       26 . A sports simulation system according to  claim 23  wherein said launch area sensing unit is above and looks down onto said launch area. 
   
   
       27 . A sports simulation system according to  claim 26  wherein said launch area sensing unit processes captured images to determine if one or more moving objects satisfying specified motion criteria are in the captured images, and if so outputs the captured images to said host processor. 
   
   
       28 . A sports simulation system comprising:
 at least one pair of digital camera devices having overlapping fields of view looking across and in front of a display surface;   a launch area sensing unit capturing images of the region in which contact with said projectile is mode;   at least one processing stage processing image data from the camera devices and said launch area sensing unit relating to images in which a launched projectile exists and determining the three-dimensional positions, velocity, acceleration and spin of a detected launched projectile traveling through said overlapping fields of view, the three-dimensional positions, velocity, acceleration and spin being used by said at least one processing stage to calculate a trajectory of said launched projectile into a visually apparent three-dimensional sports scene projected onto said display surface; and   a projection unit presenting said three-dimensional sport scene on said display surface including a simulation of said projectile following said calculated trajectory.   
   
   
       29 . A sports simulation system according to  claim 28  wherein said launch area sensing unit comprises at least one camera device having a field of view generally encompassing a launch area within which the projectile is launched toward said display surface. 
   
   
       30 . A sports simulation system according to  claim 29  wherein said launch area sensing unit further comprises at least one illuminator to illuminate in said launch area. 
   
   
       31 . A sports simulation system according to  claim 30  wherein said at least one processing stage processes image data received from the launch area sensing unit to determine the angle at which impact with the projectile is made. 
   
   
       32 . A sports simulation system according to  claim 29  wherein said launch area sensing unit is above said launch area. 
   
   
       33 . A sports simulation system according to  claim 32  wherein said launch area sensing unit processes captured images to determine if one or more moving objects satisfying specified motion criteria are in the captured images, and if so outputs the captured images to said at least one processing stage.