Method and system for tracking and behavioral monitoring of multiple objects moving through multiple fields-of-view

Abstract

A computerized method of video analysis that includes receiving several series of video frames generated by a number of image sensors. Each image sensor has a field-of-view. The image sensors monitor a portion of a monitored environment. The computerized method also includes concurrently tracking, independent of calibration, multiple objects within the monitored environment as the objects move between fields-of-view, at least two of which overlap, and multiple objects within one field-of-view. The tracking is based on the plurality of received series of video frames

1 . A computerized method of video analysis comprising: 
 receiving a plurality of series of video frames generated by a plurality of image sensors, each having a field-of-view, which monitor portions of a monitored environment; and    concurrently tracking, independent of calibration (i) a plurality of objects within the monitored environment as the objects move between fields-of-view, at least two of which overlap, and ii) a plurality of objects within one field-of-view based on the plurality of received series of video frames.    
   
   
       2 . The method of  claim 1  wherein the image sensors are cameras.  
   
   
       3 . The method of  claim 1  further comprising tracking objects based on a probability that an object included in one video frame generated by a first image sensor at a first point in time will be included in a video frame generated by a second image sensor a second point in time.  
   
   
       4 . The method of  claim 1  further comprising: 
 storing a plurality of blob states over time, each state including a number of objects included in the blob and a blob signature; and    storing a plurality of transition likelihood values representing the probability that objects within one blob at one instant in time correspond to objects within other blobs at other instants in time.    
   
   
       5 . The method of  claim 4  further comprising altering the stored transition probabilities upon analysis of additional video frames.  
   
   
       6 . The method of  claim 4  further comprising storing object data indicating correspondences between objects and blob states.  
   
   
       7 . The method of  claim 4  generating a tracking solution based on the blob states and transition probabilities.  
   
   
       8 . The method of  claim 1  generating tracking metadata including at least one of object track data, tracking solutions, object feature data and field-of-view data.  
   
   
       9 . The method of  claim 8  further comprising: 
 selecting a rule set to analyze generated tracking metadata; and    evaluating, using a rules engine, the tracking metadatabased on the rule set.    
   
   
       10 . The method of  claim 9  further comprising selecting the rule set to monitor parking lot security.  
   
   
       11 . The method of  claim 9  further comprising selecting the rule set to detect property theft.  
   
   
       12 . The method of  claim 9  further comprising selecting the rule set to detect hazards to children.  
   
   
       13 . The method of  claim 9  further comprising selecting the rule set to monitor public safety.  
   
   
       14 . The method of  claim 9  further comprising selecting the rule set to determine merchandizing and operations statistics.  
   
   
       15 . A computerized system for video analysis comprising: 
 a receiving module configured to receive a plurality of series of video frames, the series of video frames generated by a plurality of image sensors which monitor portions of a monitored environment and have a field-of-view; and    a calibration-independent tracking module in communication with the receiving module and configured to i) concurrently track a plurality of objects within the monitored environment as the objects move between fields-of-view at least two of which overlap and ii) concurrently track a plurality of objects within one field-of-view based on the plurality of received series of video frames, the tracking module outputting tracking metadata.    
   
   
       16 . The system of  claim 15  further comprising a rules engine in communication with the tracking module and receiving the tracking metadata.  
   
   
       17 . A system for monitoring parking lot security comprising: 
 a receiving module configured to receive a plurality of series of video frames, the series of video frames generated by a plurality of image sensors which monitor portions of a monitored environment and have a field-of-view;    a calibration-independent tracking module in communication with the receiving module and configured to i) concurrently track a plurality of objects within the monitored environment as the objects move between fields-of-view at least two of which overlap and ii) concurrently track a plurality of objects within one field-of-view based on the plurality of received series of video frames, the tracking module outputting tracking metadata; and    a rules engine utilizing a parking lot security rule set configured to receive and evaluate the tracking metadata.    
   
   
       18 . A system for property theft detection comprising: 
 a receiving module configured to receive a plurality of series of video frames, the series of video frames generated by a plurality of image sensors which monitor portions of a monitored environment and have a field-of-view;    a calibration-independent tracking module in communication with the receiving module and configured to i) concurrently track a plurality of objects within the monitored environment as the objects move between fields-of-view at least two of which overlap and ii) concurrently track a plurality of objects within one field-of-view based on the plurality of received series of video frames, the tracking module outputting tracking metadata; and    a rules engine utilizing a theft detection rule set configured to receive and evaluate the tracking metadata.    
   
   
       19 . A system for child hazard detection comprising: 
 a receiving module configured to receive a plurality of series of video frames, the series of video frames generated by a plurality of image sensors which monitor portions of a monitored environment and have a field-of-view;    a calibration-independent tracking module in communication with the receiving module and configured to i) concurrently track a plurality of objects within the monitored environment as the objects move between fields-of-view at least two of which overlap and ii) concurrently track a plurality of objects within one field-of-view based on the plurality of received series of video frames, the tracking module outputting tracking metadata; and    a rules engine utilizing a child safety rule set configured to receive and evaluate the tracking metadata.    
   
   
       20 . A system for property theft detection comprising: 
 a receiving module configured to receive a plurality of series of video frames, the series of video frames generated by a plurality of image sensors which monitor portions of a monitored environment and have a field-of-view;    a calibration-independent tracking module in communication with the receiving module and configured to i) concurrently track a plurality of objects within the monitored environment as the objects move between fields-of-view at least two of which overlap and ii) concurrently track a plurality of objects within one field-of-view based on the plurality of received series of video frames, the tracking module outputting tracking metadata; and    a rules engine utilizing a public safety monitoring rule set configured to receive and evaluate the tracking metadata.    
   
   
       21 . A system for merchandizing and operations statistical analysis comprising: 
 a receiving module configured to receive a plurality of series of video frames, the series of video frames generated by a plurality of image sensors which monitor portions of a monitored environment and have a field-of-view;    a calibration-independent tracking module in communication with the receiving module and configured to i) concurrently track a plurality of objects within the monitored environment as the objects move between fields-of-view at least two of which overlap and ii) concurrently track a plurality of objects within one field-of-view based on the plurality of received series of video frames, the tracking module outputting tracking metadata; and    a rules engine utilizing a merchandizing and operations statistical rule set configured to receive and evaluate the tracking metadata.