USRE48914EActiveUtility

System and method for multipurpose traffic detection and characterization

78
Assignee: LEDDARTECH INCPriority: Mar 2, 2012Filed: Mar 1, 2013Granted: Feb 1, 2022
Est. expiryMar 2, 2032(~5.6 yrs left)· nominal 20-yr term from priority
G08G 1/0125G01S 17/58G06V 10/255G08G 1/0175G01S 17/66G06V 2201/08G06V 20/54G01S 17/88G06T 2200/04G01S 17/89G01S 17/86G06T 7/277G08G 1/054G01S 7/484G01S 7/4808G06T 2207/30236G06T 2207/10028G08G 1/04G01S 7/4802G08G 1/015G06K 9/3241G06K 2209/23G06K 9/00785
78
PatentIndex Score
7
Cited by
364
References
40
Claims

Abstract

A method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, comprising: providing a 3D optical emitter; providing a 3D optical receiver with a wide and deep field of view; driving the 3D optical emitter into emitting short light pulses; receiving a reflection/backscatter of the emitted light, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of the 3D optical receiver; using the individual digital full-waveform LIDAR trace and the emitted light waveform, detecting a presence of a plurality of vehicles, a position of at least part of each vehicle and a time at which the position is detected; assigning a unique identifier to each vehicle; repeating the steps of driving, receiving, acquiring and detecting, at a predetermined frequency; tracking and recording an updated position of each vehicle and an updated time at which the updated position is detected.

Claims

exact text as granted — not AI-modified
We claim: 
     
       1. A method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the method comprising:
 providing a 3D optical emitter at an installation height oriented to allow illumination of a 3D detection zone in said environment;   providing a 3D optical receiver oriented to have a wide and deep field of view within said 3D detection zone, said 3D optical receiver having a plurality of detection channels in said field of view;   driving the 3D optical emitter into emitting short light pulses toward the detection zone, said light pulses having an emitted light waveform;   receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone at said 3D optical receiver, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of said 3D optical receiver;   using said individual digital full-waveform LIDAR trace and said emitted light waveform, detecting a presence of a plurality of vehicles in said 3D detection zone, a position of at least part of each said vehicle in said 3D detection zone and a time at which said position is detected;   assigning a unique identifier to each vehicle of said plurality of vehicles detected;   repeating said steps of driving, receiving, acquiring and detecting, at a predetermined frequency;   at each instance of said repeating step, tracking and recording an updated position of each vehicle of said plurality of vehicles detected and an updated time at which said updated position is detected, with said unique identifier;   wherein said detecting said presence includes:
 extracting observations in the individual digital full-waveform LIDAR trace; 
 using the location for the observations to remove observations coming from a surrounding environment; 
 extracting lines using an estimate line and a covariance matrix using polar coordinates; 
 removing observations located on lines parallel to the x axis. 
   
     
     
       2. The method as claimed in  claim 1 , wherein said traffic control environment is at least one of a traffic management environment and a traffic enforcement environment. 
     
     
       3. The method as claimed in  claim 1 , wherein said detecting said presence includes
 extracting observations in the individual digital full-waveform LIDAR trace and intensity data for the observations;   finding at least one blob in the observations;   computing an observation weight depending on the intensity of the observations in the blob;   computing a blob gravity center based on the weight and a position of the observations in the blob.   
     
     
       4. The method as claimed in  claim 1 , further comprising setting at least one trigger line location and recording trigger line trespassing data with the unique identifier. 
     
     
       5. The method as claimed in  claim 4 , further comprising setting said trigger line location relative to a visible landmark in said environment. 
     
     
       6. The method as claimed in  claim 1 , wherein said detecting said time at which said position is detected includes assigning a timestamp for said detecting said presence and wherein said timestamp is adapted to be synchronized with an external controller. 
     
     
       7. The method as claimed in  claim 1 , further comprising obtaining a classification for each detected vehicles using a plurality of detections in the 3D detection zone caused by the same vehicle. 
     
     
       8. The method as claimed in  claim 1 , wherein said detecting said presence further comprises detecting a presence of a pedestrian in said environment. 
     
     
       9. The method as claimed in  claim 1 , wherein said part of said vehicle is one of a front, a side and a rear of the vehicle. 
     
     
       10. The method as claimed in  claim 1 , wherein emitting short light pulses includes emitting short light pulses of a duration of less than 50 ns. 
     
     
       11. The method as claimed in  claim 1 , wherein said 3D optical emitter is at least one of an infrared LED source, a visible-light LED source and a laser. 
     
     
       12. The method as claimed in  claim 1 , wherein said providing said 3D optical receiver to have a wide and deep field of view includes providing said 3D optical receiver to have a horizontal field of view angle of at least 20° and a vertical field of view angle of at least 4°. 
     
     
       13. The method as claimed in  claim 1 , further comprising determining and recording a speed for each said vehicle using said position and said updated position of one of said instances of said repeating step and an elapsed time between said time of said position and said updated time of said updated position, with said unique identifier. 
     
     
       14. The method as claimed in  claim 13 , further comprising using a Kalman filter to determine an accuracy for said speed to validate said speed; comparing said accuracy to a predetermined accuracy threshold; if said accuracy is lower than said predetermined accuracy threshold, rejecting said speed. 
     
     
       15. The method as claimed in  claim 14 , further comprising retrieving a speed limit and identifying a speed limit infraction by comparing said speed recorded for each said vehicle to said speed limit. 
     
     
       16. The method as claimed in  claim 1 , further comprising:
 providing a 2D optical receiver, wherein said 2D optical receiver being an image sensor adapted to provide images of said 2D detection zone;   driving the 2D optical receiver to capture a 2D image;   using image registration to correlate corresponding locations between said 2D image and said detection channels;   extracting vehicle identification data from said 2D image at a location corresponding to said location for said detected vehicle;   assigning said vehicle identification data to said unique identifier.   
     
     
       17. The method as claimed in  claim 16 , wherein the vehicle identification data is at least one of a picture of the vehicle and a license plate alphanumerical code present on the vehicle. 
     
     
       18. The method as claimed in  claim 17 , wherein the vehicle identification data includes said 2D image showing a traffic violation. 
     
     
       19. The method as claimed in  claim 17 , further comprising extracting at least one of a size of characters on the license plate and a size of the license plate and comparing one of said size among different instances of the repeating to determine an approximate speed value. 
     
     
       20. The method as claimed in  claim 16 , further comprising providing a 2D illumination source oriented to allow illumination of a 2D detection zone in said 3D detection zone and driving the 2D illumination source to emit pulses to illuminate said 2D detection zone and synchronizing said driving the 2D optical receiver to capture images with said driving the 2D illumination source to emit pulses to allow capture of said images during said illumination. 
     
     
       21. The method as claimed in  claim 20 , wherein driving the 2D illumination source includes driving the 2D illumination source to emit pulses of a duration between 10 μs and 10 ms. 
     
     
       22. The method as claimed in  claim 19 , wherein the 2D illumination source is at least one of a visible light LED source, an infrared LED light source and laser. 
     
     
       23. The method as claimed in  claim 19 , wherein the 3D optical emitter and the 2D illumination source are provided by a common infrared LED light source. 
     
     
       24. The method as claimed in  claim 19 , wherein the vehicle identification data is at least two areas of high retroreflectivity apparent on the images, said detecting a presence includes extracting observations in the individual digital signals and intensity data for the observations, the method further comprising correlating locations for the areas of high retroreflectivity and high intensity data locations in the observations, wherein each said area of high retroreflectivity is created from one of a retroreflective license plate, a retro-reflector affixed on a vehicle and a retro-reflective lighting module provided on a vehicle. 
     
     
       25. The method as claimed in  claim 16 , further comprising combining multiples ones of said captured images into a combined image with the vehicle and the vehicle identification data apparent. 
     
     
       26. A vehicle detection system for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the system comprising:
 a 3D optical emitter provided at an installation height and oriented to allow illumination of a 3D detection zonein the environment; 
 a 3D optical receiver provided and oriented to have a wide and deep field of view within the 3D detection zone, the 3D optical receiver having a plurality of detection channelsin said field of view; 
 a controller for driving the 3D optical emitter into emitting short light pulses toward the detection zone, the light pulses having an emitted light waveform; 
 the 3D optical receiver for receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone, thereby for acquiring an individual digital full-waveform light detection and ranging (LIDAR) trace for each channel of the 3D optical receiver; 
 a processor configured for detecting a presence of a plurality of vehicles in the 3D detection zone using the individual digital full-waveform LIDAR traceand the emitted light waveform, capturing a series of vehicle measurements from the LIDAR trace, detecting a position of at least part of each the vehicle in the 3D detection zone, recording a time at which the position is detected, and assigning a unique identifier to each vehicle of the plurality of vehicles detectedand tracking and recording an updated position of each vehicle of the plurality of vehicles detected and an updated time at which the updated position is detected, with the unique identifier; 
 a 2D optical receiver, wherein the 2D optical receiver is an image sensor adapted to provide images of the 2D detection zone; and 
 a driver for driving the 2D optical receiver image sensor to capture a 2D image the images; 
 the processor being further adapted configured for using image registration to correlate corresponding locations between said 2D image images and said detection channels, estimating a length of a vehicle by fitting a first line to a first subset of said series of vehicle measurements, estimating a width of a vehicle by fitting a second line to a second subset of the vehicle measurements, and extracting vehicle identification data from the 2D image at a location corresponding to the location for the a detected vehicle; and assigning the vehicle identification data to the unique identifier. 
 
     
     
       27. The system as claimed in  claim 26 , wherein said processor is further for determining and recording a speed for each the vehicle using the position and the an updated position of one of the instances of the repeating step and an elapsed time between the time of the position and the an updated time of the updated position, with the unique identifier. 
     
     
       28. The system as claimed in  claim 26 , further comprising a 2D illumination source provided and oriented to allow illumination of a 2D detection zone in the 3D detection zone;
 a source driver for driving the 2D illumination source to emit pulses; 
 a synchronization module for synchronizing said source driver and said driver to allow capture of said images while said 2D detection zone is illuminated. 
 
     
     
       29. A method for tracking and characterizing a plurality of vehicles simultaneously in a traffic control environment, the method comprising:
 providing a 3D optical emitter at an installation height oriented to allow illumination of a 3D detection zone in said environment;   providing a 3D optical receiver oriented to have a wide and deep field of view within said 3D detection zone, said 3D optical receiver having a plurality of detection channels in said field of view;   driving the 3D optical emitter into emitting short light pulses toward the detection zone, said light pulses having an emitted light waveform;   receiving a reflection/backscatter of the emitted light on the vehicles in the 3D detection zone at said 3D optical receiver, thereby acquiring an individual digital full-waveform LIDAR trace for each detection channel of said 3D optical receiver;   using said individual digital full-waveform LIDAR trace and said emitted light waveform, detecting a presence of a plurality of vehicles in said 3D detection zone, a position of at least part of each said vehicle in said 3D detection zone and a time at which said position is detected;   assigning a unique identifier to each vehicle of said plurality of vehicles detected;   repeating said steps of driving, receiving, acquiring and detecting, at a predetermined frequency;   at each instance of said repeating step, tracking and recording an updated position of each vehicle of said plurality of vehicles detected and an updated time at which said updated position is detected, with said unique identifier,   wherein said detecting said presence includes:
 extracting observations in the individual digital full-waveform LIDAR trace and intensity data for the observations; 
 finding at least one blob in the observations; 
 computing an observation weight depending on the intensity of the observations in the blob; 
 computing a blob gravity center based on the weight and a position of the observations in the blob. 
   
     
     
       30. The vehicle detection system of claim 26, wherein the processor is further configured to estimate a height of the vehicle. 
     
     
       31. The vehicle detection system of claim 26, wherein the processor is configured to estimate a volume of the vehicle based at least in part on the vehicle measurements. 
     
     
       32. The vehicle detection system of claim 26 wherein the processor is configured to identify a corner point of the vehicle less than a threshold distance from points on both of the first and second lines. 
     
     
       33. The vehicle detection system of claim 32, wherein the processor is configured to define a three-dimensional bounding box corresponding to the vehicle based on detection of corners. 
     
     
       34. The vehicle detection system of claim 33, wherein the three-dimensional bounding box represents an estimate of bounding dimensions of the vehicle. 
     
     
       35. The vehicle detection system of claim 34, wherein the processor is further configured to refine the estimate of the bounding dimensions as the light detection and ranging (LIDAR) trace is produced by reflection of the illumination signals from an increasing number of sides of the vehicle. 
     
     
       36. The vehicle detection system of claim 26, wherein the light detection and ranging (LIDAR) trace includes reflection of the illumination signals from a complete side of the vehicle, and wherein the processor is configured to determine dimensions of a three-dimensional bounding box corresponding to the vehicle based at least on full-waveform signal processing of the signal waveforms from the vehicle measurements for a complete side of the vehicle. 
     
     
       37. The vehicle detection system of claim 26, wherein the processor is configured to account for changes in the distance between the vehicle and the 3D optical emitter due to relative movement between the 3D optical emitter and the vehicle. 
     
     
       38. The vehicle detection system of claim 26, wherein the processor is configured to assign a classification to the vehicle based on a dimension of the vehicle. 
     
     
       39. The vehicle detection system of claim 38, wherein the classification is according to a classification scheme distinguishing two-wheeled and four-wheeled vehicles. 
     
     
       40. The vehicle detection system of claim 26, wherein the processor is configured to trigger an event based at least in part on a dimension of the vehicle.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.