Surveillance monitoring method

Abstract

A surveillance monitoring method is provided, which includes: executing an algorithm using a camera to perform a first inference on recognition of an obstacle and recognition of a target; tracking at least one object using the camera to generate image information; performing a second inference on recognition of the obstacle and recognition of the target using a radar; tracking the at least one object using the radar to generate radar information; fusing the image information and the radar information to obtain a first recognition result; collecting environmental information using the camera or the radar, and forming a confidence level based on the environmental information, the first inference, and the second inference; and dynamically adjusting a proportion of the image information and the radar information according to the confidence level when fusing the image information and the radar information to obtain a second recognition result.

What is claimed is: 
     
         1 . A surveillance monitoring method, comprising:
 executing an algorithm using a camera to perform a first inference on recognition of an obstacle and recognition of a target;   tracking at least one object using the camera to generate image information;   performing a second inference on recognition of the obstacle and recognition of the target using a radar;   tracking the at least one object using the radar to generate radar information;   fusing the image information and the radar information to obtain a first recognition result;   collecting environmental information using the camera or the radar, and forming a confidence level based on the environmental information, the first inference, and the second inference; and   dynamically adjusting a proportion of the image information and the radar information according to the confidence level when fusing the image information and the radar information to obtain a second recognition result.   
     
     
         2 . The surveillance monitoring method of  claim 1 , wherein the camera is a PTZ camera. 
     
     
         3 . The surveillance monitoring method of  claim 1 , wherein the algorithm is a machine learning algorithm or a deep learning algorithm. 
     
     
         4 . The surveillance monitoring method of  claim 1 , wherein the camera or the radar uses an extended Kalman filter (EKF) algorithm to track the object. 
     
     
         5 . The surveillance monitoring method of  claim 1 , wherein the radar is a millimeter wave radar. 
     
     
         6 . The surveillance monitoring method of  claim 1 , wherein the camera and the radar are integrated in a surveillance monitoring device.