Systems and Methods for Identifying Threats and Locations, Systems and Method for Augmenting Real-Time Displays Demonstrating the Threat Location, and Systems and Methods for Responding to Threats

Abstract

Systems for identifying threat materials such as CBRNE threats and locations are provided. The systems can include a data acquisition component configured to determine the presence of a CBRNE threat; data storage media; and processing circuitry operatively coupled to the data acquisition device and the storage media. Methods for identifying a CBRNE threat are provided. The methods can include: determining the presence of a CBRNE threat using a data acquisition component; and acquiring an image while determining the presence of the CBRNE threat. Methods for augmenting a real-time display to include the location and/or type of CBRNE threat previously identified are also provided. Methods for identifying and responding to CBRNE threats are provided as well.

1 .- 30 . (canceled) 
     
     
         31 . A system comprising:
 a threat or environmental detector configured to detect at least one of a chemical threat, a biological threat, a radiological threat, an explosive threat, a drug threat, and a narcotic threat;   a display device; and   processing circuitry operatively coupled to the detector and the display device, wherein the processing circuitry is configured to:
 determine a presence of a threat material on an exterior surface of an object in an area using the detector; 
 determine a location of the threat material in relation to the object when the presence of the threat material was determined using a depth sensing device; 
 generate an augmented reality tag based on the determined presence of the threat material, the location of the threat material in relation to the object, and a location of the detector; 
 associate the augmented reality tag with a three-dimensional model of the area; and 
 display augmented imagery on the display device based on the augmented reality tag and the three-dimensional model of the area to indicate the location of threat material on the exterior surface of the object. 
   
     
     
         32 . The system of  claim 31 , wherein the display device comprises at least one of glasses, a heads-up display, a monocular device, a hand-held device, and a spatial augmented reality device. 
     
     
         33 . The system of  claim 31 , wherein the detector comprises at least one of a chemical agent disclosure spray and an image acquisition device, an explosive trace detector, a biological analyzer, a bio-threat detector, a mass spectrometry instrument, an ion mobility spectrometer, a radiation detector, a spectroscopic radiation detector, and a radionuclide identification device. 
     
     
         34 . The system of  claim 31 , further comprising a global positioning system (GPS) device configured to determine the location of the detector, wherein the location of the detector is a geolocation of the detector. 
     
     
         35 . The system of  claim 31 , wherein the processing circuitry is further configured to use simultaneous localization and mapping to determine the location of the threat material in relation to the object and the location of the detector when the presence of the threat material was determined. 
     
     
         36 . The system of  claim 31 , wherein the processing circuitry is further configured to display the augmented imagery on the display device to indicate the location of the threat material on the exterior surface of the object based on the location of the threat material in relation to the object after the object has been moved to a secondary location different from a location where the presence of the threat material was determined. 
     
     
         37 . The system of  claim 31 , wherein the processing circuitry is further configured to display the augmented imagery on a second display device to indicate the location of the threat material on the exterior surface of the object. 
     
     
         38 . The system of  claim 31 , wherein the processing circuitry is further configured to determine a threat type of the threat material using the detector and display the threat type on the display device. 
     
     
         39 . The system of  claim 31 , wherein the processing circuitry is further configured to determine a time when the threat material was detected, and wherein the generating the augmented reality tag is further based on the time when the threat material was detected. 
     
     
         40 . The system of  claim 31 , wherein the display device is separate from the detector. 
     
     
         41 . The system of  claim 31 , wherein the display device and the detector are parts of the same device. 
     
     
         42 . A method comprising:
 detecting a presence of a threat material on an exterior surface of an object in an area using a threat or environmental detector configured to detect at least one of a chemical threat, a biological threat, a radiological threat, an explosive threat, a drug threat, and a narcotic threat;   determining a location of the threat material in relation to an object in an area using a depth sensing device;   generating an augmented reality tag based on the detected presence of the threat material, the location of the threat material in relation to the object, and a location of the detector;   associating the augmented reality tag with a three-dimensional model of the area; and   displaying augmented imagery on a display device based on the augmented reality tag and the three-dimensional model of the area to indicate the location of the threat material on the exterior surface of the object.   
     
     
         43 . The method of  claim 42 , further comprising determining a geolocation of the detector and associating the augmented reality tag with the three-dimensional model of the area based on at least the geolocation of the detector and the location of the threat material in relation to the detector. 
     
     
         44 . The method of  claim 42 , further comprising determining the location of the threat material in relation to the object and the location of the detector when the presence of the threat material was determined utilizing simultaneous localization and mapping. 
     
     
         45 . The method of  claim 42 , further comprising displaying the augmented imagery on a second display device based on the augmented reality tag and the three-dimensional model of the area to indicate the location of threat material on the exterior surface of the object. 
     
     
         46 . The method of  claim 42 , further comprising determining a time when the threat material was detected, and wherein the generating the augmented reality tag is further based on the time when the threat material was detected. 
     
     
         47 . The method of  claim 42 , wherein the display device is separate from the detector. 
     
     
         48 . The method of  claim 47 , wherein the display device is disposed at a location remote from the threat material. 
     
     
         49 . The method of  claim 42 , wherein the display device and the detector are parts of the same device. 
     
     
         50 . The method of  claim 49 , further comprising determining a threat type of the threat material using the detector and displaying the threat type on the display device.