Dynamic vibration sensor optics distortion prediction

Abstract

The present disclosure discloses a system and a method for mitigating image distortion. In an example implementation, the system and the method can receive vehicle state data and vehicle inertial measurement data; generate an image distortion prediction indicative of image distortion within an image captured by the image capture assembly based on the vehicle state data and the vehicle inertial measurement data; and at least one of correct or mitigate the image distortion based on the image distortion prediction.

What is claimed is: 
     
       1. A system comprising a computer including a processor and a memory, the memory including instructions such that the processor is programmed to:
 receive vehicle state data, vehicle inertial measurement data, and strain data indicative of displacement on an image capture assembly; 
 generate an image distortion prediction indicative of image distortion within an image captured by the image capture assembly based on the vehicle state data, the vehicle inertial measurement data, and the strain data; 
 at least one of correct or mitigate image distortion within the image based on the image distortion prediction; and 
 determine whether to modify one or more vehicle actions, including at least a vehicle speed or a vehicle course, based on the image distortion prediction. 
 
     
     
       2. The system of  claim 1 , wherein the processor is further programmed to actuate the vehicle based on the image distortion prediction. 
     
     
       3. The system of  claim 1 , wherein the image distortion prediction includes at least one of a distortion type or a distortion magnitude. 
     
     
       4. The system of  claim 3 , wherein the at least one of the distortion type or the distortion magnitude comprises at least one of an image translation, an image rotation, or an image distortion error. 
     
     
       5. The system of  claim 3 , wherein the processor is further programmed to mitigate the image distortion based on the image distortion prediction by accessing a lookup table based on the at least one of the distortion type or the distortion magnitude and applying an image correction technique corresponding to the at least one of the distortion type or the distortion magnitude. 
     
     
       6. The system of  claim 1 , wherein the processor is further programmed to update a vehicle routing algorithm based on the image distortion prediction. 
     
     
       7. The system of  claim 1 , further comprising the image capture assembly disposed over a roof of the vehicle. 
     
     
       8. The system of  claim 7 , wherein the image capture assembly comprises a housing including a camera. 
     
     
       9. The system of  claim 8 , further comprising a sensor disposed within the housing. 
     
     
       10. The system of  claim 9 , wherein the sensor measures at least one of strain data indicative of strain on the image capture assembly or inertial measurement data of the image capture assembly. 
     
     
       11. The system of  claim 9 , wherein the camera comprises a stereoscopic camera, wherein the sensor is attached to a lens assembly of at least one of a first camera or a second camera of the stereoscopic camera. 
     
     
       12. The system of  claim 1 , wherein the processor is further programmed to modify an image filter parameter of an image perception algorithm based on the image distortion prediction. 
     
     
       13. A method comprising:
 receiving vehicle state data, vehicle inertial measurement data, and strain data indicative of displacement on an image capture assembly; 
 generating an image distortion prediction indicative of image distortion within an image captured by the image capture assembly based on the vehicle state data, the vehicle inertial measurement data, and the strain data; 
 at least one of correcting or mitigating image distortion within the image based on the image distortion prediction; and 
 determining whether to modify one or more vehicle actions, including at least a vehicle speed or a vehicle course, based on the image distortion prediction. 
 
     
     
       14. The method of  claim 13 , further comprising actuating the vehicle based on the image distortion prediction. 
     
     
       15. The method of  claim 14 , wherein the image distortion prediction includes at least one of a distortion type or a distortion magnitude. 
     
     
       16. The method of  claim 15 , wherein the at least one of the distortion type or the distortion magnitude comprises at least one of an image translation, an image rotation, or an image distortion error. 
     
     
       17. The method of  claim 15 , wherein the mitigating the image distortion based on the image distortion prediction includes accessing a lookup table based on the at least one of the distortion type or the distortion magnitude and applying an image correction technique corresponding to the at least one of the distortion type or the distortion magnitude.