Information processing device, information processing method, information processing program, image processing device, and image processing system for associating position information with captured images

Abstract

Provided is an information processing device configured to: acquire an image captured according to an imaging instruction by an imaging device mounted to a mobile object; acquire sensor information including position information about the mobile object from a sensor device according to a signal transmitted from the imaging device in response to the imaging instruction; and associate the acquired sensor information with the acquired image.

The invention claimed is: 
     
       1. An information processing device, comprising:
 processing circuitry configured to
 acquire an image captured according to an imaging instruction by an imaging device mounted on a mobile object, 
 acquire sensor information including position information about the mobile object from a sensor device according to an exposure notification signal transmitted by the imaging device to the sensor device at a fixed timing that is relative to an exposure end timing of the captured image, the exposure notification signal being transmitted from the imaging device to the sensor device in response to the imaging instruction, and 
 store the position information included in the acquired sensor information in association with the acquired image. 
 
 
     
     
       2. The information processing device according to  claim 1 , wherein
 the sensor information includes altitude information about the mobile object. 
 
     
     
       3. The information processing device according to  claim 1 , wherein
 the sensor information includes inclination information about the mobile object. 
 
     
     
       4. The information processing device according to  claim 1 , wherein
 the exposure notification signal indicates the exposure end timing related to the capture of the image by the imaging device. 
 
     
     
       5. The information processing device according to  claim 4 , wherein
 the sensor information is most recent sensor information at a point in time of the exposure end timing. 
 
     
     
       6. The information processing device according to  claim 1 , wherein
 the processing circuitry is further configured to compute new sensor information from the sensor information, and associate the new sensor information with the image. 
 
     
     
       7. The information processing device according to  claim 4 , wherein
 the fixed timing that is relative to the exposure end timing is the exposure end timing of an end of the exposure that the imaging device performs to capture the image, a timing of a beginning of the exposure that the imaging device performs to capture the image, or a timing at which the imaging instruction for the imaging device to capture the image is issued. 
 
     
     
       8. The information processing device according to  claim 1 , wherein
 the processing circuitry is further configured to create a composite image by arranging a plurality of images on a basis of the sensor information, the plurality of images including the acquired image. 
 
     
     
       9. The information processing device according to  claim 8 , wherein
 the processing circuitry is further configured to arrange the plurality of images while correcting positions on a basis of the sensor information. 
 
     
     
       10. The information processing device according to  claim 8 , wherein
 the sensor information includes altitude information about the mobile object, and 
 the processing circuitry is further configured to arrange the acquired image while enlarging or reducing the acquired image on a basis of the altitude information. 
 
     
     
       11. The information processing device according to  claim 8 , wherein
 the sensor information includes inclination information about the mobile object, and 
 the processing circuitry is further configured to arrange the acquired image while performing a keystone correction and/or a trimming process on a basis of the inclination information. 
 
     
     
       12. The information processing device according to  claim 1 , wherein
 the processing circuitry is further configured to acquire elevation data indicating an elevation of a ground surface imaged by the imaging device, and associate the elevation data with the sensor information. 
 
     
     
       13. The information processing device according to  claim 12 , wherein
 the processing circuitry is further configured to associate the elevation data with the image. 
 
     
     
       14. The information processing device according to  claim 12 , wherein
 the elevation data is acquired from map data containing information about a position and an elevation, on a basis of the position information about the mobile object. 
 
     
     
       15. The information processing device according to  claim 12 , wherein
 the elevation data is acquired on a basis of distance information acquired by a ranging sensor mounted on the mobile object. 
 
     
     
       16. The information processing device according to  claim 15 , wherein
 the processing circuitry is further configured to acquire the elevation data from the ranging sensor according to the exposure notification signal transmitted from the imaging device in response to the imaging instruction, and associate the acquired elevation data with the sensor information. 
 
     
     
       17. The information processing device according to  claim 1 , wherein the processing circuitry is configured to
 acquire a plurality of images captured by the imaging device mounted on the mobile object, the plurality of images being used to construct a composite image and including the acquired image, and 
 the processing circuitry is configured to store position information for each of the plurality of images. 
 
     
     
       18. The information processing device according to  claim 1 , wherein
 the imaging instruction is issued in accordance with an imaging plan; 
 the processing circuitry is configured to
 acquire elevation data indicating an elevation of a ground surface imaged by the imaging device, and associate the elevation data with the sensor information, and 
 change the imaging plan based on the elevation data. 
 
 
     
     
       19. An information processing method, comprising:
 acquiring an image captured according to an imaging instruction by an imaging device mounted on a mobile object; 
 acquiring sensor information including position information about the mobile object from a sensor device according to an exposure notification signal transmitted by the imaging device to the sensor device at a fixed timing that is relative to an exposure end timing of the captured image, the exposure notification signal being transmitted from the imaging device to the sensor device in response to the imaging instruction; and 
 storing the position information included in the acquired sensor information in association with the acquired image. 
 
     
     
       20. The information processing method according to  claim 17 , wherein
 the imaging instruction is issued in accordance with an imaging plan; and 
 the information processing method further includes
 acquiring elevation data indicating an elevation of a ground surface imaged by the imaging device, 
 associating the elevation data with the sensor information, and 
 changing the imaging plan based on the elevation data. 
 
 
     
     
       21. An image processing device, comprising:
 processing circuitry configured to
 receive a plurality of images with sensor information including position information, each position information being stored in association with a different one of the plurality of images and about a mobile object acquired according to an exposure notification signal transmitted by an imaging device to a sensor device at a fixed timing that is relative to an exposure end timing of the respective one of the plurality of images, the exposure notification signal being transmitted from the imaging device to the sensor device in response to an imaging instruction, and 
 create a composite image by arranging the plurality of images on a basis of the position information included in the sensor information. 
 
 
     
     
       22. The image processing device according to  claim 21 , wherein the processing circuitry is further configured to
 create the composite image by arranging the plurality of images on a basis of elevation data indicating an elevation of a ground surface imaged by the imaging device. 
 
     
     
       23. The image processing device according to  claim 22 , wherein the processing circuitry is further configured to
 define a first coordinate system corresponding to an imaging range of the imaging device in association with a movement of the mobile object and a second coordinate system corresponding to a plane in which one of the plurality of images is arranged, 
 compute a projected position of the one of the plurality of images on the ground surface in the first coordinate system on a basis of the sensor information and the elevation data, and 
 arrange the one of the plurality of images by converting the projected position to the second coordinate system. 
 
     
     
       24. The image processing device according to  claim 22 , wherein
 the elevation data is acquired from map data containing information about a position and an elevation. 
 
     
     
       25. The image processing device according to  claim 22 , wherein
 the elevation data is acquired by a ranging sensor mounted on the mobile object.