Information processing apparatus, imaging apparatus, and information processing method each of which issues a notification of blur of an object, and control method for the imaging apparatus

Abstract

An apparatus includes an acquisition unit configured to acquire a first captured image obtained by first image capturing with a first image capturing parameter and motion information about an object in the first captured image, a setting unit configured to set a second image capturing parameter, an estimation unit configured to estimate motion blur of an object in a second captured image which is obtained in a case where second image capturing is performed with the second image capturing parameter, based on the motion information and the second image capturing parameter, and a notification unit configured to issue a notification of the motion blur.

What is claimed is: 
     
       1. An apparatus comprising:
 one or more processors; and 
 a memory storing instructions which, when executed by the one or more processors, cause the apparatus to function as: 
 an acquisition unit configured to acquire first captured images obtained by the first image capturing with a first image capturing parameter in an image sensor and motion information about an object in the first captured images; 
 a setting unit configured to set a second image capturing parameter; 
 an estimation unit configured to estimate motion blur of an object based on the motion information and the second image capturing parameter; 
 a notification unit configured to issue a notification of the motion blur; and 
 an instruction unit configured to issue an image capturing instruction while a first captured image obtained by the first image capturing with the first image capturing parameter in the image sensor is sequentially output, 
 wherein the image sensor outputs the second captured image obtained by second image capturing with the second image capturing parameter in response to the image capturing instruction, 
 wherein the acquisition unit calculates a motion vector in each of a plurality of regions, and a difference between the first captured images for each of the block regions, and 
 wherein the notification unit issues the notification of the motion blur prior to receiving the image capturing instruction. 
 
     
     
       2. The apparatus according to  claim 1 , wherein the estimation unit estimates the motion blur based on the motion information, the first image capturing parameter, and the second image capturing parameter. 
     
     
       3. The apparatus according to  claim 1 , wherein the acquisition unit calculates and acquires the motion information by making a comparison in image between the first captured images. 
     
     
       4. The apparatus according to  claim 1 , wherein the notification unit issues a notification of the motion blur by displaying information corresponding to the motion blur on a display unit. 
     
     
       5. The apparatus according to  claim 1 , wherein the notification unit issues a notification of the motion blur by superimposing information corresponding to the motion blur on the first captured image and displaying the first captured image with the information superimposed thereon on a display unit. 
     
     
       6. The apparatus according to  claim 1 ,
 wherein the acquisition unit acquires motion information corresponding to a plurality of regions of the first captured images; 
 wherein the estimation unit estimates motion blur in a plurality of regions of the second captured image from the motion information corresponding to the plurality of regions of the first captured images, and 
 wherein the notification unit issues a notification of the motion blur for each of a plurality of corresponding regions. 
 
     
     
       7. The apparatus according to  claim 6 , wherein the notification unit issues a notification of the motion blur by displaying, in each of the first captured images, a frame for every region in which motion blur in the second captured image has been estimated to have a predetermined amount of blur or more. 
     
     
       8. The apparatus according to  claim 6 , wherein the notification unit issues a notification of the motion blur by displaying, in each of the first captured images, an edge region in a discriminable manner for every region in which motion blur in the second captured image has been estimated to have a predetermined amount of blur or more. 
     
     
       9. The apparatus according to  claim 1 ,
 wherein the first image capturing is performed before the second image capturing, and 
 wherein the notification unit issues a notification of the motion blur while the acquisition unit is sequentially acquiring the first captured images. 
 
     
     
       10. The apparatus according to  claim 1 ,
 wherein, when the second image capturing parameter is changed by the setting unit, the estimation unit performs re-estimation of the motion blur, and 
 wherein the notification unit issues a notification of the motion blur re-estimated by the estimation unit. 
 
     
     
       11. The apparatus according to  claim 1 , wherein the setting unit sets the second image capturing parameter based on the first captured images. 
     
     
       12. An apparatus comprising:
 one or more processors; and 
 a memory storing instructions which, when executed by the one or more processors, cause the apparatus to function as: 
 an acquisition unit configured to acquire first captured images obtained by first image capturing with a first image capturing parameter in an image sensor and motion information about an object in the first captured images; 
 a setting unit configured to set a second image capturing parameter; 
 an estimation unit configured to estimate motion blur of an object based on the motion information and the second image capturing parameter; and 
 a notification unit configured to issue a notification of the motion blur, 
 wherein the acquisition unit calculates, for each of the first captured images obtained by a plurality of times of the first image capturing, a motion vector in each of a plurality of regions, segments each of the plurality of regions into a plurality of block regions, and calculates a difference between the first captured images for each of the block regions, and 
 wherein the estimation unit estimates motion blur of the object for each of the block regions from the motion vector and the difference. 
 
     
     
       13. The apparatus according to  claim 12 , wherein the notification unit issues a notification of the motion blur by displaying, in each of the first captured images, an edge region in a discriminable manner for every region in which motion blur in the second captured image has been estimated to have a predetermined amount of blur or more. 
     
     
       14. The apparatus according to  claim 13 , wherein the notification unit switches a threshold value used for determining the edge region according to the motion information. 
     
     
       15. The apparatus according to  claim 14 , wherein the notification unit changes the threshold value used for determining the edge region based on a statistical value calculated from the motion vector. 
     
     
       16. The apparatus according to  claim 15 , wherein the statistical value is calculated from at least a maximum value of magnitude of the motion vector. 
     
     
       17. The apparatus according to  claim 15 , wherein the statistical value is calculated from at least a mode value of magnitude of the motion vector. 
     
     
       18. The apparatus according to  claim 15 , wherein the notification unit changes the threshold value used for determining the edge region based on at least one direction component of the motion vector. 
     
     
       19. The apparatus according to  claim 15 , wherein the notification unit changes the threshold value used for determining the edge region in each of a plurality of regions for each of the first captured images. 
     
     
       20. The apparatus according to  claim 12 , wherein, in a case where a size of each of the plurality of regions in which the motion vector is calculated is a threshold value or more, the estimation unit estimates motion blur of the object for each of the block regions from the motion vector and the difference, and, in a case where the size of each of the plurality of regions in which the motion vector is calculated is smaller than the threshold value, the estimation unit estimates motion blur of the object for each of the plurality of regions from the motion vector. 
     
     
       21. An apparatus which includes an image sensor and which, in a case where an image capturing instruction is issued by an operator while first captured images obtained by first image capturing with a first image capturing parameter in the image sensor is sequentially output, outputs a second captured image obtained by second image capturing with a second image capturing parameter in the image sensor in response to the image capturing instruction, the apparatus comprising:
 one or more processors; and 
 a memory storing instructions which, when executed by the one or more processors, cause the imaging apparatus to function as: 
 a calculation unit configured to calculate motion information based on the first captured images output from the imaging unit; 
 a setting unit configured to set the second image capturing parameter; 
 an estimation unit configured to calculate motion blur based on the motion information and the second image capturing parameter; 
 a notification unit configured to issue a notification of the estimated motion blur prior to receiving the image capturing instruction; and 
 an instruction unit configured to issue the image capturing instruction, 
 wherein the calculation unit calculates a motion vector in each of a plurality of regions, and a difference between the first captured images for each of the block regions. 
 
     
     
       22. An information processing method comprising:
 acquiring first captured images obtained by first image capturing with a first image capturing parameter in an image sensor and motion information about and object in the first captured images; 
 setting a second image capturing parameter independently of the first image capturing parameter; 
 estimating motion blur of an object based on the motion information and the second image capturing parameter; 
 issuing a notification of the motion blur, 
 issuing an imaging capturing instruction while the first captured image obtained by first image capturing with the first image capturing parameter in the image sensor is sequentially output; 
 calculating a motion vector in each of a plurality of regions and a difference between the first captured images for each of the block regions; and 
 outputting the second captured image obtained by second image capturing with the second image capturing parameter in response to the image capturing instruction, 
 wherein the issuing issues the notification of the motion blur prior to receiving the image capturing instruction. 
 
     
     
       23. A method for an apparatus which includes an imaging unit and which, in a case where an image capturing instruction is issued by an operator while first captured images obtained by first image capturing with a first image capturing parameter is sequentially output, outputs a second captured image obtained by second image capturing with a second image capturing parameter in response to the image capturing instruction, the method comprising:
 calculating motion information based on the first captured images output from the imaging unit; 
 setting the second image capturing parameter; 
 estimating motion blur based on the motion information and the second image capturing parameter; 
 issuing a notification of the estimated motion blur prior to receiving the image capturing instruction; 
 calculating a motion vector in each of a plurality of regions and a difference between the first captured images for each of the block regions; and 
 issuing the image capturing instruction. 
 
     
     
       24. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a computer, cause the computer to perform a method comprising:
 acquiring first captured images obtained by first image capturing with a first image capturing parameter in an image sensor and motion information about an object in the first captured images; 
 setting a second image capturing parameter; 
 estimating motion blur of an object based on the motion information and the second image capturing parameter; 
 issuing a notification of the motion blur; 
 issuing an image capturing instruction while the captured image obtained by first image capturing with the first image capturing parameter in the image sensor is sequentially output; and 
 outputting the second captured image obtained by second image capturing with the second image capturing parameter in response to the image capturing instruction; 
 calculating a motion vector in each of a plurality of regions and a difference between the first captured images for each of block regions, 
 wherein the issuing issues the notification of the motion blur prior to receiving the image capturing instruction.