Method and apparatus for image capture targeting

Abstract

In accordance with an example embodiment of the present invention, a method and corresponding apparatus and computer program are disclosed for: receiving images from an image sensor of a camera unit ( 505 ); monitoring locations of different objects in the received images ( 510 ); determining which if any of the different objects is a primary object that is or should be of interest to a user ( 515 ); and detecting if any primary object becomes occluded by another one of the different objects and responsively to detection of such occlusion triggering a first action ( 520 ).

The invention claimed is: 
     
       1. An apparatus comprising:
 an input for receiving images from an image sensor of a camera unit; 
 a processor configured to: 
 monitor locations of different objects in the received images, wherein the monitoring of locations of different objects involves determining a position of the different objects along an axis extending between the camera unit and the different objects; 
 determine which if any of the different objects is a primary object that is or should be of interest to a user; and 
 detect if any primary object becomes occluded by another one of the different objects and responsively to detection of such occlusion to trigger a first action, 
 wherein the processor is further configured to determine, using the determined position of different objects along the axis extending between the camera unit and the different objects, how much the camera unit should be moved laterally to avoid occlusion of primary objects, and 
 wherein the first action comprises issuing a movement signal indicative of a direction to which, and how much, the camera unit should be moved laterally to avoid the occlusion. 
 
     
     
       2. The apparatus of  claim 1 , wherein the issuing of a movement signal is subject to the determination of how much the camera unit should be moved so that the movement signal is issued only if a movement smaller than a given threshold is determined necessary. 
     
     
       3. The apparatus of  claim 1 , wherein the first action is starting of continuous shooting mode. 
     
     
       4. The apparatus of  claim 3 , wherein the processor is further configured, during the continuous shooting mode, to detect and automatically reject some or all of the images in which the occlusion is present. 
     
     
       5. The apparatus of  claim 1 , wherein the first action is delaying image capture. 
     
     
       6. The apparatus of  claim 5 , wherein the image capture is delayed at most by a given maximum period. 
     
     
       7. The apparatus of  claim 6 , wherein the maximum period is dynamically defined depending on one or more factors. 
     
     
       8. The apparatus of  claim 7 , the factors comprising one or more of the following: relative speed of the occluded primary object and of an occluding object; whether other images have already been taken where the occluded primary object was captured; sharpness of earlier image or images where the presently the occluded primary object was visible; estimated exposure period; whether a flash unit is used and if so, optionally also the possible flash rate of the flash unit. 
     
     
       9. The apparatus of  claim 1 , wherein the apparatus is further configured to receive object information from an auto-focus unit. 
     
     
       10. The apparatus of  claim 1 , wherein the processor is configured to detect different objects in the received images. 
     
     
       11. The apparatus of  claim 10 , wherein for detecting of the different objects, the processor is configured to cause the camera unit to: change focusing over entire or most of available focusing range, take images at different focusing, and determine objects at different distances based on how different parts of the images become focused and/or unfocused while the focusing is changed. 
     
     
       12. The apparatus of  claim 10 , wherein the processor is configured to receive a depth map from the camera unit and use the depth map in determination of the different objects. 
     
     
       13. A method comprising:
 receiving images from an image sensor of a camera unit; 
 monitoring locations of different objects in the received images, wherein the monitoring of locations of different objects involves determining a position of the different objects along an axis extending between the camera unit and the different objects; 
 determining which if any of the different objects is a primary object that is or should be of interest to a user; 
 detecting if any primary object becomes occluded by another one of the different objects and responsively to detecting of such occlusion triggering a first action; and 
 determining, using the determined position of different objects along the axis extending between the camera unit and the different objects, how much the camera unit should be moved laterally to avoid occlusion of primary objects, 
 wherein the first action comprises issuing a movement signal indicative of a direction to which, and how much, the camera unit should be moved laterally to avoid the occlusion. 
 
     
     
       14. The method of  claim 13 , further comprising detecting different objects in the received images. 
     
     
       15. The method of  claim 14 , wherein for detecting of the different objects, cause the camera unit to: change focusing over entire or most of available focusing range, take images at different focusing, and determine objects at different distances based on how different parts of the images become focused and/or unfocused while the focusing is changed. 
     
     
       16. The method of  claim 14 , further comprising receiving a depth map from the camera unit and using the depth map in the detecting of the different objects. 
     
     
       17. The apparatus of  claim 9 , wherein the object information comprises depth information, and wherein the processor is configured to use the received object information as a basis for the monitoring of locations of different objects in the received images. 
     
     
       18. The apparatus of  claim 1 , wherein the monitoring of locations of different objects comprises determining a position of the different objects in a lateral direction. 
     
     
       19. The apparatus of  claim 1 , wherein the processor is configured to determine depth of an object by face detection and by calculating a scale of at least one facial feature in an image.