Image processing apparatus, method therefor, and storage medium

Abstract

An image processing apparatus includes a skin area detection unit configured to detect a skin area of an object person, a difference area detection unit configured to detect a difference area between the visible light image and the infrared light image, a correction target area detection unit configured to detect a correction target area of the object person based on the skin area detected by the skin area detection unit and the difference area detected by the difference area detection unit, and a correction unit configured to correct the correction target area in the visible light image.

What is claimed is: 
     
       1. An image processing apparatus which executes image processing by using a visible light image and an infrared light image, the apparatus comprising:
 at least one processor or circuit configured to function as: 
 a skin area detection unit configured to detect a skin area of an object person; 
 a difference area detection unit configured to detect a difference area between the visible light image and the infrared light image; 
 a correction target area detection unit configured to detect a correction target area of the object person based on the skin area detected by the skin area detection unit and the difference area detected by the difference area detection unit; and 
 a correction unit configured to correct the correction target area in the visible light image. 
 
     
     
       2. The image processing apparatus according to  claim 1 , wherein the correction unit corrects a luminance component of the visible light image in the correction target area by using the infrared light image to generate a new luminance component, and combines the new luminance component with a color difference component of the visible light image. 
     
     
       3. The image processing apparatus according to  claim 1 , wherein the correction unit corrects a luminance component of the visible light image in the correction target area by using a luminance component of a peripheral pixel in the correction target area to generate a new luminance component, and combines the new luminance component with a color difference component of the visible light image. 
     
     
       4. The image processing apparatus according to  claim 1 , wherein the at least one processor or circuit is further is configured to function as a brightness correction unit configured to correct brightness of at least either one of the visible light image and the infrared light image,
 wherein the difference area detection unit detects a difference area between the visible light image and the infrared light image, the brightness of which has been corrected by the brightness correction unit. 
 
     
     
       5. The image processing apparatus according to  claim 1 , wherein the visible light image and the infrared light image are acquired by a same image sensor. 
     
     
       6. The image processing apparatus according to  claim 1 , wherein the visible light image and the infrared light image are acquired through imaging with irradiation of infrared light. 
     
     
       7. The image processing apparatus according to  claim 1 , wherein the skin area detection unit detects only the skin area in a range excluding an organ area in a face range of the object person. 
     
     
       8. The image processing apparatus according to  claim 1 , wherein the correction target area detection unit restricts a size of a detection area when the correction target area is detected. 
     
     
       9. The image processing apparatus according to  claim 1 , wherein the skin area detection unit uses the visible light image to detect a skin area of the object person. 
     
     
       10. The image processing apparatus according to  claim 1 , wherein the skin area detection unit calculates a difference between an image acquired by an imaging apparatus through imaging with irradiation of infrared light and an image acquired by imaging without irradiation of infrared light, and detects the skin area from the difference of the images based on a relationship between a distance from the object person to the imaging apparatus, and spectral reflectance in a wavelength of infrared light. 
     
     
       11. The image processing apparatus according to  claim 4 , wherein the brightness correction unit equalizes the brightness between the visible light image and the infrared light image. 
     
     
       12. An imaging apparatus comprising:
 an imaging unit configured to capture a visible light image and an infrared light image; and 
 an image processing apparatus which executes image processing by using a visible light image and an infrared light image, the image processing apparatus comprising: 
 at least one processor or circuit configured to function as: 
 a skin area detection unit configured to detect a skin area of an object person; 
 a difference area detection unit configured to detect a difference area between the visible light image and the infrared light image; 
 a correction target area detection unit configured to detect a correction target area of the object person based on the skin area detected by the skin area detection unit and the difference area detected by the difference area detection unit; and 
 a correction unit configured to correct the correction target area in the visible light image. 
 
     
     
       13. An image processing method for executing image processing by using a visible light image and an infrared light image, the method comprising:
 detecting a skin area of an object person; 
 detecting a difference area between the visible light image and the infrared light image; 
 detecting a correction target area of the object person based on the detected skin area and the detected difference area; and 
 correcting the correction target area in the visible light image. 
 
     
     
       14. A non-transitory computer-readable storage medium storing a program for causing a computer to execute following operations of image processing using a visible light image and an infrared light image, the operations comprising:
 detecting a skin area of an object person; 
 detecting a difference area between the visible light image and the infrared light image; 
 detecting a correction target area of the object person based on the detected skin area and the detected difference area; and 
 correcting the correction target area in the visible light image.