Image processing device and method with image process effect selection based upon flow vector patterns

Abstract

[Object] To select an effect process appropriately according to a feature of an image. [Solution] Provided is an image processing device including a flow vector detection unit configured to detect flow vectors of pixels in an input image, and an effect selection unit configured to select a process of effect to the input image, on the basis of a pattern of the flow vectors.

The invention claimed is: 
     
       1. An image processing device comprising:
 a flow vector detection unit configured to detect flow vectors of pixels in an input image; and 
 an effect selection unit configured to select a process of effect to the input image, on the basis of a pattern of the flow vectors, 
 wherein the pattern of the flow vectors indicates a presence or absence of a vanishing point. 
 
     
     
       2. The image processing device according to  claim 1 , wherein the effect selection unit selects presence or absence of the effect to the input image, as the process of the effect. 
     
     
       3. The image processing device according to  claim 1 , wherein the effect selection unit selects a type of the effect, as the process of the effect. 
     
     
       4. The image processing device according to  claim 1 , wherein
 the effect selection unit selects whether or not to apply zoom effect to the input image, on the basis of the presence or absence of the vanishing point, as the process of the effect. 
 
     
     
       5. The image processing device according to  claim 4 , wherein
 the effect selection unit selects edge preservation zoom as the zoom effect, when the zoom effect is applied to the input image, and when the input image includes a linear edge. 
 
     
     
       6. The image processing device according to  claim 4 , wherein
 the effect selection unit selects edge preservation zoom, as the zoom effect, when the zoom effect is applied to the input image, and when a face is included in the input image. 
 
     
     
       7. The image processing device according to  claim 1 , wherein
 the pattern of the flow vectors is identified by coherency of the flow vectors. 
 
     
     
       8. The image processing device according to  claim 1 , wherein
 the effect selection unit selects a type of the effect to the input image, on the basis of coherency of the flow vectors, as the process of the effect. 
 
     
     
       9. The image processing device according to  claim 7 , wherein
 the effect selection unit selects a type of zoom effect as the effect, on the basis of the coherency. 
 
     
     
       10. The image processing device according to  claim 9 , wherein
 the effect selection unit selects one of walk-through and edge preservation zoom, as the zoom effect, on the basis of a tendency according to a region of the input image, of the coherency. 
 
     
     
       11. The image processing device according to  claim 1 , wherein
 the effect selection unit selects presence or absence of the effect to the input image, on the basis of coherency of the flow vectors, as the process of the effect. 
 
     
     
       12. An image processing device, comprising:
 a flow vector detection unit configured to detect flow vectors of pixels in an input image; and 
 an effect selection unit configured to select a process of effect to the input image, on the basis of a pattern of the flow vectors, 
 wherein the effect selection unit selects a type of the effect to the input image, on the basis of coherency of the flow vectors, as the process of the effect, and 
 the effect selection unit selects a type of art effect as the effect, on the basis of an intensity of the coherency, as the process of the effect. 
 
     
     
       13. The image processing device according to  claim 12 , wherein
 the effect selection unit does not apply the type of the art effect as the effect when the intensity of the coherency is smaller than a threshold value. 
 
     
     
       14. The image processing device according to  claim 12 , wherein
 the effect selection unit applies art effect that expresses brushstrokes to the input image, as the art effect, when the coherency exceeds a predetermined intensity. 
 
     
     
       15. The image processing device according to  claim 14 , wherein
 the effect selection unit applies art effect of a watercolor painting style, as the art effect that expresses the brushstrokes, when a region of a face included in the input image accounts for a predetermined proportion or more of the input image. 
 
     
     
       16. The image processing device according to  claim 14 , wherein
 the effect selection unit applies art effect of an oil painting style, as the art effect that expresses the brushstrokes, when a specific color is dominant in the input image. 
 
     
     
       17. The image processing device according to  claim 12 , wherein
 the effect selection unit does not apply the art effect to the input image, regardless of the intensity of the coherency, when a face included in the input image is smaller than a predetermined size. 
 
     
     
       18. The image processing device according to  claim 12 , wherein
 the effect selection unit applies one of art effect of an illustration style and art effect of a pointillism style, as the art effect, on the basis of a degree of a linear edge included in the input image, when applying the art effect to the input image. 
 
     
     
       19. An image processing method comprising:
 detecting, by a processing circuit of an image processing device, flow vectors of pixels in an input image; and 
 selecting, by the processing circuit of the image processing device, a process of effect to the input image, on the basis of a pattern of the flow vectors, 
 wherein the pattern of the flow vectors indicates a presence or absence of a vanishing point. 
 
     
     
       20. The image processing method according to  claim 19 , wherein
 selecting the process of effect comprises selecting whether or not to apply zoom effect to the input image, on the basis of the presence or absence of the vanishing point, as the process of the effect. 
 
     
     
       21. A non-transitory computer readable medium storing a program, the program being executable by a processing circuit to perform operations comprising:
 detecting flow vectors of pixels in an input image; and 
 selecting a process of effect to the input image, on the basis of a pattern of the flow vectors, 
 wherein the pattern of the flow vectors indicates a presence or absence of a vanishing point. 
 
     
     
       22. The non-transitory computer readable medium according to  claim 21 , wherein
 selecting the process of effect comprises selecting whether or not to apply zoom effect to the input image, on the basis of the presence or absence of the vanishing point, as the process of the effect.