Image Enhancement Based on Combining Images from a Single Camera

Abstract

Provided are systems and methods for image enhancement based on combining multiple related images, such as images of the same object taken from different imaging angles. This approach allows simulating images captured from longer distances using telephoto lenses. Initial images may be captured using a simple camera equipped with shorter focal length lenses, typically used on camera phones, tablets, and laptops. The initial images may be taken using a single camera. An object or, more specifically, a center line of the object is identified in each image. The object is typically present in the foreground portion of the initial images. The initial images may be cross-faded along the object center line to yield a combined image. Separating of the foreground and background portions of each image may be separated and separately processed, such as blurring the background portion and sharpening the foreground portion.

What is claimed is: 
     
         1 . A method of combining multiple related images to enhance image quality, the method comprising:
 receiving at least two initial images captured using a single camera provided on one device;
 each of the at least two initial images comprising an object representation of an object, 
 the object representation provided on a foreground portion of each of the at least two initial images; and 
 each of the at least two initial images corresponding to a different imaging angle relative to the object; 
   detecting the object in each of the at least two initial images;   determining an object center line of the object in each of the at least two initial images; and   cross-fading the at least two initial images along the object center line,
 wherein the cross-fading yields a combined image. 
   
     
     
         2 . The method of  claim 1 , wherein the object comprises at least a face of a user. 
     
     
         3 . The method of  claim 2 , wherein, for each of the at least two initial images, the single camera is positioned at at least one of a different distance and a different angle relative to the face of the user. 
     
     
         4 . The method of  claim 3 , wherein the device is one of a camera phone or a tablet computer system. 
     
     
         5 . The method of  claim 1 , wherein the two initial images are stereo images, and the detecting comprises analyzing the stereo disparity of the stereo image. 
     
     
         6 . The method of  claim 1 , wherein the detecting further comprises face detection. 
     
     
         7 . The method of  claim 1 , wherein the detecting the object comprises one or more techniques selected from the group consisting of motion parallax, local focus, color grouping, and face detection. 
     
     
         8 . The method of  claim 1 , wherein the detecting the object comprises face detection. 
     
     
         9 . The method of  claim 1 , wherein the combined image comprises a combined foreground portion and a combined background portion, the combined foreground portion comprises a combined object created by cross-fading the objects of the at least two initial images. 
     
     
         10 . The method of  claim 10 , further comprising changing one or more properties of the combined foreground portion, the one or more properties are selected from the group consisting of changing sharpness, changing color, suppressing, and changing saturation. 
     
     
         11 . The method of  claim 10 , further comprising changing one or more properties of the combined background portion, the one or more properties are selected from the group consisting of changing sharpness, changing color, suppressing, and changing saturation. 
     
     
         12 . The method of  claim 11 , wherein the combined background portion is blurred using one or more blurring techniques including at least one of circular blurring and Gaussian blurring. 
     
     
         13 . The method of  claim 12 , wherein the combined background portion is blurred adaptively. 
     
     
         14 . The method of  claim 9 , wherein the combined background portion is replaced with a new background image. 
     
     
         15 . The method of  claim 1 , further comprising:
 determining the foreground portion of each of the at least two initial images;   separating the foreground portion from a background portion of each of the at least two initial images;   wherein the cross-fading the at least two initial images comprises:
 cross-fading the foreground portions of the at least two initial images; and 
 independently, cross-fading the background portions of the at least two initial images. 
   
     
     
         16 . The method of  claim 15 , wherein the cross-fading the background portions of the two initial images comprises shifting at least some of the background portions in a direction towards the object center line. 
     
     
         17 . The method of  claim 1 , further comprises repeating the receiving, determining, aligning, and cross-fading operations at least once. 
     
     
         18 . The method of  claim 1 , wherein the least two initial images represent at least two different frames of a video. 
     
     
         19 . A system for combining multiple related images to enhance image quality, the system comprising:
 at least one processor; and   a memory communicatively coupled with the at least one processor, the memory storing instructions, which when executed by the at least processor performs a method comprising:
 receiving at least two initial images captured using a single camera provided on one device;
 each of the at least two initial images comprising an object representation of an object, 
 the object representation provided on a foreground portion of each of the at least two initial images; and 
 each of the at least two initial images corresponding to a different imaging angle relative to the object; 
 
 detecting the object in each of the at least two initial images; 
 determining an object center line of the object in each of the at least two initial images; and 
 cross-fading the at least two initial images along the object center line, wherein the cross-fading yields a combined image. 
   
     
     
         20 . A non-transitory computer-readable storage medium having embodied thereon instructions, which when executed by at least one processor, perform steps of a method, the method comprising:
 receiving at least two initial images captured using a single camera provided on one device;
 each of the at least two initial images comprising an object representation of an object, 
 the object representation provided on a foreground portion of each of the at least two initial images; and 
 each of the at least two initial images corresponding to a different imaging angle relative to the object; 
   detecting the object in each of the at least two initial images;   determining an object center line of the object in each of the at least two initial images; and   cross-fading the at least two initial images along the object center line, wherein the cross-fading yields a combined image.