Enhanced video encoding using depth information

Abstract

The invention is directed to systems, methods and computer program products for enhancing video encoding using depth information. An exemplary method comprises: determining, using a computing device, depth information associated with a first object in an image; determining, based on the depth information, that the first object is an object in focus; determining, based on the object in focus, a more important segment of an image; determining a first bit rate for encoding the more important segment of the image; and encoding the more important segment using the first bit rate.

What is claimed is: 
     
       1. A method for encoding an image, the method comprising:
 determining, using a computing device, depth information associated with a first object in an image; 
 determining, based on the depth information, that the first object is an object in focus; 
 determining, based on the object in focus, a more important segment of an image, 
 segmenting the image such that the more important segment comprises a segment in which objects are situated at a distance less than a first threshold distance from the computing device, and a less important segment comprises a segment in which objects are situated at a distance greater than a second threshold distance from the computing device, the second threshold distance being greater than the first threshold distance; 
 determining a first bit rate for encoding the more important segment of the image; and 
 encoding the more important segment using the first bit rate. 
 
     
     
       2. The method of  claim 1 , further comprising:
 determining depth information associated with a second object in the image; 
 determining, based on the depth information associated with the second object in the image, that the second object is not an object in focus; and 
 determining, based on the object not in focus, the less important segment of the image. 
 
     
     
       3. The method of  claim 2 , further comprising:
 determining a second bit rate for encoding the less important segment of the image; and 
 encoding the less important segment using the second bit rate, wherein the second bit rate is less than the first bit rate. 
 
     
     
       4. The method of  claim 3 , wherein an available bit rate is based on the first bit rate and the second bit rate. 
     
     
       5. The method of  claim 2 , wherein a first distance between the first object and the computing device is less than a predetermined distance, and wherein a second distance between the second object and the computing device is equal to or greater than the predetermined distance. 
     
     
       6. The method of  claim 2 , wherein the less important segment is not encoded. 
     
     
       7. The method of  claim 2 , wherein the less important segment comprises a background segment. 
     
     
       8. The method of  claim 2 , further comprising replacing the less important segment with a customized image. 
     
     
       9. The method of  claim 8 , wherein the customized image comprises an advertisement. 
     
     
       10. The method of  claim 1 , wherein the computing device comprises an image-capturing device. 
     
     
       11. The method of  claim 1 , wherein the computing device comprises a mobile phone. 
     
     
       12. The method of  claim 1 , wherein the computing device comprises at least one of a time-of-flight image-capturing device or a stereoscopic image-capturing device. 
     
     
       13. The method of  claim 1 , wherein the image is associated with a video. 
     
     
       14. The method of  claim 1 , wherein the more important segment comprises a foreground segment. 
     
     
       15. The method of  claim 1 , wherein the depth information is determined after the first bit rate is determined. 
     
     
       16. The method of  claim 1 , further comprising generating a three-dimensional representation of the image. 
     
     
       17. The method of  claim 1 , further comprising capturing the image. 
     
     
       18. The method of  claim 17 , wherein at least one of the depth information or the first bit rate is determined either before, during, or after capturing the image. 
     
     
       19. An apparatus for encoding an image, the apparatus comprising:
 a memory; 
 a processor; and 
 a module stored in the memory, executable by the processor, and configured to: 
 determine depth information associated with a first object in an image; 
 determine, based on the depth information, that the first object is an object in focus; 
 determine, based on the object in focus, a more important segment of an image; 
 segment the image such that the more important segment comprises a segment in which objects are situated at a distance less than a first threshold distance from the apparatus, and a less important segment comprises a segment in which objects are situated at a distance greater than a second threshold distance from the apparatus, the second threshold distance being greater than the first threshold distance; 
 determine a first bit rate for encoding the more important segment of the image; and 
 encode the more important segment using the first bit rate. 
 
     
     
       20. A computer program product for encoding an image, the computer program product comprising:
 a non-transitory computer-readable medium comprising a set of codes for causing a computer to: 
 determine depth information associated with a first object in an image; 
 determine, based on the depth information, that the first object is an object in focus; 
 determine, based on the object in focus, a more important segment of an image; 
 segment the image such that the more important segment comprises a segment in which objects are situated at a distance less than a first threshold distance from the computer, and a less important segment comprises a segment in which objects are situated at a distance greater than a second threshold distance from the computer, the second threshold distance being greater than the first threshold distance; 
 determine a first bit rate for encoding the more important segment of the image; and 
 encode the more important segment using the first bit rate.