Method and apparatus for in-camera night lapse video

Abstract

A method and apparatus for night lapse video capture are disclosed. The apparatus includes an image sensor, a processor, a denoiser, and an encoder. The image sensor is configured to capture image data. The processor is configured to process the image data using an image processing pipeline. The denoiser is configured to perform denoising based on a motion estimation that is based on a comparison of a portion of the first image and a portion of the second image. The encoder is configured to encode the denoised image in a video format. The encoder is configured to store a video file in the video format.

What is claimed is: 
     
         1 . A method comprising:
 obtaining an image and a reference image;   processing the image and the reference image using an image processing pipeline, wherein processing the image includes:
 converting the image to a YUV image; 
 denoising the YUV image to obtain a denoised image; 
 encoding the denoised image in a video format; and 
 storing a video file in the video format. 
   
     
     
         2 . The method of  claim 1 , wherein the image is a Bayer image, and wherein processing the image includes:
 performing chroma denoising of the YUV image; and   performing a warp correction of the YUV image.   
     
     
         3 . The method of  claim 2 , wherein the reference image is a Bayer reference image, and wherein processing the reference image comprises:
 converting the Bayer reference image to a YUV reference image.   
     
     
         4 . The method of  claim 3 , wherein processing the reference image includes:
 performing chroma denoising of the reference image; and   performing a warp correction of the reference image.   
     
     
         5 . The method of  claim 4 , wherein denoising the YUV image comprises:
 determining a motion estimation based on a comparison of a portion of the image and a portion of the reference image;   obtaining a mask based on the motion estimation; and   subtracting the mask from the image to obtain a denoised image.   
     
     
         6 . The method of  claim 1 , wherein the video file is encoded in an advanced video coding (AVC) format or a high-efficiency video coding (HEVC) format. 
     
     
         7 . The method of  claim 1 , wherein processing the image includes performing local tone mapping of the YUV image to obtain a wide dynamic range (WDR) image. 
     
     
         8 . The method of  claim 7 , wherein obtaining the image includes obtaining the image at multiple exposures. 
     
     
         9 . An image capture device comprising:
 an image sensor configured to obtain an image and a reference image;   a processor configured to process the image and the reference image using an image processing pipeline, the processor configured to convert the reference image to a YUV reference image;   a denoiser circuit configured to denoise the image based on a motion estimation based on a comparison of a portion of the image and a portion of the reference image; and   an encoder circuit configured to:
 encode the denoised image in a video format; and 
 store a video file in the video format. 
   
     
     
         10 . The image capture device of  claim 9 , the processor further configured to:
 convert the image to a YUV image;   perform chroma denoising of the YUV image; and   perform a warp correction of the YUV image.   
     
     
         11 . The image capture device of  claim 10 , the processor further configured to:
 perform chroma denoising of the YUV reference image; and   perform a warp correction of the YUV reference image.   
     
     
         12 . The image capture device of  claim 11 , wherein the denoiser circuit is further configured to:
 obtain a mask based on the motion estimation; and   subtract the mask from the image to obtain a denoised image.   
     
     
         13 . The image capture device of  claim 9 , wherein the video file is encoded in an advanced video coding (AVC) format or a high-efficiency video coding (HEVC) format. 
     
     
         14 . The image capture device of  claim 9 , wherein the processor is further configured to:
 perform local tone mapping of the YUV reference image to obtain a wide dynamic range (WDR) reference image.   
     
     
         15 . The image capture device of  claim 14 , wherein the image sensor is configured to obtain the image at multiple exposures. 
     
     
         16 . An image capture device comprising:
 an image sensor configured to obtain an image and a reference image;   a processor configured to process the image and the reference image using an image processing pipeline, the processor configured to:
 obtain a YUV image; and 
 obtain a YUV reference image; 
   a denoiser circuit configured to denoise the YUV image to obtain a denoised image; and   an encoder circuit configured to:
 encode the denoised image in a video format; and 
 store a video file in the video format. 
   
     
     
         17 . The image capture device of  claim 16 , wherein the encoder circuit is an advanced video coding (AVC) encoder circuit or a high-efficiency video coding (HEVC) encoder circuit. 
     
     
         18 . The image capture device of  claim 16 , wherein the encoder circuit is further configured to select a bitrate prior to an image capture or during the image capture. 
     
     
         19 . The image capture device of  claim 18 , wherein the encoder circuit is further configured to select the bitrate based on a function of ISO or integration time. 
     
     
         20 . The image capture device of  claim 18 , wherein the encoder circuit is further configured to select the bitrate based on a function of a scene classification.