Video stabilization

Abstract

Method, device and computer program product for stabilizing a video signal. In one embodiment, a plurality of frames of a video signal are captured using a camera. A first motion of the camera is determined, with the first motion exclusive of second motion occurring while the shutter is open. Pixel displacement between first and second frames of the video signal is determined based on the determined first motion. An image of at least one of the first and second frames is shifted in accordance with the pixel displacement.

1 . A method of stabilizing a video signal, the method comprising:
 capturing a plurality of frames of the video signal using a camera;   determining first motion of the camera, the determined first motion exclusive of second motion occurring while the shutter is open;   determining a pixel displacement between first and second frames of the video signal based on the determined first motion; and   shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal.   
     
     
         2 . The method of  claim 1  further comprising:
 generating a plurality of samples from a motion sensor representing the first motion; and 
 determining a displacement of the camera between the first frame of the video signal and the second frame of the video signal based on the plurality of samples, wherein the determining of the pixel displacement is based on the determined displacement of the camera. 
 
     
     
         3 . The method of  claim 2 , further comprising determining rotational motion of the camera based on the samples from the motion sensor, and wherein the determining of the displacement of the camera determines an angular displacement of the camera. 
     
     
         4 . The method of  claim 1 , the operations further comprising:
 determining a pixel displacement between the first frame and the second frame;   determining an accumulated pixel displacement based on the pixel displacement between the first frame and the second frame;   determining a filtered accumulated pixel displacement based on a weighted sum of the determined accumulated pixel displacement and a filtered accumulated pixel displacement for the first frame, and   wherein the shifting of the image is in accordance with the filtered accumulated pixel displacement.   
     
     
         5 . The method of  claim 1 , wherein the image comprises a stride value indicating memory space of the image, a plurality of pixel values, a pointer indicating a position of a first pixel of the image, and a width value indicating a width of the image, wherein said shifting of the image comprises adjusting the pointer and the width value without adjusting the stride value. 
     
     
         6 . The method of  claim 1  wherein the image comprises a plurality of image planes which are each represented by a respective plurality of pixel values, a respective pointer indicating the position of a first pixel of the image plane, and a respective width value indicating the width of the image plane, wherein the image planes are shifted together by adjusting their respective pointers and width values without adjusting the stride value. 
     
     
         7 . The method of  claim 1  further comprising rounding the determined pixel displacement to an integer-pixel displacement. 
     
     
         8 . A computer program product for stabilizing a video signal, the computer program product being embodied on a computer-readable medium comprising instructions that when executed by a hardware processor of a device configure the hardware processor to perform operations comprising:
 capturing a plurality of frames of the video signal using a camera;   determining first motion of the camera, the determined first motion exclusive of second motion occurring while a shutter of the camera is open;   determining a pixel displacement between first and second frames of the video signal based on the determined first motion; and   shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal.   
     
     
         9 . The computer program product of  claim 8 , the operations further comprising:
 generating a plurality of samples from a motion sensor representing the first motion; and   determining a displacement of the camera between the first frame of the video signal and the second frame of the video signal based on the plurality of samples, wherein the determining of the pixel displacement is based on the determined displacement of the camera.   
     
     
         10 . The computer program product of  claim 9 , the operations further comprising determining rotational motion of the camera based on the samples from the motion sensor, and wherein the determining of the displacement of the camera determines an angular displacement of the camera. 
     
     
         11 . The computer program product of  claim 8 , the operations further comprising
 determining a pixel displacement between the first frame and the second frame;   determining an accumulated pixel displacement based on the pixel displacement between the first frame and the second frame;   determining a filtered accumulated pixel displacement based on a weighted sum of the determined accumulated pixel displacement and a filtered accumulated pixel displacement for the first frame, and   wherein the shifting of the image is in accordance with the filtered accumulated pixel displacement.   
     
     
         12 . The computer program product of  claim 8 , wherein the image comprises a stride value indicating memory space of the image, a plurality of pixel values, a pointer indicating a position of a first pixel of the image, and a width value indicating a width of the image, wherein said shifting of the image comprises adjusting the pointer and the width value without adjusting the stride value. 
     
     
         13 . The computer program product of  claim 8 , wherein the image comprises a plurality of image planes which are each represented by a respective plurality of pixel values, a respective pointer indicating the position of a first pixel of the image plane, and a respective width value indicating the width of the image plane, wherein the image planes are shifted together by adjusting their respective pointers and width values without adjusting the stride value. 
     
     
         14 . The computer program product of  claim 8 , further comprising rounding the determined pixel displacement to an integer-pixel displacement. 
     
     
         15 . A device configured to stabilize a video signal, the device comprising:
 a camera configured to capture a plurality of frames of the video signal;   hardware processing circuitry configured to perform operations comprising:   capturing a plurality of frames of the video signal using a camera;   determining first motion of the camera, the determined first motion exclusive of second motion occurring while a shutter of the camera is open;   determining a pixel displacement between first and second frames of the video signal based on the determined first motion; and   shifting an image of at least one of the first and second frames in accordance with the pixel displacement to thereby stabilize the video signal.   
     
     
         16 . The device of  claim 15 , further comprising a motion sensor, the operations further comprising:
 generating a plurality of samples from the motion sensor representing the first motion; and   determining a displacement of the camera between the first frame of the video signal and the second frame of the video signal based on the plurality of samples, wherein the determining of the pixel displacement is based on the determined displacement of the camera.   
     
     
         17 . The device of  claim 16 , the operations further comprising determining rotational motion of the camera based on the samples from the motion sensor, and wherein the determining of the displacement of the camera determines an angular displacement of the camera. 
     
     
         18 . The device of  claim 15 , the operation further comprising
 determining a pixel displacement between the first frame and the second frame;   determining an accumulated pixel displacement based on the pixel displacement between the first frame and the second frame;   determining a filtered accumulated pixel displacement based on a weighted sum of the determined accumulated pixel displacement and a filtered accumulated pixel displacement for the first frame, and   wherein the shifting of the image is in accordance with the filtered accumulated pixel displacement.   
     
     
         19 . The device of  claim 15 , wherein the image comprises a stride value indicating memory space of the image, a plurality of pixel values, a pointer indicating a position of a first pixel of the image, and a width value indicating a width of the image, wherein said shifting of the image comprises adjusting the pointer and the width value without adjusting the stride value. 
     
     
         20 . The device of  claim 15 , wherein the image comprises a plurality of image planes which are each represented by a respective plurality of pixel values, a respective pointer indicating the position of a first pixel of the image plane, and a respective width value indicating the width of the image plane, wherein the image planes are shifted together by adjusting their respective pointers and width values without adjusting the stride value.