Method of sensor-assisted rate control

Abstract

Methods and systems of determining a quantization step for encoding video based on motion data are provided. Video captured by an image capture device is received. The video comprises a video frame component. Additionally, motion data associated with the video frame component is received. Further, a quantization step for encoding the video frame component is determined based on the motion data.

1 - 20 . (canceled) 
     
     
         21 . A method of determining a quantization step for encoding video based on motion data, said method comprising:
 receiving video captured by an image capture device, the video comprising a video frame component, the video frame component including a video frame;   receiving motion data associated with the video frame component, the motion data including a degree of movement; and   determining a quantization step for encoding the video frame component based on the motion data; including:
 in response to the degree of movement exceeding a threshold degree of movement, choosing a first quantization step for encoding the video frame; and 
 in response to the degree of movement not exceeding the threshold degree of movement, choosing a second quantization step for encoding the video frame, the second quantization step being less than the first quantization step. 
   
     
     
         22 . The method of  claim 21 , wherein the image capture device is installed on an unmanned aerial vehicle (UAV), and wherein the step of capturing the video occurs while the UAV is in flight. 
     
     
         23 . The method of  claim 22 , wherein the motion data is obtained using one or more sensors on-board the UAV. 
     
     
         24 . The method of  claim 23 , wherein the image capture device is carried by the gimbal configured on the UAV, and the motion data obtained by the one or more sensors includes rotation motion data indicating rotation about one or more of: a yaw axis, a pitch, or a roll axis of the video capture device. 
     
     
         25 . The method of  claim 24 , wherein the one or more sensors are configured on the gimbal. 
     
     
         26 . The method of  claim 24 , wherein the one or more sensors are configured off-board the gimbal. 
     
     
         27 . The method of  claim 21 , wherein the motion data includes optical flow field data that demonstrates how light flows within the video frame component. 
     
     
         28 . The method of  claim 25 , wherein the optical flow field data is generated with aid of an optical flow field generator based on data obtained using one or more sensors on-board the UAV. 
     
     
         29 . The method of  claim 28 , wherein the image capture device is on-board a UAV, and wherein (1) the optical flow field data is generated, or (2) the quantization step for encoding the video frame component is determined, while the UAV is in flight. 
     
     
         30 . The method of  claim 21 , further comprising encoding the video frame component based on the determined quantization step for encoding the video frame component. 
     
     
         31 . A non-transitory computer readable medium containing program instructions for determining a quantization step for encoding video based on motion data, said computer readable medium comprising:
 program instructions for receiving video captured by an image capture device, the video comprising a video frame component, the video frame component including a video frame;   program instructions for receiving motion data associated with the video frame component, the motion data including a degree of movement; and   program instructions for determining a quantization step for encoding the video frame component based on the motion data, determining the quantization step including:
 in response to the degree of movement exceeding a threshold degree of movement, choosing a first quantization step for encoding the video frame; and 
 in response to the degree of movement not exceeding the threshold degree of movement, choosing a second quantization step for encoding the video frame, the second quantization step being less than the first quantization step. 
   
     
     
         32 . The computer readable medium of  claim 31 , wherein the image capture device is installed on an unmanned aerial vehicle (UAV), and wherein the program instructions for receiving the video are executed while the UAV is in flight. 
     
     
         33 . The computer readable medium of  claim 32 , wherein the program instructions for determining the quantization step for encoding the video frame component based on the motion data are executed while the UAV is in flight. 
     
     
         34 . The computer readable medium of  claim 32 , wherein the motion data is obtained using one or more sensors on-board the UAV. 
     
     
         35 . The computer readable medium of  claim 34 , wherein the image capture device is carried by the gimbal configured on the UAV, and the motion data obtained by the one or more sensors includes rotation motion data indicating rotation about one or more of: a yaw axis, a pitch, or a roll axis of the video capture device. 
     
     
         36 . The computer readable medium of  claim 31 , wherein the motion data includes optical flow field data that demonstrates how light flows within the video frame component. 
     
     
         37 . The computer readable medium of  claim 31 , further comprising program instructions for encoding the video frame component based on the determined quantization step for encoding the video frame component. 
     
     
         38 . A system for determining a quantization step for encoding video based on motion data, said system comprising:
 an image capture device configured to capture a video; and   one or more processors, individually or collectively configured to:
 receive the video captured by the image capture device, the video comprising a video frame component, the video frame component including a video frame; 
 receive motion data associated with the video frame component, the motion data including a degree of movement; and 
   determine a quantization step for encoding the video frame component based on the motion data, including:
 in response to the degree of movement exceeding a threshold degree of movement, choosing a first quantization step for encoding the video frame; and 
 in response to the degree of movement not exceeding the threshold degree of movement, choosing a second quantization step for encoding the video frame, the second quantization step being less than the first quantization step. 
   
     
     
         39 . The system of  claim 38 , wherein the image capture device is installed on an unmanned aerial vehicle (UAV), and wherein the motion data is obtained using one or more sensors, wherein the one or more sensors include one or more of the following: optical sensor, ultrasonic sensor, MVO, gyroscope, GPS, altimeter. 
     
     
         40 . The system of  claim 39 , wherein the one or more processors are on-board the UAV.