Processing Media By Adaptive Group of Pictures Structuring

Abstract

A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

1 . A method comprising:
 determining, based at least on a spatial feature value associated with a first frame of a plurality of frames of content, a first Group of Picture (GOP) size for a first group of frames of the plurality of frames, wherein the first group of frames comprises the first frame;   determining, based on determining that a second frame of the plurality of frames is associated with a different spatial feature value than the first frame, a second GOP size for a second group of frames of the plurality of frames, wherein the second group of frames comprises the second frame, and wherein the second GOP size is different from the first GOP size; and   encoding the first group of frames using the first GOP size and encoding the second group of frames using the second GOP size.   
     
     
         2 . The method of  claim 1 , further comprising:
 determining the spatial feature value associated with the first frame; and   determining the different spatial feature value associated with the second frame.   
     
     
         3 . The method of  claim 2 , wherein determining the spatial feature value associated with the first frame comprises performing one or more pre-processing operations on the first frame, and wherein determining the different spatial feature value associated with the second frame comprises performing the one or more pre-processing operations on the second frame. 
     
     
         4 . The method of  claim 2 , wherein determining the spatial feature value associated with at least the first frame comprises at least one of applying a Fast Discrete Cosine Transform (Fast DCT) to the first frame or applying one or more filters to the first frame, and
 wherein determining the different spatial feature value associated with at least the second frame comprises at least one of applying a Fast DCT to the second frame or applying one or more filters to the second frame.   
     
     
         5 . The method of  claim 4 , wherein the one or more filters comprises at least one of an edge detection filter or a high pass filter. 
     
     
         6 . The method of  claim 1 , further comprising:
 determining, based at least on the spatial feature value associated with the first frame, a hierarchical structure associated with the first group of frames; and   determining, based at least on the different spatial feature value associated with the second frame, a hierarchical structure associated with the second group of frames.   
     
     
         7 . The method of  claim 1 , further comprising:
 determining, based at least on the spatial feature value associated with the first frame, at least one mini-GOP and at least one mini-GOP size for the first group of frames,   wherein encoding the first group of frames using the first GOP size comprises encoding the first group of frames based on the at least one mini-GOP size.   
     
     
         8 . The method of  claim 7 , wherein the first group of frames begins with an I-frame and ends at a frame immediately preceding another I-frame, and wherein the at least one mini-GOP begins with a P-frame. 
     
     
         9 . The method of  claim 1 , wherein the spatial feature value indicates a spatial complexity associated with the first frame, and wherein the different spatial feature value indicates a different spatial complexity associated with the second frame. 
     
     
         10 . The method of  claim 1 , wherein the spatial feature value indicates an amount of high frequency information in the first frame, and wherein the different spatial feature value indicates a different amount of high frequency information in the second frame. 
     
     
         11 . A device comprising:
 one or more processors; and   memory storing instructions that, when executed by the one or more processors, cause the device to:   determine, based at least on a spatial feature value associated with a first frame of a plurality of frames of content, a first Group of Picture (GOP) size for a first group of frames of the plurality of frames, wherein the first group of frames comprises the first frame;   determine, based on determining that a second frame of the plurality of frames is associated with a different spatial feature value than the first frame, a second GOP size for a second group of frames of the plurality of frames, wherein the second group of frames comprises the second frame, and wherein the second GOP size is different from the first GOP size; and   encode the first group of frames using the first GOP size and encoding the second group of frames using the second GOP size.   
     
     
         12 . The device of  claim 11 , wherein the instructions, when executed by the one or more processors, further cause the device to:
 determine the spatial feature value associated with the first frame; and   determine the different spatial feature value associated with the second frame.   
     
     
         13 . The device of  claim 12 , wherein the instructions that, when executed by the one or more processors, cause the device to determine the spatial feature value associated with the first frame comprise instructions that, when executed by the one or more processors, further cause the device to perform one or more pre-processing operations on the first frame, and
 wherein the instructions that, when executed by the one or more processors, cause the device to determine the different spatial feature value associated with the second frame comprise instructions that, when executed by the one or more processors, further cause the device to perform one or more pre-processing operations on the second frame.   
     
     
         14 . The device of  claim 12 , wherein the instructions that, when executed by the one or more processors, cause the device to determine the spatial feature value associated with at least the first frame comprise instructions that, when executed by the one or more processors, cause the device to at least one of apply a Fast Discrete Cosine Transform (Fast DCT) to the first frame or apply one or more filters to the first frame, and
 wherein the instructions that, when executed by the one or more processors, cause the device to determine the different spatial feature value associated with at least the second frame comprise instructions that, when executed by the one or more processors, cause the device to at least one of apply a Fast DCT to the second frame or apply one or more filters to the second frame.   
     
     
         15 . The device of  claim 14 , wherein the one or more filters comprises at least one of an edge detection filter or a high pass filter. 
     
     
         16 . The device of  claim 11 , wherein the instructions, when executed by the one or more processors, further cause the device to:
 determine, based at least on the spatial feature value associated with the first frame, a hierarchical structure associated with the first group of frames; and   determine, based at least on the different spatial feature value associated with the second frame, a hierarchical structure associated with the second group of frames.   
     
     
         17 . The device of  claim 11 , wherein the instructions, when executed by the one or more processors, further cause the device to:
 determine, based at least on the spatial feature value associated with the first frame, at least one mini-GOP and at least one mini-GOP size for the first group of frames,   wherein encoding the first group of frames using the first GOP size comprises encoding the first group of frames based on the at least one mini-GOP size.   
     
     
         18 . The device of  claim 17 , wherein the first group of frames begins with an I-frame and ends at a frame immediately preceding another I-frame, and wherein the at least one mini-GOP begins with a P-frame. 
     
     
         19 . The device of  claim 11 , wherein the spatial feature value indicates a spatial complexity associated with the first frame, and wherein the different spatial feature value indicates a different spatial complexity associated with the second frame. 
     
     
         20 . The device of  claim 11 , wherein the spatial feature value indicates an amount of high frequency information in the first frame, and wherein the different spatial feature value indicates a different amount of high frequency information in the second frame. 
     
     
         21 . A computer-readable medium storing instructions that, when executed, cause:
 determining, based at least on a spatial feature value associated with a first frame of a plurality of frames of content, a first Group of Picture (GOP) size for a first group of frames of the plurality of frames, wherein the first group of frames comprises the first frame;   determining, based on determining that a second frame of the plurality of frames is associated with a different spatial feature value than the first frame, a second GOP size for a second group of frames of the plurality of frames, wherein the second group of frames comprises the second frame, and wherein the second GOP size is different from the first GOP size; and   encoding the first group of frames using the first GOP size and encoding the second group of frames using the second GOP size.   
     
     
         22 . The computer-readable medium of  claim 21 , wherein the instructions, when executed, further cause:
 determining the spatial feature value associated with the first frame; and   determining the different spatial feature value associated with the second frame.   
     
     
         23 . The computer-readable medium of  claim 22 , wherein determining the spatial feature value associated with the first frame comprises performing one or more pre-processing operations on the first frame, and wherein determining the different spatial feature value associated with the second frame comprises performing the one or more pre-processing operations on the second frame. 
     
     
         24 . The computer-readable medium of  claim 22 , wherein determining the spatial feature value associated with at least the first frame comprises at least one of applying a Fast Discrete Cosine Transform (Fast DCT) to the first frame or applying one or more filters to the first frame, and
 wherein determining the different spatial feature value associated with at least the second frame comprises at least one of applying a Fast DCT to the second frame or applying one or more filters to the second frame.   
     
     
         25 . The computer-readable medium of  claim 24 , wherein the one or more filters comprises at least one of an edge detection filter or a high pass filter. 
     
     
         26 . The computer-readable medium of  claim 21 , wherein the instructions, when executed, further cause:
 determining, based at least on the spatial feature value associated with the first frame, a hierarchical structure associated with the first group of frames; and   determining, based at least on the different spatial feature value associated with the second frame, a hierarchical structure associated with the second group of frames.   
     
     
         27 . The computer-readable medium of  claim 21 , wherein the instructions, when executed, further cause:
 determining, based at least on the spatial feature value associated with the first frame, at least one mini-GOP and at least one mini-GOP size for the first group of frames,   wherein encoding the first group of frames using the first GOP size comprises encoding the first group of frames based on the at least one mini-GOP size.   
     
     
         28 . The computer-readable medium of  claim 27 , wherein the first group of frames begins with an I-frame and ends at a frame immediately preceding another I-frame, and wherein the at least one mini-GOP begins with a P-frame. 
     
     
         29 . The computer-readable medium of  claim 21 , wherein the spatial feature value indicates a spatial complexity associated with the first frame, and wherein the different spatial feature value indicates a different spatial complexity associated with the second frame. 
     
     
         30 . The computer-readable medium of  claim 21 , wherein the spatial feature value indicates an amount of high frequency information in the first frame, and wherein the different spatial feature value indicates a different amount of high frequency information in the second frame. 
     
     
         31 . A system comprising:
 a computing device configured to:
 determine, based at least on a spatial feature value associated with a first frame of a plurality of frames of content, a first Group of Picture (GOP) size for a first group of frames of the plurality of frames, wherein the first group of frames comprises the first frame; 
 determine, based on determining that a second frame of the plurality of frames is associated with a different spatial feature value than the first frame, a second GOP size for a second group of frames of the plurality of frames, wherein the second group of frames comprises the second frame, and wherein the second GOP size is different from the first GOP size; and 
 encode the first group of frames using the first GOP size and encoding the second group of frames using the second GOP size; and 
   an output device configured to decode the encoded first group of frames and the encoded second group of frames.   
     
     
         32 . The system of  claim 31 , wherein the computing device is further configured to:
 determine the spatial feature value associated with the first frame; and   determine the different spatial feature value associated with the second frame.   
     
     
         33 . The system of  claim 32 , wherein determining the spatial feature value associated with the first frame comprises performing one or more pre-processing operations on the first frame, and wherein determining the different spatial feature value associated with the second frame comprises performing the one or more pre-processing operations on the second frame. 
     
     
         34 . The system of  claim 32 , wherein determining the spatial feature value associated with at least the first frame comprises at least one of applying a Fast Discrete Cosine Transform (Fast DCT) to the first frame or applying one or more filters to the first frame, and
 wherein determining the different spatial feature value associated with at least the second frame comprises at least one of applying a Fast DCT to the second frame or applying one or more filters to the second frame.   
     
     
         35 . The system of  claim 34 , wherein the one or more filters comprises at least one of an edge detection filter or a high pass filter. 
     
     
         36 . The system of  claim 31 , wherein the computing device is further configured to:
 determine, based at least on the spatial feature value associated with the first frame, a hierarchical structure associated with the first group of frames; and   determine, based at least on the different spatial feature value associated with the second frame, a hierarchical structure associated with the second group of frames.   
     
     
         37 . The system of  claim 31 , wherein the computing device is further configured to:
 determine, based at least on the spatial feature value associated with the first frame, at least one mini-GOP and at least one mini-GOP size for the first group of frames,   wherein encoding the first group of frames using the first GOP size comprises encoding the first group of frames based on the at least one mini-GOP size.   
     
     
         38 . The system of  claim 37 , wherein the first group of frames begins with an I-frame and ends at a frame immediately preceding another I-frame, and wherein the at least one mini-GOP begins with a P-frame. 
     
     
         39 . The system of  claim 31 , wherein the spatial feature value indicates a spatial complexity associated with the first frame, and wherein the different spatial feature value indicates a different spatial complexity associated with the second frame. 
     
     
         40 . The system of  claim 31 , wherein the spatial feature value indicates an amount of high frequency information in the first frame, and wherein the different spatial feature value indicates a different amount of high frequency information in the second frame.