Content adaptive impairments compensation filtering for high efficiency video coding

Abstract

A system and method for quality restoration filtering is described that can be used either in conjunction with video coding, or standalone for postprocessing. It uses wiener filtering approach in conjunction with an efficient codebook representation.

1 - 48 . (canceled) 
     
     
         49 . A system comprising:
 memory to store at least a portion of a codebook corresponding to a plurality of sets of loop filter coefficients for a loop filter;   an interface to receive encoded video data including a syntax to enable selection of a set of loop filter coefficients based on the codebook; and   a processor to decode the encoded video data, wherein to decode the encoded video data, the processor is to:
 decode at least a portion of the encoded video data into at least a block of quantized coefficients, 
 generate a residual block based on application of an inverse quantization and an inverse transform to the block of quantized coefficients, 
 add, to the residual block, a loop filtering compensated prediction block from a motion compensation predictor to form a decoded video block, 
 select, based on the codebook, the set of loop filter coefficients based on the syntax, 
 process at least a portion of a plurality of decoded blocks including the decoded block based on implementation of the selected loop filter coefficients by the loop filter, and 
 generate decoded video data based on the plurality of decoded blocks. 
   
     
     
         50 . The system of  claim 49 , wherein the encoded video data further comprises an indicator to indicate the codebook is to be used for loop filtering at least the portion of the decoded blocks. 
     
     
         51 . The system of  claim 49 , wherein the encoded video data further comprises an indicator to indicate the codebook is not to be used for loop filtering at least a second portion of the encoded video data. 
     
     
         52 . The system of  claim 49 , wherein the system comprises one of a computer, a set-top box, a phone, a handheld device, or a gaming console. 
     
     
         53 . The system of  claim 49 , wherein the processor comprises a filtering processor. 
     
     
         54 . The system of  claim 49 , the processor further to select, based on the codebook and the syntax, a second set of loop filter coefficients and to process at least a second portion of a second plurality of decoded blocks based on implementation of the second selected loop filter coefficients by the loop filter. 
     
     
         55 . The system of  claim 49 , wherein the encoded video data further comprises update data to update a second portion of the codebook based on the update data. 
     
     
         56 . A method for decoding video comprising:
 receiving at least a portion of a codebook corresponding to a plurality of sets of loop filter coefficients for a loop filter;   receiving encoded video data including a syntax to enable selection of a set of loop filter coefficients based on the codebook;   decoding at least a portion of the encoded video data into at least a block of quantized coefficients;   generating a residual block based on application of an inverse quantization and an inverse transform to the block of quantized coefficients;   adding, to the residual block, a loop filtering compensated prediction block from a motion compensation predictor to form a decoded video block;   selecting, based on the codebook, the set of loop filter coefficients based on the syntax;   processing at least a portion of a plurality of decoded blocks including the decoded block based on implementation of the selected loop filter coefficients by the loop filter; and   generating decoded video data based on the plurality of decoded blocks.   
     
     
         57 . The method of  claim 56 , wherein the encoded video data further comprises an indicator to indicate the codebook is to be used for loop filtering at least the portion of the decoded blocks. 
     
     
         58 . The method of  claim 56 , wherein the encoded video data further comprises an indicator to indicate the codebook is not to be used for loop filtering at least a second portion of the encoded video data. 
     
     
         59 . The method of  claim 56 , further comprising:
 selecting, based on the codebook and the syntax, a second set of loop filter coefficients; and   processing at least a second portion of a second plurality of decoded blocks based on implementation of the second selected loop filter coefficients by the loop filter.   
     
     
         60 . The method of  claim 56 , wherein the encoded video data further comprises update data to update a second portion of the codebook based on the update data. 
     
     
         61 . At least one machine readable medium comprising a plurality of instructions that, in response to being executed on a device, cause the device to perform video decoding by:
 receiving at least a portion of a codebook corresponding to a plurality of sets of loop filter coefficients for a loop filter;   receiving encoded video data including a syntax to enable selection of a set of loop filter coefficients based on the codebook;   decoding at least a portion of the encoded video data into at least a block of quantized coefficients;   generating a residual block based on application of an inverse quantization and an inverse transform to the block of quantized coefficients;   adding, to the residual block, a loop filtering compensated prediction block from a motion compensation predictor to form a decoded video block;   selecting, based on the codebook, the set of loop filter coefficients based on the syntax,   processing at least a portion of a plurality of decoded blocks including the decoded block based on implementation of the selected loop filter coefficients by the loop filter; and   generating decoded video data based on the plurality of decoded blocks.   
     
     
         62 . The machine readable medium of  claim 61 , wherein the encoded video data further comprises an indicator to indicate the codebook is to be used for loop filtering at least the portion of the decoded blocks. 
     
     
         63 . The machine readable medium of  claim 61 , wherein the encoded video data further comprises an indicator to indicate the codebook is not to be used for loop filtering at least a second portion of the encoded video data. 
     
     
         64 . The machine readable medium of  claim 61 , further comprising instructions that, in response to being executed on the device, cause the device to perform video decoding by:
 selecting, based on the codebook and the syntax, a second set of loop filter coefficients; and   processing at least a second portion of a second plurality of decoded blocks based on implementation of the second selected loop filter coefficients by the loop filter.   
     
     
         65 . The machine readable medium of  claim 61 , wherein the encoded video data further comprises update data to update a second portion of the codebook based on the update data. 
     
     
         66 . A system comprising:
 means for receiving at least a portion of a codebook corresponding to a plurality of sets of loop filter coefficients for a loop filter;   means for receiving encoded video data including a syntax to enable selection of a set of loop filter coefficients based on the codebook;   means for decoding at least a portion of the encoded video data into at least a block of quantized coefficients;   means for generating a residual block based on application of an inverse quantization and an inverse transform to the block of quantized coefficients;   means for adding, to the residual block, a loop filtering compensated prediction block from a motion compensation predictor to form a decoded video block;   means for selecting, based on the codebook, the set of loop filter coefficients based on the syntax;   means for processing at least a portion of a plurality of decoded blocks including the decoded block based on implementation of the selected loop filter coefficients by the loop filter; and   means for generating decoded video data based on the plurality of decoded blocks.   
     
     
         67 . The system of  claim 66 , wherein the encoded video data further comprises an indicator to indicate the codebook is to be used for loop filtering at least the portion of the decoded blocks. 
     
     
         68 . The system of  claim 66 , wherein the encoded video data further comprises an indicator to indicate the codebook is not to be used for loop filtering at least a second portion of the encoded video data. 
     
     
         69 . The system of  claim 66 , further comprising:
 means for selecting, based on the codebook and the syntax, a second set of loop filter coefficients; and   means for processing at least a second portion of a second plurality of decoded blocks based on implementation of the second selected loop filter coefficients by the loop filter.   
     
     
         70 . The system of  claim 66 , wherein the encoded video data further comprises update data to update a second portion of the codebook based on the update data. 
     
     
         71 . An apparatus comprising:
 a processor to receive at least a portion of a codebook corresponding to a plurality of sets of loop filter coefficients for a loop filter, to receive encoded video data including a syntax to enable selection of a set of loop filter coefficients based on the codebook, to decode at least a portion of the encoded video data into at least a block of quantized coefficients, to generate a residual block based on application of an inverse quantization and an inverse transform to the block of quantized coefficients, to add, to the residual block, a loop filtering compensated prediction block from a motion compensation predictor to form a decoded video block, to select, based on the codebook, the set of loop filter coefficients based on the syntax, to process at least a portion of a plurality of decoded blocks including the decoded block based on implementation of the selected loop filter coefficients by the loop filter, and to generate decoded video data based on the plurality of decoded blocks.   
     
     
         72 . The apparatus of  claim 71 , wherein the encoded video data further comprises an indicator to indicate the codebook is to be used for loop filtering at least the portion of the decoded blocks. 
     
     
         73 . The apparatus of  claim 71 , wherein the encoded video data further comprises an indicator to indicate the codebook is not to be used for loop filtering at least a second portion of the encoded video data. 
     
     
         74 . The apparatus of  claim 71 , wherein the processor comprises a filtering processor. 
     
     
         75 . The apparatus of  claim 71 , the processor further to select, based on the codebook and the syntax, a second set of loop filter coefficients and to process at least a second portion of a second plurality of decoded blocks based on implementation of the second selected loop filter coefficients by the loop filter. 
     
     
         76 . The apparatus of  claim 71 , wherein the encoded video data further comprises update data to update a second portion of the codebook based on the update data.