System and method for scalable encoding and decoding of multimedia data using multiple layers

Abstract

A method of using a base layer to predict an enhancement layer is disclosed. The method may include using a block of multimedia data to generate a base residual including base quantized coefficients, using the block of multimedia data to generate an enhancement residual including enhancement quantized coefficients, determining a first value based on the base quantized coefficients, determining a second value based on the enhancement quantized coefficients, and determining the enhancement layer using at least one of the base quantized coefficients or the enhancement quantized coefficients. A method of decoding a multimedia bitstream may include receiving a multimedia bitstream having a base layer and an enhancement layer and decoding the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.

1 . A method of using a base layer to predict an enhancement layer, comprising:
 using a block of multimedia data to generate a base residual including a plurality of base quantized coefficients;   using the block of multimedia data to generate an enhancement residual including a plurality of enhancement quantized coefficients;   determining a first value based on the plurality of base quantized coefficients;   determining a second value based on the plurality of enhancement quantized coefficients; and   determining the enhancement layer using at least one of the plurality of base quantized coefficients or the plurality of enhancement quantized coefficients.   
     
     
         2 . The method of  claim 1 , further comprising transmitting a minimum value of the plurality of base quantized coefficients if the first value is equal to the second value. 
     
     
         3 . The method of  claim 1 , further comprising determining a minimum value from the plurality of base quantized coefficients and the plurality of enhancement quantized coefficients. 
     
     
         4 . The method of  claim 1 , further comprising setting the first value to zero if the first sum is less than a threshold. 
     
     
         5 . The method of  claim 1 , further comprising transmitting the plurality of enhancement quantized coefficients if a sign of the plurality of base quantized coefficients is not equal to a sign of the plurality of enhancement quantized coefficients. 
     
     
         6 . The method of  claim 1 , further comprising using temporal prediction to generate a base motion vector and the base residual. 
     
     
         7 . The method of  claim 1 , further comprising using temporal prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         8 . The method of  claim 1 , further comprising using interlayer prediction to generate a base motion vector and the base residual. 
     
     
         9 . The method of  claim 1 , further comprising using interlayer prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         10 . An apparatus for using a base layer to predict an enhancement layer, comprising:
 a motion estimation module for using a block of multimedia data to generate a base residual including a plurality of base quantized coefficients and for using the block of multimedia data to generate an enhancement residual including a plurality of enhancement quantized coefficients; and   a prediction module for determining a first value based on the plurality of base quantized coefficients, for determining a second value based on the plurality of enhancement quantized coefficients and for determining the enhancement layer using at least one of the plurality of base quantized coefficients or the plurality of enhancement quantized coefficients.   
     
     
         11 . The apparatus of  claim 10 , wherein the prediction module further comprises transmitting a minimum value of the plurality of base quantized coefficients if the first value is equal to the second value. 
     
     
         12 . The apparatus of  claim 10 , wherein the prediction module further comprises determining a minimum value from the plurality of base quantized coefficients and the plurality of enhancement quantized coefficients. 
     
     
         13 . The apparatus of  claim 10 , wherein the prediction module further comprises setting the first value to zero if the first sum is less than a threshold. 
     
     
         14 . The apparatus of  claim 10 , wherein the motion estimation module further comprises transmitting the plurality of enhancement quantized coefficients if a sign of the plurality of base quantized coefficients is not equal to a sign of the plurality of enhancement quantized coefficients. 
     
     
         15 . The apparatus of  claim 10 , wherein the motion estimation module further comprises using temporal prediction to generate a base motion vector and the base residual. 
     
     
         16 . The apparatus of  claim 10 , wherein the motion estimation module further comprises using temporal prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         17 . The apparatus of  claim 10 , wherein the motion estimation module further comprises using interlayer prediction to generate a base motion vector and the base residual. 
     
     
         18 . The apparatus of  claim 10 , wherein the motion estimation module further comprises using interlayer prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         19 . An apparatus for using a base layer to predict an enhancement layer, comprising:
 means for using a block of multimedia data to generate a base residual including a plurality of base quantized coefficients;   means for using the block of multimedia data to generate an enhancement residual including a plurality of enhancement quantized coefficients;   means for determining a first value based on the plurality of base quantized coefficients;   means for determining a second value based on the plurality of enhancement quantized coefficients; and   means for determining the enhancement layer using at least one of the plurality of base quantized coefficients or the plurality of enhancement quantized coefficients.   
     
     
         20 . The apparatus of  claim 19 , further comprising means for transmitting a minimum value of the plurality of base quantized coefficients if the first value is equal to the second value. 
     
     
         21 . The apparatus of  claim 19 , further comprising means for determining a minimum value from the plurality of base quantized coefficients and the plurality of enhancement quantized coefficients. 
     
     
         22 . The apparatus of  claim 19 , further comprising means for setting the first value to zero if the first sum is less than a threshold. 
     
     
         23 . The apparatus of  claim 19 , further comprising means for transmitting the plurality of enhancement quantized coefficients if a sign of the plurality of base quantized coefficients is not equal to a sign of the plurality of enhancement quantized coefficients. 
     
     
         24 . The apparatus of  claim 19 , further comprising means for using temporal prediction to generate a base motion vector and the base residual. 
     
     
         25 . The apparatus of  claim 19 , further comprising means for using temporal prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         26 . The apparatus of  claim 19 , further comprising means for using interlayer prediction to generate a base motion vector and the base residual. 
     
     
         27 . The apparatus of  claim 19 , further comprising means for using interlayer prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         28 . A machine-readable medium embodying a method of using a base layer to predict an enhancement layer, the method comprising:
 using a block of multimedia data to generate a base residual including a plurality of base quantized coefficients;   using the block of multimedia data to generate an enhancement residual including a plurality of enhancement quantized coefficients;   determining a first value based on the plurality of base quantized coefficients;   determining a second value based on the plurality of enhancement quantized coefficients; and   determining the enhancement layer using at least one of the plurality of base quantized coefficients or the plurality of enhancement quantized coefficients.   
     
     
         29 . The machine-readable medium of  claim 28 , wherein the method further comprises transmitting a minimum value of the plurality of base quantized coefficients if the first value is equal to the second value. 
     
     
         30 . The machine-readable medium of  claim 28 , wherein the method further comprises determining a minimum value from the plurality of base quantized coefficients and the plurality of enhancement quantized coefficients. 
     
     
         31 . The machine-readable medium of  claim 28 , wherein the method further comprises setting the first value to zero if the first sum is less than a threshold. 
     
     
         32 . The machine-readable medium of  claim 28 , wherein the method further comprises transmitting the plurality of enhancement quantized coefficients if a sign of the plurality of base quantized coefficients is not equal to a sign of the plurality of enhancement quantized coefficients. 
     
     
         33 . The machine-readable medium of  claim 28 , wherein the method further comprises using temporal prediction to generate a base motion vector and the base residual. 
     
     
         34 . The machine-readable medium of  claim 28 , wherein the method further comprises using temporal prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         35 . The machine-readable medium of  claim 28 , wherein the method further comprises using interlayer prediction to generate a base motion vector and the base residual. 
     
     
         36 . The machine-readable medium of  claim 28 , wherein the method further comprises using interlayer prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         37 . A processor for using a base layer to predict an enhancement layer, the processor being configured to:
 use a block of multimedia data to generate a base residual including a plurality of base quantized coefficients;   use the block of multimedia data to generate an enhancement residual including a plurality of enhancement quantized coefficients;   determine a first value based on the plurality of base quantized coefficients;   determine a second value based on the plurality of enhancement quantized coefficients; and   determine the enhancement layer using at least one of the plurality of base quantized coefficients or the plurality of enhancement quantized coefficients.   
     
     
         38 . The processor of  claim 37 , further configured to transmit a minimum value of the plurality of base quantized coefficients if the first value is equal to the second value. 
     
     
         39 . The processor of  claim 37 , further configured to determine a minimum value from the plurality of base quantized coefficients and the plurality of enhancement quantized coefficients. 
     
     
         40 . The processor of  claim 37 , further configured to set the first value to zero if the first sum is less than a threshold. 
     
     
         41 . The processor of  claim 37 , further configured to transmit the plurality of enhancement quantized coefficients if a sign of the plurality of base quantized coefficients is not equal to a sign of the plurality of enhancement quantized coefficients. 
     
     
         42 . The processor of  claim 37 , further configured to use temporal prediction to generate a base motion vector and the base residual. 
     
     
         43 . The processor of  claim 37 , further configured to use temporal prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         44 . The processor of  claim 37 , further configured to use interlayer prediction to generate a base motion vector and the base residual. 
     
     
         45 . The processor of  claim 37 , further configured to use interlayer prediction to generate an enhancement motion vector and the enhancement residual. 
     
     
         46 . A method of decoding a multimedia bitstream comprising:
 receiving a multimedia bitstream having a base layer and an enhancement layer; and   decoding the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.   
     
     
         47 . The method of  claim 46 , wherein the intralayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         48 . The method of  claim 46 , wherein the interlayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         49 . The method of  claim 46 , wherein the intralayer or interlayer prediction is performed on a macroblock basis or a coefficient basis. 
     
     
         50 . The method of  claim 46 , further comprising:
 determining whether a plurality of base layer coefficients include at least one non-zero coefficient;   decoding the base layer using intralayer prediction if all the plurality of base layer coefficients have a zero value; and   decoding the base layer using interlayer prediction if at least one of the plurality of base layer coefficients has a non-zero value.   
     
     
         51 . An apparatus for decoding a multimedia bitstream comprising:
 a decision module for receiving a multimedia bitstream having a base layer and an enhancement layer; and   an interlayer prediction module for decoding the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.   
     
     
         52 . The apparatus of  claim 51 , further comprising an intralayer prediction module and wherein:
 the decision module determines whether a plurality of base layer coefficients include at least one non-zero coefficient;   the intralayer prediction module decodes the base layer using intralayer prediction if all the plurality of base layer coefficients have a zero value; and   the interlayer prediction module decodes the base layer using interlayer prediction if at least one of the plurality of base layer coefficients has a non-zero value.   
     
     
         53 . The apparatus of  claim 51 , wherein the intralayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         54 . The apparatus of  claim 51 , wherein the interlayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         55 . The apparatus of  claim 51 , wherein the intralayer or interlayer prediction is performed on a macroblock basis or a coefficient basis. 
     
     
         56 . An apparatus for decoding a multimedia bitstream comprising:
 means for receiving a multimedia bitstream having a base layer and an enhancement layer; and   means for decoding the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.   
     
     
         57 . The apparatus of  claim 56 , wherein the intralayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         58 . The apparatus of  claim 56 , wherein the interlayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         59 . The apparatus of  claim 56 , wherein the intralayer or interlayer prediction is performed on a macroblock basis or a coefficient basis. 
     
     
         60 . The apparatus of  claim 56 , further comprising:
 means for determining whether a plurality of base layer coefficients include at least one non-zero coefficient;   means for decoding the base layer using intralayer prediction if all the plurality of base layer coefficients have a zero value; and   means for decoding the base layer using interlayer prediction if at least one of the plurality of base layer coefficients has a non-zero value.   
     
     
         61 . A machine-readable medium embodying a method of decoding a multimedia bitstream, the method comprising:
 receiving a multimedia bitstream having a base layer and an enhancement layer; and   decoding the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.   
     
     
         62 . The machine-readable medium of  claim 61 , wherein the intralayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         63 . The machine-readable medium of  claim 61 , wherein the interlayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         64 . The machine-readable medium of  claim 61 , wherein the intralayer or interlayer prediction is performed on a macroblock basis or a coefficient basis. 
     
     
         65 . The machine-readable medium of  claim 61 , wherein the method further comprises:
 determining whether a plurality of base layer coefficients include at least one non-zero coefficient;   decoding the base layer using intralayer prediction if all the plurality of base layer coefficients have a zero value; and   decoding the base layer using interlayer prediction if at least one of the plurality of base layer coefficients has a non-zero value.   
     
     
         66 . A processor for decoding a multimedia bitstream, the processor being configured to:
 receive a multimedia bitstream having a base layer and an enhancement layer; and   decode the base layer to determine whether the enhancement layer should be decoded using intralayer prediction or interlayer prediction.   
     
     
         67 . The processor of  claim 66 , wherein the intralayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         68 . The processor of  claim 66 , wherein the interlayer prediction is performed on an N×M block basis or a coefficient basis. 
     
     
         69 . The processor of  claim 66 , wherein the intralayer or interlayer prediction is performed on a macroblock basis or a coefficient basis. 
     
     
         70 . The processor of  claim 66 , further configured to:
 determine whether a plurality of base layer coefficients include at least one non-zero coefficient;   decode the base layer using intralayer prediction if all the plurality of base layer coefficients have a zero value; and   decode the base layer using interlayer prediction if at least one of the plurality of base layer coefficients has a non-zero value.