US10931954B2ActiveUtilityA1

Image coding modes selection for an embedded codec circuitry

71
Assignee: SONY CORPPriority: Nov 20, 2018Filed: Nov 20, 2018Granted: Feb 23, 2021
Est. expiryNov 20, 2038(~12.4 yrs left)· nominal 20-yr term from priority
H04N 19/103H04N 19/154H04N 19/184H04N 19/176H04N 19/70H04N 19/192
71
PatentIndex Score
1
Cited by
18
References
20
Claims

Abstract

A media device includes a processor to calculate a value of an objective function for each sequence of modes of a plurality of sequences of modes, based on at least statistical data of a plurality of modes. The plurality of sequences of modes corresponds to different combinations of modes from the plurality of modes. The plurality of modes corresponds to a plurality of encoding operations executed. The processor selects a sequence of modes from the plurality of sequences of modes based on a value of the objective function associated with the sequence of modes. The modes in the selected sequence of modes are less than the plurality of modes and represents an optimal encoding scheme executable to encode an input image block.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A media device, comprising:
 a memory configured to store a plurality of modes, wherein each mode of the plurality of modes corresponds to a different encoding operation of a plurality of encoding operations; and 
 at least one processor configured to:
 calculate a value of an objective function for each sequence of modes of a plurality of sequences of modes, based on at least statistical data of the plurality of modes,
 wherein each sequence of modes of the plurality of sequences of modes comprises a combination of different modes in a defined sequence, from the plurality of modes, and 
 the statistical data comprises a count of entropy coded bits for each mode of the plurality of modes; and 
 
 select a first sequence of modes from the plurality of sequences of modes based on a first value of the objective function associated with the first sequence of modes, wherein
 the first value of the objective function is maximum among a plurality of values of the objective function associated with the plurality of sequences of modes, and 
 the selected first sequence of modes is less than the plurality of modes and represents an optimal encoding scheme executable to encode an input image block. 
 
 
 
     
     
       2. The media device according to  claim 1 , wherein the memory is further configured to store the statistical data of the plurality of modes, and wherein the at least one processor is further configured to:
 extract the stored statistical data from the memory based on the objective function; 
 calculate a sum of squared error (SSE) for each sequence of modes of the plurality of sequences of modes based on the extracted statistical data; and 
 calculate the value of the objective function for each sequence of modes of the plurality of sequences of modes based on the SSE. 
 
     
     
       3. The media device according to  claim 1 , wherein the at least one processor is further configured to:
 determine the objective function based on at least one of a compression ratio requirement, a random access requirement, a block size requirement, or an input image block characteristics. 
 
     
     
       4. The media device according to  claim 3 , wherein the objective function is a measure of coding performance, and wherein the at least one processor is further configured to:
 determine the objective function as a sum of an average of peak signal to noise ratio (PSNR) of a plurality of image blocks and a worst PSNR, based on a block level random access requirement and a fixed bit-rate requirement, wherein the worst PSNR is an average of the PSNR of image blocks that have minimum PSNR among the plurality of image blocks. 
 
     
     
       5. The media device according to  claim 1 , wherein the plurality of encoding operations comprises different entropy coding schemes, quantization schemes, residual prediction schemes, and transform coding schemes. 
     
     
       6. The media device according to  claim 1 , wherein the at least one processor is further configured to generate a set of signaling bits for each mode of the first sequence of modes based on a variable length coding (VLC) scheme, wherein a number of signaling bits for each mode of the first sequence of modes is variable. 
     
     
       7. The media device according to  claim 6 , wherein in the variable length coding scheme, the at least one processor is further configured to:
 calculate a value of a cost function for each pair of mode of a plurality of pairs of modes of the first sequence of modes, wherein the value of the cost function is a difference of values of the objective function of modes in a pair of modes of the plurality of pairs of modes; and 
 allocate the number of signaling bits for each mode of the first sequence of modes based on the calculated value of the cost function, wherein the pair of modes that has a minimum value of the cost function is allocated the maximum number of signaling bits. 
 
     
     
       8. The media device according to  claim 1 , wherein the at least one processor is further configured to:
 calculate a second value of the objective function for each mode of the plurality of modes based on the statistical data of the plurality of modes; and 
 determine a plurality of one-dimensional (1D) vectors based on the second value of the objective function, wherein the plurality of 1D vectors corresponds to the plurality of sequences of modes, and wherein each 1D vector of the plurality of 1D vectors indicates a different sequence of modes of the plurality of sequences of modes. 
 
     
     
       9. The media device according to  claim 8 , wherein a length of each 1D vector of the plurality of 1D vectors is equal to a count of the plurality of modes, wherein each 1D vector of the plurality of 1D vectors comprises binary ‘1’ values, and wherein positions of the binary ‘1’ values indicate modes in a corresponding sequence of modes of the plurality of sequences of modes. 
     
     
       10. The media device according to  claim 8 , wherein the at least one processor is further configured to:
 select a first mode and a second mode from the plurality of modes, based on comparison of the calculated second value of the objective function for each mode of the plurality of modes, wherein a third value of the objective function for the first mode and a fourth value of the objective function for the second mode are greater than values of the objective function for remaining modes of the plurality of modes; and 
 determine a 1D vector of the plurality of 1D vectors such that a binary ‘1’ value is allocated for one of the first mode or the second mode. 
 
     
     
       11. The media device according to  claim 1 , wherein the at least one processor is further configured to:
 generate a set of signaling bits for each mode of the first sequence of modes; and 
 communicate the set of signaling bits to an embedded codec (EBC) circuitry, wherein the EBC circuitry determines the optimal encoding scheme based on the communicated set of signaling bits for each mode of the first sequence of modes, wherein the optimal encoding scheme comprises a set of encoding operations of the plurality of encoding operations. 
 
     
     
       12. The media device according to  claim 11 , wherein the EBC circuitry executes the set of encoding operations to generate a bit-stream of the input image block. 
     
     
       13. A media device, comprising:
 embedded codec (EBC) circuitry that comprises encoder circuitry; 
 a memory configured to store a plurality of modes, wherein each mode of the plurality of modes corresponds to a different encoding operation of a plurality of encoding operations executed by the encoder circuitry, 
 wherein the encoder circuitry is configured to:
 calculate a value of an objective function for each sequence of modes of a plurality of sequences of modes, based on at least statistical data of the plurality of modes, wherein
 each sequence of modes of the plurality of sequences of modes comprises a combination of different modes in a defined sequence, from the plurality of modes, and 
 the statistical data comprises a count of entropy coded bits for each mode of the plurality of modes; 
 
 select a first sequence of modes from the plurality of sequences of modes based on a first value of the objective function associated with the first sequence of modes,
 wherein the first value of the objective function is maximum among a plurality of values of the objective function associated with the plurality of sequences of modes; 
 
 generate a set of signaling bits for each mode of the first sequence of modes; and 
 encode an input image block by execution of an optimal encoding scheme on the input image block, wherein the set of signaling bits indicates the optimal encoding scheme. 
 
 
     
     
       14. The media device according to  claim 13 , wherein the encoder circuitry is further configured to:
 determine the optimal encoding scheme based on the set of signaling bits for each mode of the first sequence of modes, wherein the optimal encoding scheme comprises a set of encoding operations of the plurality of encoding operations, and wherein the set of encoding operations corresponds to the first sequence of modes; and 
 generate a bit-stream of the input image block based on application of the optimal encoding scheme on the input image block. 
 
     
     
       15. The media device according to  claim 13 , wherein the encoder circuitry is further configured to:
 determine the objective function based on at least one of a compression ratio requirement, a random access requirement, a block size requirement, or an input image block characteristics. 
 
     
     
       16. The media device according to  claim 13 , wherein the memory is further configured to store the statistical data of the plurality of sequences of modes, and
 the encoder circuitry is further configured to: 
 extract the stored statistical data from the memory based on the objective function; 
 calculate a sum of squared error (SSE) for each sequence of modes of the plurality of sequences of modes based on the extracted statistical data; and 
 calculate the value of the objective function for each sequence of modes of the plurality of sequences of modes based on the SSE. 
 
     
     
       17. The media device according to  claim 13 , wherein the encoder circuitry is further configured to generate the set of signaling bits for each sequence of modes of the plurality of sequences of modes based on a variable length coding (VLC) scheme, wherein a number of signaling bits for each sequence of modes of the plurality of sequences of modes is variable. 
     
     
       18. The media device according to  claim 17 , wherein in the variable length coding scheme, the encoder circuitry is further configured to:
 calculate a value of a cost function for each pair of mode of a plurality of pairs of modes of the first sequence of modes, wherein the value of the cost function is a difference of values of the objective function of modes in a pair of modes of the plurality of pairs of modes; and 
 allocate the number of signaling bits for each mode of the first sequence of modes based on the calculated value of the cost function, wherein the pair of modes that has a minimum value of the cost function is allocated the maximum number of signaling bits. 
 
     
     
       19. The media device according to  claim 13 , wherein the encoder circuitry is further configured to:
 calculate a second value of the objective function for each mode of the plurality of modes based on the statistical data of the plurality of modes; and 
 determine a plurality of one-dimensional (1D) vectors based on the second value of the objective function, wherein the plurality of 1D vectors corresponds to the plurality of sequences of modes, and wherein each 1D vector of the plurality of 1D vectors indicates a different sequence of modes of the plurality of sequences of modes. 
 
     
     
       20. A method, comprising:
 in a media device that comprises a memory and encoder circuitry:
 storing, by the memory, a plurality of modes, wherein each mode of the plurality of modes corresponds to a different encoding operation of a plurality of encoding operations; 
 calculating, by the encoder circuitry, a value of an objective function for each sequence of modes of a plurality of sequences of modes, based on at least statistical data of the plurality of modes, wherein
 each sequence of modes of the plurality of sequences of modes comprises a combination of different modes in a defined sequence, from the plurality of modes, and 
 the statistical data comprises a count of entropy coded bits for each mode of the plurality of modes; and 
 
 selecting, by the encoder circuitry, a first sequence of modes from the plurality of sequences of modes based on a first value of the objective function associated with the first sequence of modes, wherein
 the first value of the objective function is maximum among a plurality of values of the objective function associated with the plurality of sequences of modes, and 
 
 the selected first sequence of modes is less than the plurality of modes and represents an optimal encoding scheme executable to encode an input image block.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.