Compressed domain data channel for watermarking, scrambling and steganography

Abstract

A computer-implemented method is provided for processing a video stream in the compressed domain for watermarking, scrambling and other applications. Syntax elements are generated for input video as part of a video compression process. The syntax elements are entropy coded with an arithmetic entropy encoding process to produce a compressed bitstream for the input video. Regions of frames and related syntax elements of the input video are identified as candidates for modification. Based on metadata associated with a particular user, the syntax elements, the regions, and entropy coding state of the arithmetic entropy encoding process, bytes of the input video are changed to generate a modifying bitstream that is unique to the particular user; and modifying the compressed bitstream using the modifying bitstream to produce a decodable bitstream for the input video.

What is claimed is: 
     
       1. A computer-implemented method comprising:
 obtaining uncompressed input video; 
 generating syntax elements for the input video as part of a video compression process; 
 entropy coding the syntax elements with an arithmetic entropy encoding process to produce a compressed bitstream for the input video; 
 identifying regions of frames and related syntax elements of the input video which are candidates for modification; 
 based on metadata associated with a particular user, the syntax elements, the regions, and entropy coding state of the arithmetic entropy encoding process, changing bytes of the input video to generate a modifying bitstream that is unique to the particular user; and 
 modifying the compressed bitstream using the modifying bitstream to produce a decodable bitstream for the input video. 
 
     
     
       2. The method of  claim 1 , wherein the metadata is descriptive of a watermarking signal unique to the particular user. 
     
     
       3. The method of  claim 1 , wherein changing bytes of the input video is performed to produce a unique modifying bitstream for each of a plurality of users based on unique metadata associated with each of the plurality of users. 
     
     
       4. The method of  claim 1 , wherein changing includes:
 identifying potential syntax elements for modification based on identifiers of the regions; 
 identifying which of the potential syntax elements may be changed and how bytes of the bitstream may be changed based on the entropy coding state and possible changes to the potential syntax elements, and producing identified byte locations representative thereof; and 
 modifying the identified byte locations of the bitstream based on the metadata. 
 
     
     
       5. The method of  claim 4 , wherein the potential syntax elements which are changed are encoded with bypass-coded bits. 
     
     
       6. The method of  claim 5 , wherein the modifying includes changing at least one of sign bits, transform coefficient bits, motion vectors, intra prediction modes, inter prediction modes, filter coefficients or filter selection parameters, loop filter parameters, quantization indices, header data or metadata contained in headers. 
     
     
       7. The method of  claim 1 , wherein changing comprises changing bytes of non-reference frames, including frames just before a decoder refresh frame. 
     
     
       8. The method of  claim 1 , wherein the metadata is descriptive of a scrambling code, and wherein modifying comprises modifying the compressed bitstream with the modifying bitstream to produce a scrambled bitstream based on the scrambling code, and further comprising:
 sending the scrambled bitstream to a user device associated with the particular user. 
 
     
     
       9. The method of  claim 8 , further comprising:
 modifying the scrambled bitstream using the modifying bitstream to produce an unscrambled compressed bitstream; and 
 decoding the unscrambled compressed bitstream to recover the input video. 
 
     
     
       10. The method of  claim 9 , further comprising, at the user device:
 obtaining the metadata; and 
 generating the modifying bitstream using the metadata. 
 
     
     
       11. An apparatus comprising:
 a communication interface; and 
 a processor coupled to the communication interface, wherein the processor is configured to:
 obtain uncompressed input video; 
 generate syntax elements for the input video as part of a video compression process; 
 entropy code the syntax elements with an arithmetic entropy encoding process to produce a compressed bitstream for the input video; 
 identify regions of frames and related syntax elements of the input video which are candidates for modification; and 
 based on metadata associated with a particular user, the syntax elements, the regions, and entropy coding state of the arithmetic entropy encoding process, change bytes of the input video to generate a modifying bitstream that is unique to the particular user; and 
 modify the compressed bitstream using the modifying bitstream to produce a decodable bitstream for the input video. 
 
 
     
     
       12. The apparatus of  claim 11 , wherein the metadata is descriptive of a watermarking signal unique to the particular user. 
     
     
       13. The apparatus of  claim 11 , wherein the processor is configured to change bytes of the input video to produce a unique modifying bitstream for each of a plurality of users based on unique metadata associated with each of the plurality of users. 
     
     
       14. The apparatus of  claim 11 , wherein the processor is configured to change bytes by:
 identifying potential syntax elements for modification based on identifiers of the regions; 
 identifying which of the potential syntax elements may be changed and how bytes of the bitstream may be changed based on the entropy coding state and possible changes to the potential syntax elements, and producing identified byte locations representative thereof; and 
 modifying the identified byte locations of the bitstream based on the metadata. 
 
     
     
       15. The apparatus of  claim 14 , wherein the potential syntax elements which are changed are encoded with bypass-coded bits. 
     
     
       16. One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor, cause the processor to perform operations including:
 obtaining uncompressed input video; 
 generating syntax elements for the input video as part of a video compression process; 
 entropy coding the syntax elements with an arithmetic entropy encoding process to produce a compressed bitstream for the input video; 
 identifying regions of frames and related syntax elements of the input video which are candidates for modification; 
 based on metadata associated with a particular user, the syntax elements, the regions, and entropy coding state of the arithmetic entropy encoding process, changing bytes of the input video to generate a modifying bitstream that is unique to the particular user; and 
 modifying the compressed bitstream using the modifying bitstream to produce a decodable bitstream for the input video. 
 
     
     
       17. The non-transitory computer readable storage media of  claim 16 , wherein the metadata is descriptive of a watermarking signal unique to the particular user. 
     
     
       18. The non-transitory computer readable storage media of  claim 16 , wherein the instructions operable for changing bytes comprises instructions operable for changing bytes of the input video to produce a unique modifying bitstream for each of a plurality of users based on unique metadata associated with each of the plurality of users. 
     
     
       19. The non-transitory computer readable storage media of  claim 16 , wherein the instructions operable for changing bytes comprises instructions operable for:
 identifying potential syntax elements for modification based on identifiers of the regions; 
 identifying which of the potential syntax elements may be changed and how bytes of the bitstream may be changed based on the entropy coding state and possible changes to the potential syntax elements, and producing identified byte locations representative thereof; and 
 modifying the identified byte locations of the bitstream based on the metadata. 
 
     
     
       20. The non-transitory computer readable storage media of  claim 16 , wherein the potential syntax elements which are changed are encoded with bypass-coded bits.