System and method for processing symbols embedded in digital video

Abstract

Video images in, e.g., a multimedia stream are scanned prior to compression for transmission to recognize symbols, such as graphics symbols and alpha-numeric characters. The types, positions, sizes, etc. of the symbols are recorded to render symbol information, and then the images are compressed with or without compressing the symbols, which may be removed from the images prior to compression if desired. The compressed video and symbol information are sent to a receiver, which decompresses the video, optionally transforms the symbols, and then inserts the symbols where indicated by the symbol information.

1 . A method for processing a multimedia stream including at least video image information, comprising: 
 scanning at least a portion of the multimedia stream to detect whether a symbol is present-within the video image information;    creating a correlated symbol representation of the detected symbol;    producing remaining video image information by removing the symbol from the video image information of the multimedia stream; and    compressing the remaining video image information of the multimedia stream to produce a compressed stream.    
     
     
         2 . The method of  claim 1 , wherein the correlated symbol representation includes at least one symbol characteristic selected from a group consisting of a position of the symbol within the video image information, a color of the symbol, a font type of the symbol, a size of the symbol, a binary code representing the symbol, and combinations thereof.  
     
     
         3 . The method of  claim 1 , wherein the video image information includes a plurality of video frames and scanning at least a portion of the multimedia stream further includes only scanning every n-th frame of the plurality of video frames until the symbol is detected.  
     
     
         4 . The method of  claim 1 , wherein the image information represents at least one image frame of a plurality of image frames, and wherein scanning comprises scanning the at least one image frame prior to the act of compressing.  
     
     
         5 . The method of  claim 4 , further comprising using character recognition to detect the symbol.  
     
     
         6 . The method of  claim 4 , wherein the correlated symbol representation includes at least one symbol characteristic, which comprises a position of the symbol in the at least one image frame.  
     
     
         7 . The method of  claim 6 , further comprising decompressing the compressed stream to render a decompressed stream.  
     
     
         8 . The method of  claim 7 , further comprising using the position of the symbol to insert the symbol into at least one image represented by the decompressed stream.  
     
     
         9 . The method of  claim 1 , further comprising transmitting the compressed stream apart from the correlated symbol representation.  
     
     
         10 . The method of  claim 1 , further comprising transmitting the compressed stream along with the correlated symbol representation, which is embedded in the compressed stream.  
     
     
         11 . The method of  claim 1 , wherein removing the symbol comprises blanking out the symbol prior to the act of compressing.  
     
     
         12 . The method of  claim 1 , wherein removing the symbol comprises replacing pixel information representing the symbol with pixel information that matches pixels surrounding the symbol prior to compressing the remaining video image information.  
     
     
         13 . The method of  claim 1 , further comprising transmitting the compressed stream and the correlated symbol representation over a wireless channel.  
     
     
         14 . The method of  claim 13 , wherein the wireless channel is a broadcast channel.  
     
     
         15 . The method of  claim 13 , wherein the compressed stream is transmitted on a first wireless channel and the correlated symbol representation is transmitted on a second wireless channel.  
     
     
         16 . The method of  claim 15 , wherein at least one of the channels is a broadcast channel.  
     
     
         17 . The method of  claim 13 , wherein the compressed stream is transmitted on a first transmission system and the correlated symbol representation is transmitted on a second transmission system.  
     
     
         18 . A system for processing a multimedia stream comprising at least video image information, said system comprising a processor including logic for undertaking the acts of: 
 scanning at least a portion of the multimedia stream to locate a symbol within the video image information;    providing a correlated symbol representation of the symbol;    producing remaining video image information by removing the symbol from the video image information of the multimedia stream; and    compressing the remaining video image information to render a compressed stream.    
     
     
         19 . The system of  claim 18 , wherein the act of producing undertaken by the processor includes at least one of: 
 blanking out the symbol in the video image information prior to the act of compressing;    replacing pixel information representing the symbol with pixel information that matches pixels surrounding the symbol, prior to compressing;    replacing pixel values representing the symbol with values that when compressed with the image produce a smaller compressed stream as compared to compression of the video image information with pixel values representing the symbol; and    replacing the symbol with data relating to one or more of control, conveying general information, and error correction.    
     
     
         20 . The system of  claim 18 , wherein the acts undertaken by the processor include compressing the correlated symbol representation and the video image information.  
     
     
         21 . The system of  claim 18 , wherein the video image information includes a plurality of video frames and scanning at least a portion of the multimedia stream includes only scanning every n-th frame of the plurality of video frames until the symbol is detected.  
     
     
         22 . The system of  claim 18 , wherein the correlated symbol representation includes at least one symbol characteristic selected from a group consisting of a position of the symbol within the video image information, a binary code for the symbol, a color of the symbol, a size of the symbol, a font of the symbol, and combinations thereof.  
     
     
         23 . The system of  claim 18  wherein the processor is a transmitter processor, and the compressed stream and the correlated symbol representation are transmitted, and wherein the correlated symbol representation includes at least one symbol characteristic, which comprises a position of the symbol in the video image information.  
     
     
         24 . The system of  claim 23 , wherein the system further includes a receive processor executing logic to undertake acts comprising: 
 decompressing the compressed stream to produce a decompressed stream;    using the correlated symbol representation to produce a symbol image; and    combining the symbol image with the decompressed stream.    
     
     
         25 . The system of  claim 24 , wherein the acts undertaken by the receive processor further comprise using the position of the symbol to combine the symbol into the decompressed image.  
     
     
         26 . The system of  claim 23 , wherein the acts undertaken by the receive processor further comprise using transformation parameters for the symbol to alter the correlated symbol representation before combining the correlated symbol representation with the decompressed stream.  
     
     
         27 . The system of  claim 18 , wherein the compressed stream and the correlated symbol representation is transmitted over a wireless channel.  
     
     
         28 . The system of  claim 27 , wherein the wireless channel is a broadcast channel.  
     
     
         29 . The system of  claim 18 , wherein the compressed stream is transmitted on a first wireless channel and the correlated symbol representation is transmitted on a second wireless channel.  
     
     
         30 . The system of  claim 29 , wherein at least one of the channels is a broadcast channel.  
     
     
         31 . The system of  claim 18 , wherein the compressed stream is transmitted on a first transmission system and the correlated symbol representation is transmitted on a second transmission system.  
     
     
         32 . An apparatus for processing a multimedia stream comprising at least video image information, comprising: 
 means for scanning at least a portion of the multimedia stream to detect whether a symbol is present within the video image information;    means for creating a correlated symbol representation of the detected symbol;    means for producing remaining video image information by removing the symbol from the video information of the multimedia stream; and    means for compressing the remaining video image information to produce a compressed stream.    
     
     
         33 . The apparatus of  claim 32 , wherein the correlated symbol representation includes at least one symbol characteristic selected from a group consisting of a position of the symbol within the video image information, a color of the symbol, a font type of the symbol, a size of the symbol, a binary code representing the symbol, and combinations thereof.  
     
     
         34 . The apparatus of  claim 32 , wherein the video image information includes a plurality of video frames and scanning at least a portion of the multimedia stream further includes only scanning every n-th frame of the plurality of video frames until the symbol is detected.  
     
     
         35 . The apparatus of  claim 32 , wherein the image information represents at least one image frame of a plurality of image frames, and wherein scanning comprises scanning the at least one image frame prior to the act of compressing.  
     
     
         36 . The apparatus of  claim 35 , wherein the correlated symbol representation includes at least one symbol characteristic, which comprises a position of the symbol in the at least one image frame.  
     
     
         37 . The apparatus of  claim 35 , further comprising means for using character recognition to detect the symbol.  
     
     
         38 . The apparatus of  claim 37 , further comprising means for decompressing the compressed stream to render a decompressed stream.  
     
     
         39 . The apparatus of  claim 38 , further comprising means for using the position of the symbol to insert the symbol into at least one image represented by the decompressed stream.  
     
     
         40 . The apparatus of  claim 32 , further comprising means for transmitting the compressed stream apart from the correlated symbol representation.  
     
     
         41 . The apparatus of  claim 32 , further comprising means for transmitting the compressed stream along with the correlated symbol representation, which is embedded in the compressed stream.  
     
     
         42 . The apparatus of  claim 32 , wherein removing the symbol comprises blanking out the symbol prior to the act of compressing.  
     
     
         43 . The apparatus of  claim 32 , wherein removing the symbol comprises replacing pixel information representing the symbol with pixel information that matches pixels surrounding the symbol prior to compressing the remaining video image information.  
     
     
         44 . The apparatus of  claim 32 , further comprising means for transmitting the compressed stream and the correlated symbol representation over a wireless channel.  
     
     
         45 . The apparatus of  claim 44 , wherein the wireless channel is a broadcast channel.  
     
     
         46 . The apparatus of  claim 32 , wherein the compressed stream is transmitted on a first wireless channel and the correlated symbol representation is transmitted on a second wireless channel.  
     
     
         47 . The apparatus of  claim 46 , wherein at least one of the channels is a broadcast channel.  
     
     
         48 . The apparatus of  claim 32 , wherein the compressed stream is transmitted on a first transmission system and the correlated symbol representation is transmitted on a second transmission system.