Screen Map and Standards-Based Progressive Codec for Screen Content Coding

Abstract

Methods and systems for delivering screen content to a client device are disclosed. One method includes, for each of a plurality of coding units corresponding to screen regions included in a screen at a particular time, classifying screen content included in the coding unit as having a content type selected from among a plurality of content types, at least one of the content types comprising a screen image type, and, based on a determination that the screen content has a screen image type, applying a progressive standards-based encoding to the screen content of that coding unit. The method also includes transmitting encoded screen content for each of the screen regions to the client device.

1 . A method of processing screen content received at a client device, the method comprising:
 receiving, at the client device, a compressed screen content bitstream including metadata defining a screen map having a plurality of screen regions each including screen content classified according to a plurality of content types, at least one of the plurality of content types comprising an image type;   decompressing the compressed screen content bitstream for each of the plurality of screen regions at the client device, at least one of the plurality of screen regions including screen content classified as the image type;   wherein decompressing the compressed screen content bitstream includes applying a progressive standards-based codec to decompress the screen content classified as the image type.   
     
     
         2 . The method of  claim 1 , further comprising, determining a content type for each of the plurality of screen regions, the content type selected from among a plurality of content types, the plurality of content types including an image type, a video type, and a text type. 
     
     
         3 . The method of  claim 2 , further comprising, based on a determination that the screen content includes at least one screen region has a video type, applying a standards-based encoding to the screen content of that coding unit. 
     
     
         4 . The method of  claim 2 , further comprising, based on a determination that the screen content includes at least one screen region has a text type, applying a text codec to the screen content of that coding unit. 
     
     
         5 . The method of  claim 1 , wherein the progressive standards-based codec comprises at least one of an MPEG AVC/H.264 codec or an MPEG HEVC/H.265 codec. 
     
     
         6 . The method of  claim 1 , wherein the metadata includes one or more quality flags, a slides flag, a special effects flag, a motion flag, a spatial skip flag, and a temporal skip flag. 
     
     
         7 . The method of  claim 1 , wherein the metadata includes a plurality of bits defining vertical and horizontal movement of the screen content. 
     
     
         8 . A system comprising:
 a programmable circuit; and   a memory communicatively connected to the programmable circuit and configured to store instructions executable by the programmable circuit, the instructions, when executed, causing the system to perform a method of processing screen content comprising:
 receiving a compressed screen content bitstream including metadata defining a screen map having a plurality of screen regions each including screen content classified according to a plurality of content types, at least one of the plurality of content types comprising an image type; 
 decompressing the compressed screen content bitstream for each of the plurality of screen regions, at least one of the plurality of screen regions including screen content classified as the image type; 
 wherein, decompressing the compressed screen content bitstream includes applying a progressive standards-based codec to decompress the screen content classified as the image type. 
   
     
     
         9 . The system of  claim 8 , wherein the programmable circuit and the memory are included in a client device. 
     
     
         10 . The system of  claim 9 , wherein the client device comprises a mobile computing device. 
     
     
         11 . The system of  claim 9 , wherein the client device includes a remote desktop client and a standards-based hardware decoder, and wherein the client device decodes encoded screen content associated with the coding units using the standards-based hardware decoder. 
     
     
         12 . The system of  claim 8 , wherein the programmable circuit comprises a special-purpose programmable circuit. 
     
     
         13 . The system of  claim 8 , wherein the plurality of coding units correspond to regions of a screen at a predetermined time. 
     
     
         14 . The system of  claim 8 , wherein encoded screen content generated by the one or more encoding modules is compatible with a standards-based codec. 
     
     
         15 . The system of  claim 8 , wherein the progressive standards-based codec comprises at least one of an MPEG AVC/H.264 codec or an MPEG HEVC/H.265 codec. 
     
     
         16 . The system of  claim 8 , wherein the method further includes determining a content type for each of the plurality of screen regions, the content type selected from among a plurality of content types, the plurality of content types including an image type, a video type, and a text type 
     
     
         17 . The system of  claim 16 , wherein the method further includes, based on a determination that the screen content includes at least one screen region has a video type, applying a standards-based encoding to the screen content of that coding unit. 
     
     
         18 . The system of  claim 16 , wherein the method further includes, based on a determination that the screen content includes at least one screen region has a text type, applying a text codec to the screen content of that coding unit. 
     
     
         19 . The system of  claim 8 , wherein the metadata includes one or more quality flags, a slides flag, a special effects flag, a motion flag, a spatial skip flag, and a temporal skip flag. 
     
     
         20 . The system of  claim 8 , wherein the metadata includes a plurality of bits defining vertical and horizontal movement of the screen content.