Video coding device, video decoding device and video encoding method

Abstract

A video coding device includes: a detecting unit configured to detect a foreground region, a background image and a shadow region reflected on the background image by the foreground region in an input picture; a shadow information compressing unit configured to perform a compression process to compress the information quantity of the shadow region; and a coding unit configured to code the foreground region, the background image and the information on the shadow region subjected to the compression process.

1. A video coding device comprising:
 a detecting unit configured to detect a foreground region, a background image and a shadow region reflected on the background image by the foreground region in an input picture, the detecting unit includes a shape information generating unit configured to generate shape information of the foreground region; 
 a shadow information compressing unit configured to perform a compression process to compress the information quantity of the shadow region, the shadow information compressing unit includes a specifying unit configured to specify a relative positional relationship between the foreground region and the shadow region, and a computing unit configured to obtain luminance variation information indicating a luminance variation of the shadow region relative to the background image; and 
 a coding unit configured to code the foreground region, the background image and the information on the shadow region subjected to the compression process, the coding unit codes the shape information, information of the relative positional relationship and the luminance variation information. 
 
   
   
     2. The video encoding device according to  claim 1 , wherein the specifying unit performs a matching process between the shape information of the foreground region and the shape information of the shadow region to obtain the information of the relative positional relationship. 
   
   
     3. The video encoding device according to  claim 2 , wherein the specifying unit performs a modification process to modify one of the shape information of the foreground region and the shape information of the shadow region when the degree of similarity at the matching process is a predetermined degree and below, and performs a second matching process using the modified shape information. 
   
   
     4. The video encoding device according to  claim 3 , wherein the modification process includes at least one of magnifying, reducing and rotating of the shape information. 
   
   
     5. The video encoding device according to  claim 1 , wherein a computing unit computes a decreasing rate of the luminance of the shadow region relative to the background image as the luminance variation information. 
   
   
     6. A video coding device comprising:
 a detecting unit configured to detect a foreground region, a background image and a shadow region reflected on the background image by the foreground region in an input picture, and the detecting unit extracts an object using a motion detection, and tracks the extracted object to determine the forgoing region and the shadow region based on the change of a luminance and a chrominance of the object; 
 a shadow information compressing unit configured to perform a compression process to compress the information quantity of the shadow region; and 
 a coding unit configured to code the foreground region, the background image and the information on the shadow region subjected to the compression process. 
 
   
   
     7. The video coding device according to  claim 1 , wherein the shadow information compressing unit performs, as the compression process, at least one of canceling the shadow region, changing the color of the shadow region, changing the shape of the shadow region, and changing the updating timing of the shadow region. 
   
   
     8. A video decoding device comprising:
 a decoding unit configured to receive a coded bit stream including a picture containing a foreground region, a background image and a shadow region reflected on the background image by the foreground region, and to decode the background image, shape information of the foreground region, information of the relative positional relationship between the foreground region and the shadow region, and luminance variation information indicating a luminance of luminance variation of the shadow region relative to the background image; and 
 a restoring unit configured to restore shape information of the shadow region from the shape information of the foreground region and the information of the relative positional relationship, and restore pattern information of the shadow region from the background image and the luminance variation information. 
 
   
   
     9. The video decoding device according to  claim 8 , further comprising a combining unit configured to combine the foreground region, the background region and the shadow region restored by the restoring unit. 
   
   
     10. The video decoding device according to  claim 8 , wherein the luminance variation information includes a decreasing rate of the luminance of the shadow region relative to the background image. 
   
   
     11. The video decoding device according to  claim 8 , wherein information of the relative positional relationship includes the information on a modification of one of the shape information of the foreground region and the shape information of the shadow region. 
   
   
     12. A video coding method comprising:
 detecting a foreground region, a background image and a shadow region reflected on the background image by the foreground region in an input picture, said detecting the foreground region comprises generating shape information of the foreground region; 
 performing compression process to compress the information quantity of the shadow region, said performing the compression process includes specifying a relative positional relationship between the foreground region and the shadow region, and obtaining luminance variation information indicating a luminance variation of the shadow region relative to the background image; and 
 coding the foreground region, the background image and the information of the shadow region on the shadow region subjected to the compression process, said coding the foreground region and the information on the shadow region includes coding the shape information, information of the relative positional relationship and the luminance variation information. 
 
   
   
     13. The video encoding method according to  claim 12 , wherein said specifying the relative positional relationship comprises performing a matching process between the shape information of the foreground region and the shape information of the shadow region. 
   
   
     14. The video encoding method according to  claim 13 , wherein said specifying the relative positional relationship comprises performing a modification process to modify one of the shape information of the foreground region and the shape information of the shadow region when the degree of similarity at the matching process is a predetermined degree and below, and performing a second matching process using the modified shape information. 
   
   
     15. The video encoding method according to  claim 14 , wherein the modification process includes at least one of magnifying, reducing and rotating of the shape information. 
   
   
     16. The video encoding method according to  claim 12 , wherein said obtaining the luminance variation information comprises computing a decreasing rate of the luminance of the shadow region relative to the background image. 
   
   
     17. A video coding method comprising:
 detecting a foreground region, a background image and a shadow region reflected on the background image by the foreground region in an input picture, and said detecting the foreground region and the shadow region includes extracting an object using a motion detection, and tracking the extracted object to determine the forgoing region and the shadow region based on the change of a luminance and a chrominance of the object; 
 performing compression process to compress the information quantity of the shadow region; and 
 coding the foreground region, the background image and the information of the shadow region on the shadow region subjected to the compression process. 
 
   
   
     18. The video coding method according to  claim 12 , wherein the compression process includes at least one of canceling the shadow region, changing the color of the shadow region, changing the shape of the shadow region, and changing the updating timing of the shadow region.