Multiview video decoding apparatus and multiview video decoding method

Abstract

A multiview video decoding apparatus which sufficiently suppresses artifact in a decoded image even when an error occurs in the to-be-decoded image. It decodes a video stream including first coded video information of a first viewpoint and second coded video information of a second viewpoint, and includes: a decoding unit which decodes the video stream; and an error detecting unit which detects an error in the video stream; and an error concealing unit which conceals the error and includes (i) a decoding control unit which, when the error is in first coded image information in the first coded video information, causes said decoding unit to decode second coded image information included in the second coded video information and to be decoded after the first coded image information and (ii) a concealment processing unit which conceals the detected error, using decoded image information generated by decoding the second coded image information.

1 . A multiview video decoding apparatus which decodes a video stream including first coded video information of a first viewpoint and second coded video information of a second viewpoint different from the first viewpoint, said multiview video decoding apparatus comprising:
 a decoding unit configured to decode the video stream;   an error detecting unit configured to detect an error in the video stream; and   an error concealing unit configured to conceal the error detected by said error detecting unit,   wherein said error concealing unit includes:   a decoding control unit configured, when the error detected by said error detecting unit is included in first coded image information in the first coded video information, to control said decoding unit such that said decoding unit decodes second coded image information included in the second coded video information, the second coded image information being scheduled to be decoded after the first coded image information is decoded; and   a concealment processing unit configured to conceal the error detected by said error detecting unit, using decoded image information generated by the decoding of the second coded image information by said decoding unit.   
     
     
         2 . The multiview video decoding apparatus according to  claim 1 ,
 wherein the second coded video information is coded with reference to the first coded video information,   said error concealing unit further includes   a determining unit configured to determine whether or not the second coded image information relates to an intra image or determine whether or not the second coded image information requires parallax compensation processing, when the detected error is included in the first coded image information, and   said decoding control unit is configured to control said decoding unit such that said decoding unit decodes the second coded image information, when said determining unit determines that the second coded image information relates to an intra image or determines that the second coded image information does not require parallax compensation processing.   
     
     
         3 . The multiview video decoding apparatus according to  claim 2 ,
 wherein said concealment processing unit is configured to replace a result of decoding the first coded image information with first concealment image information that is decoded image information generated when said decoding unit decodes the second coded image information.   
     
     
         4 . The multiview video decoding apparatus according to  claim 3 ,
 wherein the second coded image information is image information that is displayed at substantially a same time as a display time of the first coded image information.   
     
     
         5 . The multiview video decoding apparatus according to  claim 3 ,
 wherein said concealment processing unit is configured to replace the result of decoding the first coded image information with second concealment image information that is decoded image information generated before the decoding of the first coded image information when said decoding unit decodes the first coded video information, when said determining unit determines that the second coded image information does not relate to an intra image or determines that the second coded image information requires the parallax compensation processing.   
     
     
         6 . The multiview video decoding apparatus according to  claim 5 ,
 wherein said decoding control unit is configured to control said decoding unit such that said decoding units decodes the second coded image information after said concealment processing unit conceals the error, when said determining unit determines that the second coded image information does not relate to an intra image or determines that the second coded image information requires the parallax compensation processing,   said decoding unit is configured to generate third concealment image information that is decoded image information by decoding the second coded image information under the control of said decoding control unit,   said determining unit is further configured to determine whether or not said decoding unit refers to the second concealment image information when said decoding unit generates the third concealment image information, and   said concealment processing unit is configured to replace the second concealment image information with the third concealment image information when said determining unit determines that the second concealment image information is not yet referred to.   
     
     
         7 . The multiview video decoding apparatus according to  claim 2 ,
 wherein said concealment processing unit is configured to generate fourth concealment image information by performing motion compensation processing using decoded image information generated when said decoding unit decodes the second coded image information, and replace a result of decoding the first coded image information with the fourth concealment image information.   
     
     
         8 . The multiview video decoding apparatus according to  claim 1 ,
 wherein said error concealing unit is configured to conceal the error detected by said error detecting unit by replacing, in a processing unit smaller than a frame, image information including the error with predetermined image information.   
     
     
         9 . A multiview video decoding method of decoding a video stream including first coded video information of a first viewpoint and second coded video information of a second viewpoint different from the first viewpoint, said multiview video decoding method comprising:
 decoding the video stream;   detecting an error in the video stream; and   concealing the error detected in said detecting,   wherein, in said decoding,   second coded image information included in the second coded video information is decoded when the error detected in said detecting is included in first coded image information in the first coded video information, the second coded image information being scheduled to be decoded after the first coded image information is decoded, and   in said concealing,   the error detected in said detecting is concealed using decoded image information generated by decoding the second coded image information.   
     
     
         10 . A non-transitory computer-readable recording medium for a computer, said recording medium having a program recorded thereon, is the program causing a computer to execute a multiview video decoding method of decoding a video stream including first coded video information of a first viewpoint and second coded video information of a second viewpoint different from the first viewpoint, and the multiview video decoding method including:
 decoding the video stream;   detecting an error in the video stream; and   concealing the error detected in the detecting,   wherein, in the decoding,   second coded image information included in the second coded video information is decoded when the error detected in the detecting is included in first coded image information in the first coded video information, the second coded image information being scheduled to be decoded after the first coded image information is decoded, and   in the concealing,   the error detected in the detecting is concealed using decoded image information generated by decoding the second coded image information.   
     
     
         11 . An integrated circuit which decodes a video stream including first coded video information of a first viewpoint and second coded video information of a second viewpoint different from the first viewpoint, said integrated circuit comprising:
 a decoding unit configured to decode the video stream;   an error detecting unit configured to detect an error in the video stream; and   an error concealing unit configured to conceal the error detected by said error detecting unit,   wherein said error concealing unit includes:   a decoding control unit configured, when the error detected by said error detecting unit is included in first coded image information in the first coded video information, to control said decoding unit such that said decoding unit decodes second coded image information included in the second coded video information, the second coded image information being scheduled to be decoded after the first coded image information is decoded; and   a concealment processing unit configured to conceal the error detected by said error detecting unit, using decoded image information generated by the decoding of the second coded image information by said decoding unit.