Processing multiview video

Abstract

Decoding a video signal comprises receiving a bitstream comprising the multiview video signal encoded according to dependency relationships between respective views, and view-dependency data representing the dependency relationships; extracting the view-dependency data and determining the dependency relationships from the extracted data; and decoding the multiview video signal according to the determined dependency relationships using illumination compensation between segments of pictures in respective views, where the multiview video signal includes multiple views each comprising multiple pictures segmented into multiple segments.

What is claimed is: 
     
       1. A method for decoding multi-view video data in a multi-view video data stream, with a decoder, the method comprising:
 obtaining, with a Network Abstraction Layer parsing unit, identification information representing the multi-view video data stream including inter-view prediction structure information of a random access picture, all slices in the random access picture referring only to slices having a same temporal position and being in a different view of the multi-view video data; 
 obtaining, with the Network Abstraction Layer parsing unit, inter-view prediction structure information of the random access picture from the multi-view video data stream based on the identification information, the inter-view prediction structure information indicating a reference relation between inter-view reference pictures; 
 determining, with a decoded picture buffer unit, a reference picture list of a current slice for inter-view prediction using the inter-view prediction structure information of the random access picture; 
 determining, with an inter-prediction unit, a prediction value of a macroblock in the current slice based on the determined reference picture list for inter-view prediction; and 
 decoding the macroblock in the current slice using the prediction value, 
 wherein the multi-view video data includes video data of a base view and an ancillary view, the base view indicating a view being decoded independently of other views without using inter-view prediction, and the ancillary view being a view other than the base view, 
 wherein the inter-view reference pictures are identified by decoding order information between pictures, output order information between pictures, and view information identifying a view of each picture, 
 wherein the decoder includes the Network Abstraction Layer parsing unit, the decoded picture buffer unit, and the inter-prediction unit. 
 
     
     
       2. The method of  claim 1 , wherein the inter-view prediction structure information includes number information and view identification information, the number information indicating a total number of views in the multi-view video data, and the view identification information providing a view identifier of each reference view in the multi-view video data. 
     
     
       3. The method of  claim 1 , wherein the inter-view prediction structure information of the random access picture is obtained by considering a predictive direction. 
     
     
       4. The method of  claim 3 , wherein the predictive direction represents a forward direction or a backward direction in an output order of pictures. 
     
     
       5. The method of  claim 1 , wherein the ancillary view is decoded by referring to the base view. 
     
     
       6. The method of  claim 1 , wherein the inter-view prediction structure information is obtained from sequence parameter set information of a multi-view video. 
     
     
       7. An apparatus for decoding multi-view video data in a multi-view video data stream, comprising:
 a Network Abstraction Layer parsing unit obtaining identification information representing the multi-view video data stream including inter-view prediction structure information of a random access picture, all slices in the random access picture referring only to slices having a same temporal position and being in a different view of the multi-view video data, and obtaining inter-view prediction structure information of the random access picture from the multi-view video data stream based on the identification information, the inter-view prediction structure information indicating a reference relation between inter-view reference pictures; 
 a decoded picture buffer unit determining a reference picture list of a current slice for inter-view prediction using the inter-view prediction structure information of the random access picture; and 
 an inter-prediction unit determining a prediction value of a macroblock in the current slice based on the determined reference picture list for inter-view prediction, and decoding the macroblock in the current slice using the prediction value, 
 wherein the multi-view video data includes video data of a base view and an ancillary view, the base view indicating a view being decoded independently of other views without using inter-view prediction, and the ancillary view being a view other than the base view, 
 wherein the inter-view reference pictures are identified by decoding order information between pictures, output order information between pictures and view information identifying a view of each picture. 
 
     
     
       8. The apparatus of  claim 7 , wherein the inter-view prediction structure information includes number information and view identification information, the number information indicating a total number of views in the multi-view video data, and the view identification information providing a view identifier of each reference view in the multi-view video data. 
     
     
       9. The apparatus of  claim 7 , wherein the inter-view prediction structure information of the random access picture is obtained by considering a predictive direction. 
     
     
       10. The apparatus of  claim 9 , wherein the predictive direction represents a forward direction or a backward direction in an output order of pictures. 
     
     
       11. The apparatus of  claim 7 , wherein the ancillary view is decoded by referring to the base view. 
     
     
       12. The apparatus of  claim 7 , wherein the inter-view prediction structure information is obtained from sequence parameter set information of a multi-view video. 
     
     
       13. A method for decoding multi-view video data in a multi-view video data stream, with a decoder, the method comprising:
 obtaining, with a Network Abstraction Layer parsing unit, identification information representing the multi-view video data stream including inter-view prediction structure information of a random access picture, all slices in the random access picture referring only to slices having a same temporal position and being in a different view of the multi-view video data;   obtaining, with the Network Abstraction Layer parsing unit, inter-view prediction structure information of the random access picture from the multi-view video data stream based on the identification information, the inter-view prediction structure information indicating a reference relation between inter-view pictures;   determining, with a decoded picture buffer unit, a reference picture list of a current slice for inter-view prediction using the inter-view prediction structure information of the random access picture;   determining, with an inter-prediction unit, a prediction value of a macroblock in the current slice based on the determined reference picture list for inter-view prediction; and   decoding the macroblock in the current slice using the prediction value,   wherein the multi-view video data includes video data of a base view and an ancillary view, the base view indicating a view being decoded independently of other views without using inter-view prediction, and the ancillary view being a view other than the base view,   wherein the inter-view pictures are identified by view information identifying a view of each picture,   wherein the decoder includes the Network Abstraction Layer parsing unit, the decoded picture buffer unit, and the inter-prediction unit.    
     
     
       14. The method of claim 13, wherein the inter-view prediction structure information includes number information and view identification information, the number information indicating a total number of views in the multi-view video data, and the view identification information providing a view identifier of each reference view in the multi-view video data.  
     
     
       15. The method of claim 13, wherein the inter-view prediction structure information of the random access picture is obtained by considering a predictive direction.  
     
     
       16. The method of claim 15, wherein the predictive direction represents a forward direction or a backward direction in an output order of pictures.  
     
     
       17. The method of claim 13, wherein the ancillary view is decoded by referring to the base view.  
     
     
       18. The method of claim 13, wherein the inter-view prediction structure information is obtained from sequence parameter set information of a multi-view video.  
     
     
       19. An apparatus for decoding multi-view video data in a multi-view video data stream, comprising:
 a Network Abstraction Layer parsing unit obtaining identification information representing the multi-view video data stream including inter-view prediction structure information of a random access picture, all slices in the random access picture referring only to slices having a same temporal position and being in a different view of the multi-view video data, and obtaining inter-view prediction structure information of the random access picture from the multi-view video data stream based on the identification information, the inter-view prediction structure information indicating a reference relation between inter-view pictures;   a decoded picture buffer unit determining a reference picture list of a current slice for inter-view prediction using the inter-view prediction structure information of the random access picture; and   an inter-prediction unit determining a prediction value of a macroblock in the current slice based on the determined reference picture list for inter-view prediction, and decoding the macroblock in the current slice using the prediction value,   wherein the multi-view video data includes video data of a base view and an ancillary view, the base view indicating a view being decoded independently of other views without using inter-view prediction, and the ancillary view being a view other than the base view,   wherein the inter-view pictures are identified by view information identifying a view of each picture.    
     
     
       20. The apparatus of claim 19, wherein the inter-view prediction structure information includes number information and view identification information, the number information indicating a total number of views in the multi-view video data, and the view identification information providing a view identifier of each reference view in the multi-view video data.  
     
     
       21. The apparatus of claim 19, wherein the inter-view prediction structure information of the random access picture is obtained by considering a predictive direction.  
     
     
       22. The apparatus of claim 21, wherein the predictive direction represents a forward direction or a backward direction in an output order of pictures.  
     
     
       23. The apparatus of claim 19, wherein the ancillary view is decoded by referring to the base view.  
     
     
       24. The apparatus of claim 19, wherein the inter-view prediction structure information is obtained from sequence parameter set information of a multi-view video.