Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video

Abstract

An apparatus for receiving a video according to embodiments of the present invention comprises a decoder configured to decode bitstream based on viewing position and viewport information; an unpacker configured to unpack pictures in the decoded bitstream; a view regenerator configured to perform view regenerating the unpacked pictures; and a view synthesizer configured to perform view synthesis on the view regenerated pictures. A method of transmitting a video, the method comprising inter-view redundancy removing pictures for multiple viewing positions; packing the inter-view redundancy removed pictures; and encoding the packed pictures and signaling information.

The invention claimed is: 
     
       1. A method of receiving a video, the method comprising:
 decoding (i) the video and (ii) signaling information; 
 unpacking the video based on the signaling information, 
 wherein the signaling information includes patch information representing position information for a patch, 
 wherein the signaling information further includes depth information representing a range of depth for the patch, 
 wherein the signaling information further includes size information for the patch, and 
 wherein the signaling information further includes packing information; 
 based on the signaling information, view regenerating the unpacked video from which inter-view redundancy is removed; and 
 view synthesizing the view regenerated video. 
 
     
     
       2. The method of  claim 1 
 wherein the unpacked video includes at least one of a texture picture, a depth picture, a texture patch, or a texture residual, and 
 wherein the synthesized video includes a picture of target viewing position. 
 
     
     
       3. The method of  claim 2 , wherein view regenerating the unpacked video includes:
 performing translation and rotation on foreground of the unpacked video based on the signaling information including disparity information, viewing position, and viewing direction. 
 
     
     
       4. The method of  claim 2 , wherein view regenerating the unpacked video includes:
 performing occlusion detection on background of the unpacked video based on the signaling information including viewing position and viewing direction. 
 
     
     
       5. The method of  claim 2 , wherein view regenerating the unpacked video includes:
 merging foreground and background of the unpacked video; 
 crack removing the merged video; and 
 occlusion enhancing the merged video based on patch residual in the unpacked video. 
 
     
     
       6. The method of  claim 1 ,
 wherein reference views in the unpacked video include a first picture and a second picture, 
 wherein the first picture and the second picture are decomposed based on the signaling information including information for decomposition, so that a third picture for target viewing position is regenerated based on the decomposed first picture, the decomposed second picture, and the signaling information including offset information. 
 
     
     
       7. An apparatus configured to receive a video, the apparatus comprising:
 a decoder configured to decode (i) the video and (ii) signaling information; and 
 an unpacker configured to unpack the video based on the signaling information, 
 wherein the video is reconstructed based on the signaling information, 
 wherein the signaling information includes patch information representing position information for a patch, 
 wherein the signaling information further includes depth information representing a range of depth for the patch, 
 wherein the signaling information further includes size information for the patch, and 
 wherein the signaling information further includes packing information, 
 a view regenerator configured to, based on the signaling information, regenerate the unpacked video from which inter-view redundancy is removed; and 
 a view synthesizer configured to view synthesize the view regenerated video. 
 
     
     
       8. The apparatus of  claim 7 ,
 wherein the unpacked video includes at least one of a texture picture, a depth picture, a texture patch, or a texture residual, and 
 wherein the synthesized video includes a picture of target viewing position. 
 
     
     
       9. The apparatus of  claim 8 , wherein the view regenerator performs:
 translating and rotating foreground of the unpacked video based on the signaling information including disparity information, viewing position, and viewing direction. 
 
     
     
       10. The apparatus of  claim 8 , wherein the view regenerator performs:
 occlusion detecting background of the unpacked video based on the signaling information including viewing position and viewing direction. 
 
     
     
       11. The apparatus of  claim 8 , wherein the view regenerator performs:
 merging foreground and background of the unpacked video; 
 crack removing the merged video; and 
 occlusion enhancing the merged video based on patch residual in the unpacked video. 
 
     
     
       12. The apparatus of  claim 7 ,
 wherein reference views in the unpacked video include a first picture and a second picture, 
 wherein the first picture and the second picture are decomposed based on the signaling information including information for decomposition level, so that a third picture for target viewing position is regenerated based on the decomposed first picture, the decomposed second picture and the signaling information including offset information. 
 
     
     
       13. A method of transmitting a video, the method comprising:
 removing inter-view redundancy for the video, 
 packing the video and generating signaling information for the video; and 
 encoding the packed video, 
 wherein the signaling information includes patch information representing position information for a patch, 
 wherein the signaling information further includes depth information representing a range of depth for the patch, 
 wherein the signaling information further includes size information for the patch, and 
 wherein the signaling information further includes packing information. 
 
     
     
       14. The method of  claim 13 , the method comprising:
 wherein the packing information is generated by the packing the video, and 
 wherein the pictures include at least one of a texture picture, a depth picture, a texture patch, or a texture residual. 
 
     
     
       15. The method of  claim 13 , wherein the signaling information includes,
 offset information representing an offset between location of a component of a reference view and location of a component of a view to be regenerated, and 
 information for decomposition level. 
 
     
     
       16. The method of  claim 13 , wherein the signaling information includes,
 information for hole filling, information for crack removal and information for occlusion enhancement. 
 
     
     
       17. An apparatus configured to transmit a video, the apparatus comprising:
 a remover configured to remove inter-view redundancy of pictures for the video; 
 a packer configured to pack the video and generate signaling information; and 
 an encoder configured to encode the packed video, wherein the signaling information includes patch information representing position information for a patch, 
 wherein the signaling information further includes depth information representing a range of depth for the patch, 
 wherein the signaling information further includes size information for the patch, and 
 wherein the signaling information further includes packing information. 
 
     
     
       18. The apparatus of  claim 17 ,
 wherein the packing information is generated by the packer, and 
 wherein the pictures include at least one of a texture picture, a depth picture, a texture patch, or a texture residual. 
 
     
     
       19. The apparatus of  claim 17 , wherein the signaling information includes,
 offset information representing an offset between location of a component of a reference view and location of a component of a view to be regenerated, and 
 information for decomposition level. 
 
     
     
       20. The apparatus of  claim 17 , wherein the signaling information includes,
 information for hole filling, information for crack removal and information for occlusion enhancement.