Cluster-based dependency signaling

Abstract

The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with. In accordance with this concept, emphasis may be shifted between increased diversity of the signalizable inter-layer dependencies on the one hand and reduced side-information overhead for signaling the inter-layer dependencies on the other hand.

1 - 20 . (canceled) 
     
     
         21 . A device configured to process a multi-layered data stream into which a video is coded at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, the device configured to:
 read, from the multi-layered data stream,   a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and   a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID, and   construct, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers.   
     
     
         22 . The device according to  claim 21 , wherein the device is configured to read a plurality of instantiations of the second inter-dependency structure from the multi-layer data stream, namely for different pairs (j,k) of values 0<k≤j≤n<N representable by the base layer-ID, with N being the number of values representable by the base layer-ID, by
 reading, or suppressing reading, the second inter-dependency structure from the multi-layer data stream for pair (j,k) conditionally depending on the first inter-dependency syntax structure indicating a presence or non-presence of interdependency between pair (j,k), 
 wherein the instantiation of the second inter-dependency structure read for a pair (j,k) with j=k, indicates which layers among those comprising base layer-ID j are inter-layer prediction dependent on other layers among those comprising base layer-ID j, and the instantiation of the second inter-dependency structure read for pair (j,k), with k<j indicates which layers among those comprising base layer-ID j are inter-layer prediction dependent on layers among those comprising base layer-ID k. 
 
     
     
         23 . The device according to  claim 21 , wherein the device is configured to:
 read one instantiation of the second inter-dependency structure from the multi-layer data stream, the one instantiation of the second inter-dependency structure indicating, with N being the number of values representable by the base layer-ID, either   commonly for each value 0<i≤n<N representable by the base layer-ID, which layers among those comprising base layer-ID i are inter-layer prediction dependent on other layers among those comprising base layer-ID i, or   commonly for each of a set of pairs (j,k) with 0<k<j≤n<N, which layers among those comprising base layer-ID j are inter-layer prediction dependent on layers among those comprising base layer-ID k, respectively.   
     
     
         24 . The device according to  claim 21 , wherein the device is configured to
 read instantiations of the second inter-dependency structure from the multi-layer data stream, along with, for each instantiation of the second inter-dependency structure, an association syntax structure which associates the respective instantiation of the second inter-dependency structure with a respective subset of pairs (j,k) of values 0<k≤j≤n<N representable by the base layer-ID, with N being the number of values representable by the base layer-ID.   
     
     
         25 . The device according to  claim 24 , wherein the association syntax structure comprises a flag for each pair (j,k) and the device is configured to parse the association syntax structure with skipping pairs (j,k) of values 0<k≤j≤n<N for which the first inter-dependency syntax structure indicates the non-presence of interdependency between pair (j,k). 
     
     
         26 . The device according to  claim 21 , wherein the number of values representable by the extension layer-ID is M and the second inter-dependency syntax structure comprises
 one binary value for each pair (p,q) of extension values 0<q<p≤m<M, in order to indicate which layers among those comprising base layer-ID j are inter-layer prediction dependent on other layers among those comprising base layer-ID j, and   one binary value for each pair (p,q) of extension values 0<p,q≤m<M, in order to indicate which layer with extension value p and comprising base layer-ID j is inter-layer prediction dependent on layer with extension value q and comprising base layer-ID k<j.   
     
     
         27 . The device according to  claim 21 , wherein the device is configured to derive n from an explicitly signaling of a maximally assumed value among the N values representable by the base layer-ID, in the data stream, and/or derive m from an explicitly signaling of a maximally assumed value among the M values representable by the extension layer-ID, in the data stream. 
     
     
         28 . The device according to  claim 21 , where the first inter-dependency syntax structure defines interdependencies between different sets of layers and the second inter-dependency structure defines interdependencies between layers in dependent sets. 
     
     
         29 . The device according to  claim 21 , wherein the multi-layered video signal has the video material coded thereinto at the different layers using inter-layer prediction such that any layer inter-layer predicted from another layer adds one or more of further views;
 depth information;   alpha blending information;   color component information;   spatial resolution refinement; and   SNR resolution refinement.   
     
     
         30 . A device configured to process a multi-layered data stream into which a video material is coded at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, the device configured to:
 read, from the multi-layered data stream,   a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and   a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID, and   construct, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers.   
     
     
         31 . An encoder configured to encode into a multi-layered data stream a video material at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, configured to:
 insert, into the multi-layered data stream,   a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and   a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID,   with setting the first and second inter-dependency syntax structures such that, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers is constructible.   
     
     
         32 . A method for encoding into a multi-layered data stream a video material at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, comprising:
 inserting, into the multi-layered data stream,   a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and   a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID,   with setting the first and second inter-dependency syntax structures such that, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers is constructible.   
     
     
         33 . A non-transitory digital storage medium having computer-readable code stored thereon to perform, when said storage medium is run by a computer, a method according to  claim 32 .