Method for display time stamping and synchronization of multiple video objects planes

Abstract

A method of encoding a local time base embedded in the compressed data is disclosed. The local time base is encoded in two parts. The first part has a modulo time base that indicates the specific interval in the reference time base and the second part has a time base increment relative to the reference time. Two forms of time base increment is used to allow for the possibility of different encoding order and displaying order. A mechanism for the synchronization of multiple compressed streams with local time base is also described. A time base offset mechanism is also used to allow finer granularity synchronization of the multiple compressed streams.

1. A method of encoding a local time base of an audio visual sequence in the compressed data comprising the steps of:
 obtaining instances of the audio visual sequence by temporal sampling;    determining the local time base of the said instances to be encoded into compressed data;    encoding the said local time base in two parts, comprising of a modulo time base that marks the occurrence of a set of time reference spaced evenly at a specific interval on the local time base and a time base increment relative to the said evenly spaced time reference;    inserting the modulo time base into the compressed data whenever the specific interval have elapsed; and    inserting the time base increment within the compressed data of the said instances of the audio visual sequence.    
     
     
       2. A method of  claim 1 , wherein a plurality of compressed bitstreams containing local time base information encoded therein are multiplexed and de-multiplexed, for de-multiplexing further comprising the steps of:
 decoding the time base offset of the individual compressed bitstream;    examining the multiplexed bitstream for the next compressed instance and placing the said instance into the appropriate compressed bitstream until a modulo time base is encountered in the multiplexed bitstream;    inserting a modulo time base to each of the compressed bitstreams; and    repeating the last two steps until the multiplexed bitstream is exhausted.    
     
     
       3. A method of decoding a local time base of an audio visual sequence from the time base of the compressed data encoded according to  claim 1  comprising the steps of:
 initializing the reference time base taking into account the time base offset;    incrementing the reference time base by a specific interval for each modulo time base decoded;    decoding the time base increment of the compressed instance; and    determining the decoding time base of the said instance by adding the said decoded time base increment value to the reference time base.    
     
     
       4. A method of encoding the time base according to  claim 1  where the local time base, time base increment and time base offsets are in units of milliseconds and the specific interval has a duration of 1000 milliseconds. 
     
     
       5. A method of  claim 1 , wherein a plurality of compressed bitstreams containing local time base information encoded therein are multiplexed, for multiplexing further comprising the steps of:
 synchronizing the local time base of the individual compressed bitstream to a common time base by encoding and inserting the time base offset in the multiplexed bitstream;    examining each of the compressed bitstream for the next compressed instance to be placed into the multiplexed bitstream until all the compressed bitstreams have arrived at the modulo time base;    inserting a common modulo time base into the multiplex bitstream and skipping the modulo time base of the compressed bitstreams; and    repeating the last two steps until all compressed bitstreams are exhausted.    
     
     
       6. A method of multiplexing a plurality of compressed bitstreams as in  claim 5  where the individual compressed bitstreams are themselves multiplexed bitstreams. 
     
     
       7. A method of encoding a local time base of an audio visual sequence in the compressed data comprising the steps of:
 obtaining instances of the audio visual sequence by temporal sampling;    determining the local time base of the said instances to be encoded into compressed data;    encoding the said instances in one of two methods comprising of a first method of compression without reference to any future instances and a second method of compression which refers to the future reconstructed instance;    encoding the said local time base in two parts, comprising of a modulo time base that marks the occurrence of a set of time reference spaced evenly at a specific interval on the local time base and a time base increment;    encoding the time base increment for the instance compressed using the first compression method as an absolute value relative to the said evenly spaced time reference;    encoding the time base increment for the instance compressed using the second compression method as a relative value to the local time base of the previously compressed instance using the said first method;    inserting the modulo time base into the compressed data whenever the specific interval have elapsed; and    inserting the time base increment within the compressed data of the said instances of the audio visual sequence.    
     
     
       8. A method of decoding a local time base of an audio visual sequence from the time base of the compressed data encoded according to  claim 7  comprising the steps of
 initializing the reference time base taking into account of the time base offset;    incrementing the reference time base by a specific interval for each modulo time base decoded;    decoding the time base increment of the compressed instance; and    determining the time base increment to be one of two types, absolute or relative, depending on the first or second compression method used in the encoding of the instance, respectively;    determining the decoding time base of the said instance by adding the said decoded time base increment value to the reference time base if the time base is of the first type; and    determining the decoding time base of the said instance by adding the said decoded time base increment value to the decoding time base of the previous instance encoded using the first compression method, if the time base increment is of the second type.    
     
     
       9. A method for decoding a local time base from compressed data, comprising:
   decoding a modulo time base of a video object plane to increment a reference time base by a specific interval;        decoding a time base increment of the video object plane; and        combining a value of the decoded time base increment and the reference time base to determine the local time base of the video object plane.      
     
     
       10. A method for decoding a local time base from compressed data obtained by encoding video object planes, the local time base being encoded in two parts, a first part being a modulo time base data indicating that a reference time base is to be incremented by a predetermined time interval, and a second part being a value indicating a time base increment, the method comprising:
   decoding the modulo time base data of a video object plane, and incrementing the reference time base with the predetermined time interval to obtain an incremented reference time base;        decoding the time base increment of the video object plane; and        determining the local time base of the video object plane by combining the decoded time base increment and the incremented reference time base.      
     
     
       11. The method of  claim 10 , wherein the modulo time base data comprises a number of  1 's indicating a number of seconds by which the reference time base is to be incremented.  
     
     
       12. A method for decoding a local time base from compressed data obtained by encoding video object planes, the local time base being encoded in two parts, a first part being a modulo time base data that indicates whether a reference time base is to be incremented by a predetermined time interval, and a second part being a value indicating a time base increment, the method comprising:
   decoding the modulo time base data of a video object plane, and incrementing the reference time base with the predetermined time interval if the modulo time base data indicates that reference time base is to be incremented to obtain an incremented reference time base;        decoding the time base increment of the video object plane; and        determining the local time base of the video object plane by combining the decoded time base increment and one of the reference time base and the incremented reference time base.      
     
     
       13. The method of  claim 12 , wherein the modulo time base data comprises a number of  1 's indicating a number of seconds by which the reference time base is to be incremented.  
     
     
       14. The method of  claim 12 , wherein the reference time base is not incremented when the modulo time base data is  0 .