Multimedia data transmitting apparatus and method, multimedia data receiving apparatus and method, multimedia data transmission system, and storage medium

Abstract

This invention makes multimedia transmission possible while maintaining the safety of information requiring security. The transmitting side transmits multimedia data which is composed of a plurality of objects and to which Intellectual Property protection information is added. A session managing unit is placed between the transmitting side and the receiving side. This session managing unit demultiplexes the multimedia data as an output stream from the transmitting side into Intellectual Property protection data and unprotected protection data, and manages a non-secure session for transmitting the unprotected protection data and a secure session for transmitting the Intellectual Property protection data.

What is claimed is:  
     
         1 . A multimedia data transmitting apparatus for transmitting multimedia data composed of a plurality of objects, comprising: 
 input means for inputting, as a bitstream, multimedia data to which intellectual property protection management data is added;    demultiplexing means for demultiplexing the multimedia data of the input bitstream into the intellectual property protection management data and other media data;    link information updating means for updating link information for linking the intellectual property protection management data and the media data; and    session managing means for managing a non-secure session for transmitting the media data and a secure session for transmitting the intellectual property protection management data.    
     
     
         2 . The apparatus according to  claim 1 , wherein said session managing means sets, in the intellectual property protection management data, a session information data set containing an identifier which indicates that the data is secure.  
     
     
         3 . The apparatus according to  claim 1 , wherein the multimedia data is MPEG-4 format data.  
     
     
         4 . A multimedia data receiving apparatus for receiving multimedia data, comprising: 
 first receiving means for receiving media data by a non-secure session;    second receiving means for receiving, by a secure session, intellectual property protection management data for protecting and managing an intellectual property with respect to the media data;    session managing means for managing the non-secure session and the secure session;    first processing means for demultiplexing media data, which is received by said session managing means via the non-secure session, into media streams, and decoding the media streams;    second processing means for decoding intellectual property protection management data received by said session managing means via the secure session; and    reproducing means for performing reproduction on the basis of the data decoded by said first and second processing means.    
     
     
         5 . A multimedia data transmitting method of transmitting multimedia data composed of a plurality of objects, comprising: 
 the input step of inputting, as a bitstream, multimedia data to which intellectual property protection management data is added;    the demultiplexing step of demultiplexing the multimedia data of the input bitstream into the intellectual property protection management data and other media data;    the link information updating step of updating link information for linking the intellectual property protection management data and the media data; and    the session managing step of managing a non-secure session for transmitting the media data and a secure session for transmitting the intellectual property protection management data.    
     
     
         6 . A storage medium storing program codes corresponding to the steps according to  claim 5 .  
     
     
         7 . A multimedia data receiving method of receiving multimedia data, comprising: 
 the first receiving step of receiving media data by a non-secure session;    the second receiving step of receiving, by a secure session, intellectual property protection management data for protecting and managing an intellectual property with respect to the media data;    the session managing step of managing the non-secure session and the secure session;    the first processing step of demultiplexing media data, which is received in the session managing step via the non-secure session, into media streams, and decoding the media streams;    the second processing step of decoding intellectual property protection management data received in the session managing step via the secure session; and    the reproducing step of performing reproduction on the basis of the data decoded by said first and second processing means.    
     
     
         8 . A storage medium storing program codes corresponding to the steps according to  claim 7 .  
     
     
         9 . A multimedia data transmitting apparatus for transmitting multimedia data composed of a plurality of objects, comprising: 
 input means for inputting media data and intellectual property protection management data for protecting and managing the intellectual property of the media data; and    session managing means for managing a non-secure session for transmitting the media data and a secure session for transmitting the intellectual property protection management data.    
     
     
         10 . The apparatus according to  claim 9 , wherein said session managing means sets, in the intellectual property protection management data, a session information data set containing an identifier which indicates that the data is secure.  
     
     
         11 . The apparatus according to  claim 9 , wherein the multimedia data is MPEG-4 format data.  
     
     
         12 . A multimedia data transmitting method of transmitting multimedia data composed of a plurality of objects, comprising: 
 the input step of inputting multimedia data and intellectual property protection management data for protecting and managing the intellectual property of the multimedia data; and    the session managing step of managing a non-secure session for transmitting the multimedia data and a secure session for transmitting the intellectual property protection management data.    
     
     
         13 . A storage medium storing program codes corresponding to the steps according to  claim 12 .  
     
     
         14 . A multimedia data transmission system for transmitting multimedia data composed of a plurality of objects, comprising: 
 input means for inputting, as a bitstream, multimedia data to which intellectual property protection management data is added;    demultiplexing means for demultiplexing the multimedia data of the input bitstream into the intellectual property protection management data and other media data;    link information updating means for updating link information for linking the intellectual property protection management data and the media data;    session managing means for managing a non-secure session for transmitting the media data and a secure session for transmitting the intellectual property protection management data;    first processing means for demultiplexing media data, which is transmitted via the non-secure session, into media streams, and decoding the media streams;    second processing means for decoding intellectual property protection management data received via the secure session; and    reproducing means for performing reproduction on the basis of the data decoded by said first and second processing means.    
     
     
         15 . A multimedia data transmission system for transmitting multimedia data composed of a plurality of objects, comprising: 
 input means for inputting multimedia data and intellectual property protection management data for protecting and managing the intellectual property of the media data;    session managing means for managing a non-secure session for transmitting the media data and a secure session for transmitting the intellectual property protection management data;    first processing means for demultiplexing media data, which is transmitted via the non-secure session, into media streams, and decoding the media streams;    second processing means for decoding intellectual property protection management data received via the secure session; and    reproducing means for performing reproduction on the basis of the data decoded by said first and second processing means.    
     
     
         16 . A data processing apparatus for encoding data containing security information in accordance with a predetermined coding standard, and transmitting the encoded data, comprising: 
 first encoding means for encoding object data;    second encoding means for encoding security information of the object data;    generating means for generating transmission data from the encoded data obtained by said first and second encoding means;    demultiplexing means for demultiplexing the transmission data obtained by said generating means into security information transmission data and object data transmission data;    first transmitting means for transmitting, by a first session, the security information transmission data obtained by said demultiplexing means; and    second transmitting means for transmitting, by a second session, the object data transmission data obtained by said demultiplexing means.    
     
     
         17 . A data processing apparatus for encoding data containing security information in accordance with a predetermined coding standard, and transmitting the encoded data, comprising: 
 first encoding means for encoding object data;    second encoding means for encoding security information of the object data;    first transmitting means for transmitting, by a first session, transmission data for the encoded data obtained by said first encoding means; and    second transmitting means for transmitting, by a second session, transmission data for the encoded data obtained by said second encoding means.    
     
     
         18 . The apparatus according to  claim 16 , wherein said first encoding means comprises security adding means for adding security to object data.  
     
     
         19 . The apparatus according to  claim 16 , wherein 
 the first session includes a non-secure session, and    the second session includes a secure session.    
     
     
         20 . The apparatus according to  claim 16 , further comprising decoding means for decoding the object data and the security information from the data transmitted by said first and second transmitting means.  
     
     
         21 . The apparatus according to  claim 16 , wherein the predetermined coding standard is an MPEG-4 coding standard.  
     
     
         22 . The apparatus according to  claim 21 , wherein the security information is IPMP data.  
     
     
         23 . A data processing apparatus for receiving and decoding arbitrary data encoded in accordance with a predetermined coding standard and security information of the arbitrary data, the arbitrary data and the security information being transmitted by different sessions.  
     
     
         24 . A data processing system in which a plurality of devices are communicably connected, wherein at least one of said plurality of devices has a function of the data processing apparatus according to  claim 1 .  
     
     
         25 . A data processing system for transmitting multimedia data in accordance with a predetermined coding standard, comprising: 
 at least one first encoding means for encoding media data containing data of at least one of image, video, and audio;    second encoding means for encoding information of a scene constructed of the media data;    third encoding means for encoding attribute information of the media data;    fourth encoding means for encoding security information of the media data;    first forming means for multiplexing all the encoded data obtained by said first to fourth encoding means to form one bitstream;    demultiplexing means for demultiplexing the bitstream obtained by said first forming means into the security information encoded data obtained by said fourth encoding means, and the encoded data obtained by said first to third encoding means;    second forming means for forming the two encoded data obtained by said demultiplexing means into one bitstream again;    link information updating means for updating link information for linking the two encoded data obtained by said demultiplexing means;    transmitting means for transmitting, by first and second different sessions, the two bitstreams obtained by said second forming means;    session control means for setting up two, secure and non-secure sessions for said transmitting means;    third forming means for demultiplexing the encoded data obtained by said first to third encoding means from the bitstream transmitted by the first session by said transmitting means;    fourth forming means for demultiplexing the security information encoded data obtained by said fourth encoding means from the bitstream transmitted by the second session by said transmitting means;    first decoding means for decoding the media data encoded data obtained by said third forming means;    second decoding means for decoding the scene information encoded data obtained by said third forming means to reconstruct the scene;    third decoding means for decoding the media data attribute information encoded data obtained by said third forming means;    fourth decoding means for decoding the security information encoded data obtained by said fourth forming means;    reproducing means for reproducing the data obtained by said first to third decoding means; and    reproduction control means for controlling the reproduction by said reproducing means on the basis of the security information obtained by said fourth decoding means.    
     
     
         26 . The system according to  claim 25 , wherein said first encoding means comprises security adding means for adding security to the media data.  
     
     
         27 . The system according to  claim 25 , wherein the predetermined coding standard is an MPEG- 4  coding standard.  
     
     
         28 . The system according to  claim 27 , wherein the security information is IPMP data.  
     
     
         29 . A data processing method of encoding and transmitting data containing security information in accordance with a predetermined coding standard, comprising: 
 the generation step of generating transmission data from encoded data of object data and encoded data of security information of the object data;    a demultiplexing step of demultiplexing the transmission data obtained in the generation step into security information transmission data and object data transmission data; and    the transmission step of transmitting, by different sessions, the two transmission data obtained in the demultiplexing step.    
     
     
         30 . The method according to  claim 29 , wherein the generation step comprises the security addition step of adding security to the object data.  
     
     
         31 . A data processing method of encoding and transmitting data containing security information in accordance with a predetermined coding standard, comprising the transmission step of transmitting encoded data of object data and encoded data of security information of the object data by different sessions.  
     
     
         32 . The method according to  claim 29 , wherein the predetermined coding standard is an MPEG- 4  coding standard.  
     
     
         33 . The method according to  claim 32 , wherein the security information is IPMP data.  
     
     
         34 . The method according to  claim 29 , further comprising the decoding step of decoding the object data and the security information from the data transmitted by different sessions in the transmission step.  
     
     
         35 . The method according to  claim 29 , wherein the transmission step comprises the steps of: 
 transmitting the object data transmission data by a non-secure session; and    transmitting the security information transmission data by a secure session.    
     
     
         36 . A storage medium storing a computer program for executing the steps according to  claim 29 .  
     
     
         37 . A storage medium storing a computer program for executing the step according to claim  31 .