System and method for annotating multi-modal characteristics in multimedia documents

Abstract

A manual annotation system of multi-modal characteristics in multimedia files. There is provided an arrangement for selection an observation modality of video with audio, video without audio, audio with video, or audio without video, to be used to annotate multimedia content. While annotating video or audio features in isolation results in less confidence in the identification of the features, observing both audio and video simultaneously and annotating that observation results in a higher confidence level.

What is claimed is:  
     
         1 . An apparatus for managing multimedia content, said apparatus comprising: 
 an arrangement for supplying multimedia content;    an input interface for permitting the selection, for observation, of at least one of the following modes associated with the multimedia content: an audio portion that includes video; and a video portion that includes audio; and    an arrangement for annotating observations of a selected mode.    
     
     
         2 . The apparatus according to  claim 1 , wherein said input interface permits the selection, for observation, of both of the following associated with the multimedia content: an audio portion that includes video; and a video portion that includes audio.  
     
     
         3 . The apparatus according to  claim 1 , wherein said input interface additionally permits the selection, for observation, of solely a video portion of multimedia content.  
     
     
         4 . The apparatus according to  claim 1 , wherein said input interface additionally permits the selection, for observation, of solely an audio portion of multimedia content.  
     
     
         5 . The apparatus according to  claim 1 , wherein said arrangement for supplying multimedia content comprises a working memory which stores multimedia files.  
     
     
         6 . The apparatus according to  claim 1 , wherein said input interface is adapted to: first permit the selection of a multimedia file and then permit the selection of said at least one of: an audio portion simultaneously with video; and a video portion simultaneously with audio.  
     
     
         7 . The apparatus according to  claim 1 , further comprising a working memory for saving the annotated observations of a selected mode.  
     
     
         8 . The apparatus according to  claim 1 , wherein said input interface is adapted to permit the selection, for observation, at least the following mode associated with the multimedia content: a video portion that includes audio.  
     
     
         9 . The apparatus according to  claim 8 , wherein said input interface comprises: 
 an arrangement for permitting the selection, for observation, of a video mode of multimedia content; and    an arrangement for selectably adding audio to the video mode for observation.    
     
     
         10 . A method of managing multimedia content, said method comprising the steps of: 
 supplying multimedia content;    permitting the selection, for observation, of at least one of the following modes associated with the multimedia content: an audio portion that includes video; and a video portion that includes audio; and    annotating observations of a selected mode.    
     
     
         11 . The method according to  claim 10 , wherein said step of permitting selection comprises permitting the selection, for observation, of both of the following associated with the multimedia content: an audio portion that includes video; and a video portion that includes audio.  
     
     
         12 . The method according to  claim 10 , wherein said step of permitting selection additionally comprises permitting the selection the selection, for observation, of solely a video portion of multimedia content.  
     
     
         13 . The method according to  claim 10 , wherein step of permitting selection comprises permitting the selection, for observation, of solely an audio portion of multimedia content.  
     
     
         14 . The method according to  claim 10 , wherein said step of supplying multimedia content comprises providing a working memory which stores multimedia files.  
     
     
         15 . The method according to  claim 10 , wherein said step of permitting selection comprises: first permitting the selection of a multimedia file and then permitting the selection of said at least one of: an audio portion simultaneously with video; and a video portion simultaneously with audio.  
     
     
         16 . The method according to  claim 10 , further comprising the step of providing a working memory for saving the annotated observations of a selected mode.  
     
     
         17 . The method according to  claim 10 , wherein said step of permitting selection comprises permitting the selection, for observation, at least the following mode associated with the multimedia content: a video portion that includes audio.  
     
     
         18 . The method according to  claim 17 , wherein said step of permitting selection comprises: 
 permitting the selection, for observation, of a video mode of multimedia content; and    thereafter enabling the addition of audio to the video mode for observation.    
     
     
         19 . A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for managing multimedia content, said method comprising the steps of: 
 supplying multimedia content;    permitting the selection, for observation, of at least one of the following modes associated with the multimedia content: an audio portion that includes video; and a video portion that includes audio; and    annotating observations of a selected mode.