Systems and Methods For Using Video Metadata to Associate Advertisements Therewith

Abstract

A system for using metadata from a video signal to associate advertisements therewith, comprising (i) a segmentation system to divide the video signal into video clips, (ii) a digitizing system for digitizing the video clips, (iii) a feature extraction system for extracting audio and video features from each video clip, associating each audio feature with respective video clips, associating each video feature with respective video clips, and saving the audio and video features into an associated metadata file, (iv) a web interface to the feature extraction system for receiving the video clips, and (v) a database, wherein video signals and associated metadata files are stored and indexed, wherein the associated metadata file is provided when a video player requests the corresponding video signal, enabling selection of a relevant advertisement for presentment in conjunction with respective video clips based on the associated audio and video features of the respective video clip.

1 . A method for using metadata from a video signal to associate advertisements therewith, comprising the steps of:
 (i) segmenting the video signal into a plurality of video clips;   (ii) extracting audio and video features from the plurality of video clips;   (iii) digitizing the plurality of video clips;   (iv) identifying extracted audio features within respective digitized video clips using audio processing, wherein each extracted audio feature is associated with the respective digitized video clip;   (v) identifying extracted video features within respective digitized video clips using visual processing, wherein each extracted video feature is associated with the respective digitized video clip;   (vi) saving the associated audio features and associated video features in a metadata file;   (vii) associating the metadata file with the video signal;   (viii) storing the metadata file in a database; and   (ix) providing the associated metadata file when a video player requests the corresponding video signal,   wherein, the associated metadata file enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.   
     
     
         2 . The method of  claim 1 , wherein the metadata file comprises an XML file. 
     
     
         3 . The method of  claim 1 , wherein the steps of identifying extracted video features and extracted audio features further comprises uploading the digitized video clips to a feature extraction system through a web interface. 
     
     
         4 . The method of  claim 1 , wherein each digitized video clip is specified by a predetermined time frame. 
     
     
         5 . The method of  claim 1 , wherein the video features comprise at least one of:
 (i) one or more people;   (ii) one or more characters;   (iii) one or more animals;   (iv) one or more objects;   (v) one or more geographic locations;   (vi) background; and   (vii) one or more scenes.   
     
     
         6 . The method of  claim 1 , further comprising the steps of:
 (i) identifying and recognizing one or more objects from the video signal by an object classification system of the feature extraction system; and   (ii) identifying and recognizing one or more scenes from the video signal by a scene classification system of the feature extraction system.   
     
     
         7 . The method of  claim 1 , wherein the video signal comprises an accompanying audio signal. 
     
     
         8 . The method of  claim 7 , wherein audio features of the audio signal comprise one or more of:
 (i) a list of one or more words;   (ii) speeches by one or more people;   (iii) dialogue by one or more people;   (iv) music; and   (v) background sound.   
     
     
         9 . The method of  claim 8 , further comprising the steps of:
 (i) identifying and recognizing one or more background sounds from the audio signal by using a sound classification system of the feature extraction system;   (ii) identify and recognizing one or more music segments from the audio signal by using a music classification system of the feature extraction system; and   (iii) identifying and recognizing human speech, dialogues, one or more words, one or more phrases by using a speech recognition system of the feature extraction system.   
     
     
         10 . The method of  claim 9 , further comprising the steps of:
 (i) collecting audio features of the audio signal by using an audio signal recognition system of the feature extraction system; and   (ii) saving the collected audio features in the metadata file.   
     
     
         11 . The method of  claim 10 , wherein the metadata file comprises one or more of:
 (i) video identification information;   (ii) a file name;   (iii) a digital signature;   (iv) the length of the video signal;   (v) a keyword list;   (vi) a time-coded transcript;   (vii) one or more segments with a corresponding start and stop time;   (viii) one or more contents;   (ix) one or more characters;   (x) one or more pets;   (xi) one or more objects; and   (xii) a list of vocabulary.   
     
     
         12 . A system for using metadata from a video signal to associate advertisements therewith, comprising:
 (i) a segmentation system for dividing the video signal into a plurality of video clips;   (ii) a digitizing system for digitizing the plurality of video clips;   (iii) a feature extraction system for extracting audio features and video features from each digitized video clip, associating each audio feature with at least one digitized video clip, associating each video feature with at least one digitized video clip, and saving the audio features and video features into a metadata file associated with the video signal;   (iv) a web interface to the feature extraction system for receiving the digitized video clips; and   (v) a database accessible by a third party user, wherein video signals and associated metadata files are stored and indexed with a unique filename for each video signal in the database and its corresponding video signal,   wherein the associated metadata file is provided when a video player requests the corresponding video signal, and enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.   
     
     
         13 . The system of  claim 12 , wherein the associated metadata file comprises an XML file. 
     
     
         14 . The system of  claim 12 , wherein each digitized video clip is specified by a predetermined time frame. 
     
     
         15 . The system of  claim 12 , wherein the video features comprise at least one of
 (i) one or more people;   (ii) one or more characters;   (iii) one or more animals;   (iv) one or more objects;   (v) one or more geographic locations;   (vi) background; and   (vii) one or more scenes.   
     
     
         16 . The system of  claim 12 , wherein a visual processing system further comprises:
 (i) an object classification system to identify and recognize one or more objects from the video signal; and   (ii) a scene classification system to identify and recognize one or more scenes from the video signal.   
     
     
         17 . The system of  claim 12 , wherein the video signal comprises an accompanying audio signal. 
     
     
         18 . The system of  claim 17 , wherein audio features of the audio signal comprise one or more of:
 (i) a list of one or more words;   (ii) speeches by one or more people;   (iii) dialogue by one or more people;   (iv) music; and   (v) background sound.   
     
     
         19 . The system of  claim 18 , wherein the feature extraction system further comprises:
 (i) an audio signal recognition (ASR) system to identify and recognize the audio features of the video signal; and   (ii) a visual processing system to identify and recognize the video features of the video signal.   
     
     
         20 . The system of  claim 19 , wherein the audio signal recognition system further comprises:
 (i) a sound classification system to identify and recognize one or more background sounds from the audio signal; and   (ii) a music classification system to identify and recognize one or more music segments from the audio signal; and   (iii) a speech recognition system to identify and recognize human speech, dialogues, one or more words, one or more phrases.   
     
     
         21 . The system of  claim 20 , wherein the metadata file comprises one or more of:
 (i) video identification information;   (ii) a file name;   (iii) a digital signature;   (iv) the length of the video signal;   (v) a keyword list;   (vi) a time-coded transcript;   (vii) one or more segments with a corresponding start and stop time;   (viii) one or more contents;   (ix) one or more characters;   (x) one or more pets;   (xi) one or more objects, and   (xii) a list of vocabulary.