Video importance rating based on compressed domain video features

Abstract

Systems and methods are provided for identifying important video frames and segments in multimedia content such as a segmented compressed domain video. Video frames in a segment are analyzed to determine intensity, contrast, and motion values for the frames and their segments. The values among frames and segments are compared to identify one or more video segments likely to be important to a viewer. The systems and methods may additionally be augmented with audio data other characteristics associated with the video frames and segments analyzed.

1 . A method comprising:
 receiving, at a mobile terminal, a segmented video sequence;   extracting, at a mobile terminal, video frames from the segmented video sequence;   computing, at a mobile terminal, a frame relevance rating based on the video frames extracted from the segmented video sequence;   determining, at the mobile terminal, a segment relevance rating by aggregating the frame relevance rating for each video segment;   determining, at the mobile terminal, important video segments by comparing the segment relevance ratings; and   displaying the important video segments.   
     
     
         2 . The method according to  claim 1 , wherein the segmented video sequence is at least one of a previously-recorded television broadcast, a home video, recorded footage from a security camera, and any other multimedia content. 
     
     
         3 . The method according to  claim 1 , wherein the frame relevance rating is at least one of summed, averaged, and analyzed for various metrics. 
     
     
         4 . The method according to  claim 1 , further comprising cleaning the video sequence based on the important video segments. 
     
     
         5 . The method according to  claim 1 , further comprising creating a preview of the video for display. 
     
     
         6 . A mobile terminal comprising:
 a processor;   a memory coupled to the processor, the processor configured to:
 receive a segmented video sequence; 
 extract video frames from the segmented video sequence; 
 compute a frame relevance rating based on the video frames extracted from the segmented video sequence; 
 determine a segment relevance rating by aggregating the frame relevance rating for each video segment; 
 determine important video segments by comparing the segment relevance ratings; and 
 display the important video segments. 
   
     
     
         7 . The mobile terminal according to  claim 6 , wherein the segmented video sequence is at least one of a previously-recorded television broadcast, a home video, recorded footage from a security camera, and any other multimedia content. 
     
     
         8 . The mobile terminal according to  claim 6 , wherein the frame relevance rating is at least one of summed, averaged, and analyzed for various metrics. 
     
     
         9 . The mobile terminal according to  claim 6 , wherein the processor is further configured to clean the video sequence based on the important video segments. 
     
     
         10 . The mobile terminal according to  claim 6 , wherein the processor is further configured to create a preview of the video for display.