Auto-transcription by cross-referencing synchronized media resources

Abstract

A media archive comprising a plurality of media resources associated with events that occurred during a time interval are processed to synchronize the media resources. Sequences of patterns are identified in each media resource of the media archive. Elements of the sequences associated with different media resources are correlated such that a set of correlated elements is associated with the same event that occurred in the given time interval. The synchronization information of the processed media resources is represented in a flexible and extensible data format. The synchronization information is used for correction of errors occurring in the media resources of a media archive, for enhancing processes identifying information in media resources, for example by transcription of audio resources or by optical character recognition of images.

1 . A computer implemented method of converting a media resource in a plurality of media resources to a text representation, the method comprising:
 receiving an audio resource and a media resource associated with events that occurred during a time interval, wherein portions of the audio resource are correlated with portions of the media resource, the correlating comprising:
 identifying a first sequence of pattern in the audio resource and a second sequence of pattern in the media resource; and 
 correlating elements of the first sequence with elements of the second sequence; 
   transcribing a first portion of the audio resource to a text representation;   identifying a second portion of the media resource correlated with the first portion of the first media resource; and   responsive to encountering an unidentifiable part of the first portion of the audio resource, determining a potential text representation for the unidentifiable part based on the second portion of the media resource.   
     
     
         2 . The computer implemented method of  claim 1 , further comprising:
 automatically inserting the potential text representation into the text representation obtained by transcribing the first portion.   
     
     
         3 . The computer implemented method of  claim 1 , further comprising:
 presenting the potential text representation for approval for incorporation into the text representation obtained by transcribing the first portion.   
     
     
         4 . The computer implemented method of  claim 1 , further comprising:
 receiving information indicative of a failure to transcribe the unidentifiable part of the first portion of the audio.   
     
     
         5 . The computer implemented method of  claim 4 , wherein the information indicative of failure to transcribe comprises an error code encountered while transcribing the first portion. 
     
     
         6 . The computer implemented method of  claim 4 , wherein the information indicative of failure to transcribe comprises an erroneous text output obtained by transcribing the unidentifiable part of the first portion. 
     
     
         7 . The computer implemented method of  claim 6 , further comprising:
 matching the erroneous text with text in the second portion of the media resource; and   determining a term with highest match score with the erroneous text as the potential text representation.   
     
     
         8 . The computer implemented method of  claim 1 , wherein the media resource comprises a script of a chat session. 
     
     
         9 . The computer implemented method of  claim 1 , wherein each pair of correlated elements is associated with an event that occurred in the time interval. 
     
     
         10 . The computer implemented method of  claim 1 , wherein the events that occurred during a time interval comprise at least one of a presentation, a screen sharing session, an online collaboration session, and a recorded media event. 
     
     
         11 . The computer implemented method of  claim 1 , wherein the events that occurred during a time interval comprise a slide presentation and each sequence of pattern corresponds to slide flips in the presentation. 
     
     
         12 . The computer implemented method of  claim 1 , wherein the first media resource and the second media resource are obtained from a media archive. 
     
     
         13 . A computer implemented method of converting a media resource in a plurality of media resources to a text representation, the method comprising:
 receiving a first media resource and a second media resource associated with events that occurred during a time interval, wherein portions of the first media resource are correlated with portions of the second media resource, the correlating comprising:
 identifying a first sequence of pattern in the first media resource and a second sequence of pattern in the second media resource; and 
 correlating elements of the first sequence with elements of the second sequence; 
   converting a first portion of the first media resource represented in a media format to a representation in text format;   identifying a second portion of the second media resource correlated with the first portion of the first media resource; and   responsive to encountering an unidentifiable part of the first portion of the first media resource, determining a potential text representation for the unidentifiable part based on the second portion of the second media resource.   
     
     
         14 . The computer implemented method of  claim 13 , further comprising:
 automatically inserting the potential text representation into the text representation obtained by transcribing the first portion.   
     
     
         15 . The computer implemented method of  claim 13 , wherein the media format of the first media resource comprises an image and the converting comprises optical character recognition. 
     
     
         16 . The computer implemented method of  claim 13 , wherein the media format of the first media resource comprises an image and the converting comprises object recognition. 
     
     
         17 . The computer implemented method of  claim 13 , wherein the media format of the first media resource comprises an image and the converting comprises facial recognition. 
     
     
         18 . A computer program product having a computer-readable storage medium storing computer-executable code for converting a media resource in a plurality of media resources to a text representation, the code comprising:
 a universal media convertor module configured to:
 receive a first media resource and a second media resource associated with events that occurred during a time interval, wherein portions of the first media resource are correlated with portions of the second media resource, the correlating comprising:
 identifying a first sequence of pattern in the first media resource and a second sequence of pattern in the second media resource; and 
 correlating elements of the first sequence with elements of the second sequence; 
 
   convert a first portion of the first media resource represented in a media format to a representation in text format;   identify a second portion of the second media resource correlated with the first portion of the first media resource; and   responsive to encountering an unidentifiable part of the first portion of the first media resource, determine a potential text representation for the unidentifiable part based on the second portion of the second media resource.   
     
     
         19 . The computer program product of  claim 18 , wherein the universal media convertor module is further configured to:
 automatically inserting the potential text representation into the text representation obtained by transcribing the first portion.   
     
     
         20 . The computer implemented method of  claim 18 , wherein the media format of the first media resource comprises an image and the converting comprises object recognition.