Methods and system for coordinating uncoordinated content based on multi-modal metadata through data filtration and synchronization in order to generate composite media assets

Abstract

Methods and systems are disclosed herein to address the problems discussed above and in particular to provide coordination for uncoordinated content. Beyond simply archiving and/or organizing available content, the methods and systems generate composite media assets that provide enriched details and supplemental data that extends beyond any given source content. The methods and systems achieve this through a novel data filtration and synchronization process.

What is claimed is: 
     
         1 . A system for coordinating uncoordinated content based on multi-modal metadata through data filtration and synchronization in order to generate composite media assets, the system comprising:
 one or more processors; and   storage circuitry comprising instructions that when executed by the one or more processors causes operations comprising:
 receiving a first user input requesting a composite media asset based on a center-of-mass point for a shared geographic location at a shared time window; 
 determining a shared object orientation based on the center-of-mass point for the shared geographic location; 
 retrieving a first media asset data structure for a first media asset, wherein the first media asset data structure comprises first location information, first time information, and first object information, and wherein:
 the first location information indicates a first geographic location corresponding to the first media asset; 
 the first time information indicates a first time corresponding to the first media asset; and 
 the first object information indicates a first object included with the first media asset; 
 
 retrieving a second media asset data structure for a second media asset, wherein the second media asset data structure comprises second location information, second time information, and second object information, and wherein:
 the second location information indicates a second geographic location corresponding to the first media asset; 
 the second time information indicates a second time corresponding to the second media asset; and 
 the second object information indicates a second object included with the second media asset; 
 
 determining that the first media asset and the second media asset correspond to the shared geographic location based on analyzing the first location information and the second location information; 
 in response to determining that the first media asset and the second media asset correspond to the shared geographic location, determining that the first media asset and the second media asset correspond to the shared time window based on analyzing the first time information and the second time information; 
 in response to determining that the first media asset and the second media asset correspond to the shared time window, determining that the first media asset and the second media asset correspond to a shared object orientation based on analyzing the first object information and the second object information; and 
 in response to determining that the first media asset and the second media asset correspond to the shared object orientation, generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset about the center-of-mass point. 
   
     
     
         2 . A method for coordinating uncoordinated content based on multi-modal metadata through data filtration and synchronization, the method comprising:
 receiving a first user input requesting a composite media asset based on a center-of-mass point for a shared geographic location at a shared time window;   determining a shared object orientation based on the center-of-mass point for the shared geographic location;   retrieving a first media asset data structure for a first media asset, wherein the first media asset data structure comprises first location information, first time information, and first object information;   retrieving a second media asset data structure for a second media asset, wherein the second media asset data structure comprises second location information, second time information, and second object information;   determining that the first media asset and the second media asset correspond to the shared geographic location based on analyzing the first location information and the second location information;   in response to determining that the first media asset and the second media asset correspond to the shared geographic location, determining that the first media asset and the second media asset correspond to the shared time window based on analyzing the first time information and the second time information;   in response to determining that the first media asset and the second media asset correspond to the shared time window, determining that the first media asset and the second media asset correspond to the shared object orientation based on analyzing the first object information and the second object information; and   in response to determining that the first media asset and the second media asset correspond to the shared object orientation, generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset about the center-of-mass point.   
     
     
         3 . The method of  claim 2 , wherein determining that the first media asset and the second media asset correspond to the shared geographic location based on analyzing the first location information and the second location information further comprises:
 receiving a second user input indicating the shared geographic location; and   in response to receiving the second user input indicating the shared geographic location, filtering a plurality of available media assets based on a comparison of respective location information for the plurality of available media assets and the shared geographic location to generate a first subset of media assets.   
     
     
         4 . The method of  claim 3 , wherein determining that the first media asset and the second media asset correspond to the shared time window based on analyzing the first time information and the second time information further comprises:
 receiving a third user input indicating the shared time window; and   in response to receiving the third user input indicating the shared time window, filtering first subset of media assets based on a comparison of respective time information for the first subset of media assets and the shared time window to generate a second subset of media assets.   
     
     
         5 . The method of  claim 2 , wherein determining that the first media asset and the second media asset correspond to the shared object orientation based on analyzing the first object information and the second object information further comprises:
 identifying a known object corresponding to the center-of-mass point;   retrieving a plurality of known object details for the known object at the shared object orientation; and   determining a known object detail of the plurality of known object details is in both the first media asset and the second media asset.   
     
     
         6 . The method of  claim 2 , wherein generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset further comprises:
 identifying a shared object in both the first media asset and the second media asset; and   generating a representation of the shared object in the composite media asset using a first object detail from the first media asset and a second object detail from the second media asset, wherein the second media asset does not comprise the first object detail and the first media asset does not comprise the second object detail.   
     
     
         7 . The method of  claim 2 , wherein:
 the first location information indicates a first geographic location corresponding to the first media asset;   the first time information indicates a first time corresponding to the first media asset; and   the first object information indicates a first object included with the first media asset.   
     
     
         8 . The method of  claim 2 , wherein the first media asset comprises a plurality of frames, and wherein retrieving the first media asset data structure for the first media asset further comprises:
 determining a first frame of the plurality of frames for generating the composite media asset;   determining a subset of the first media asset data structure that corresponds to the first frame; and   retrieving the location information, the first time information, and the first object information from the subset of the first media asset data structure.   
     
     
         9 . The method of  claim 2 , wherein the shared object orientation comprises a direction that a content capture device faced when capturing a respective media asset. 
     
     
         10 . The method of  claim 2 , wherein generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset about the center-of-mass point further comprises:
 identifying a first portion of the first media asset corresponding to an out-of-focus object;   selecting a second portion of the second media asset corresponding to the out-of-focus object in the first media asset; and   replacing the first portion of the first media asset with the second portion.   
     
     
         11 . The method of  claim 2 , wherein receiving the first user input requesting the composite media asset based on the center-of-mass point for the shared geographic location at the shared time window comprises:
 receiving a user selection of an object in the first media asset;   determining a geographic location in which the object is found;   assigning the geographic location as the shared geographic location; and   assigning a position of the object at the geographic location as the center-of-mass point.   
     
     
         12 . A non-transitory, computer-readable medium comprising instructions that when executed by one or more processors cause operations comprising:
 receiving a first user input requesting a composite media asset based on a center-of-mass point for a shared geographic location at a shared time window;   determining a shared object orientation based on the center-of-mass point for the shared geographic location;   retrieving a first media asset data structure for a first media asset, wherein the first media asset data structure comprises first location information, first time information, and first object information;   retrieving a second media asset data structure for a second media asset, wherein the second media asset data structure comprises second location information, second time information, and second object information;   determining that the first media asset and the second media asset correspond to the shared geographic location based on analyzing the first location information and the second location information;   in response to determining that the first media asset and the second media asset correspond to the shared geographic location, determining that the first media asset and the second media asset correspond to the shared time window based on analyzing the first time information and the second time information;   in response to determining that the first media asset and the second media asset correspond to the shared time window, determining that the first media asset and the second media asset correspond to the shared object orientation based on analyzing the first object information and the second object information; and   in response to determining that the first media asset and the second media asset correspond to the shared object orientation, generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset about the center-of-mass point.   
     
     
         13 . The non-transitory, computer-readable medium of  claim 12 , wherein determining that the first media asset and the second media asset correspond to the shared geographic location based on analyzing the first location information and the second location information further comprises:
 receiving a second user input indicating the shared geographic location; and   in response to receiving the second user input indicating the shared geographic location, filtering a plurality of available media assets based on a comparison of respective location information for the plurality of available media assets and the shared geographic location to generate a first subset of media assets.   
     
     
         14 . The non-transitory, computer-readable medium of  claim 13 , wherein determining that the first media asset and the second media asset correspond to the shared time window based on analyzing the first time information and the second time information further comprises:
 receiving a third user input indicating the shared time window; and   in response to receiving the third user input indicating the shared time window, filtering first subset of media assets based on a comparison of respective time information for the first subset of media assets and the shared time window to generate a second subset of media assets.   
     
     
         15 . The non-transitory, computer-readable medium of  claim 12 , wherein determining that the first media asset and the second media asset correspond to the shared object orientation based on analyzing the first object information and the second object information further comprises:
 identifying a known object corresponding to the center-of-mass point;   retrieving a plurality of known object details for the known object at the shared object orientation; and   determining a known object detail of the plurality of known object details is in both the first media asset and the second media asset.   
     
     
         16 . The non-transitory, computer-readable medium of  claim 12 , wherein generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset further comprises:
 identifying a shared object in both the first media asset and the second media asset;   generating a representation of the shared object in the composite media asset using a first object detail from the first media asset and a second object detail from the second media asset, wherein the second media asset does not comprise the first object detail and the first media asset does not comprise the second object detail.   
     
     
         17 . The non-transitory, computer-readable medium of  claim 12 , wherein:
 the first location information indicates a first geographic location corresponding to the first media asset;   the first time information indicates a first time corresponding to the first media asset; and   the first object information indicates a first object included with the first media asset.   
     
     
         18 . The non-transitory, computer-readable medium of  claim 12 , wherein the first media asset comprises a plurality of frames, and wherein retrieving the first media asset data structure for the first media asset further comprises:
 determining a first frame of the plurality of frames for generating the composite media asset;   determining a subset of the first media asset data structure that corresponds to the first frame; and   retrieving the location information, the first time information, and the first object information from the subset of the first media asset data structure.   
     
     
         19 . The non-transitory, computer-readable medium of  claim 12 , wherein the shared object orientation comprises a direction that a content capture device faced when capturing a respective media asset. 
     
     
         20 . The non-transitory, computer-readable medium of  claim 12 , wherein generating the composite media asset based on the first media asset and the second media asset by merging the first media asset and the second media asset about the center-of-mass point further comprises:
 identifying a first portion of the first media asset corresponding to an out-of-focus object;   selecting a second portion of the second media asset corresponding to the out-of-focus object in the first media asset; and   replacing the first portion of the first media asset with the second portion.