Seamless augmented user-generated content for broadcast media

Abstract

The disclosed technology can seamlessly integrate consumers into a broadcaster's products and may seamlessly add broadcaster products to their consumer's social sharing. This technology allows broadcasters to define rules for filtering and modifying myriad user-generated content to be suitable for seamless integration in broadcast media. A broadcaster interface allows the broadcaster to select user-generated content in real-time for use within the broadcast presentation. The technology can accomplish this by receiving multiple pieces of user-generated content; curating the user-generated content with ratings, categorizations, or tags; verifying suitability of the user-generated content for broadcast media; and applying broadcaster-defined rules to modify eligible pieces of user-generated content into a form suitable for inclusion in broadcast media.

We claim: 
     
         1 . A method for transforming user-generated content for incorporation into broadcast media, the method comprising:
 receiving one or more pieces of user-generated content;   determining a substance of a portion of the broadcast media;   combining the broadcast media with the one or more pieces of user-generated content such that:
 the one or more pieces of user-generated content is transformed to match the determined substance; 
 wherein a combination of the portion of the broadcast media and the transformed one or more pieces of user-generated content are displayed in the broadcast media at the same time; and 
   interacting with a broadcast system to provide the transformed one or more pieces of user-generated content,
 wherein at least some of the provided user-generated content is incorporated into a broadcast presentation. 
   
     
     
         2 . The method of  claim 1 , wherein transforming the one or more pieces of user-generated content to match the determined substance comprises:
 automatically detecting features comprising one or more of:
 particular points or features in a face depicted in the one or more pieces of user-generated content; 
 a skeletal representation of a human form, the human form depicted in the one or more pieces of user-generated content, 
 a corporate logo depicted in the one or more pieces of user-generated content; or 
 any combination thereof; and 
   modifying the one or more pieces of user-generated content, based on the features, to match the determined substance of the portion of the broadcast media.   
     
     
         3 . The method of  claim 1  further comprising curating the one or more pieces of user-generated content to apply one or more ratings, categorizations, or tags to the one or more pieces of user-generated content. 
     
     
         4 . The method of  claim 3 ,
 wherein curating the one or more pieces of user-generated content comprises obtaining analytics, for at least two pieces of the one or more pieces of user-generated content, specifying a level of interaction with the at least two pieces of user-generated content in one or more social media systems; and   wherein only a first of the at least two pieces of user-generated content is selected, for inclusion in the broadcast media, based on the analytics for the first piece of user-generated content being above a threshold or being greater than the analytics for the others of the at least two pieces of user-generated content.   
     
     
         5 . The method of  claim 1  further comprising verifying whether each piece of the one or more pieces of user-generated content satisfies requirements for the broadcast media. 
     
     
         6 . The method of  claim 5 , wherein the verifying comprises filtering out, from the one or more pieces of user-generated content, content identified to have objectional material identified by applying one or more machine learning models trained to identify one or more of adult material, offensive material, specified products, or specified logos. 
     
     
         7 . The method of  claim 5 ,
 wherein the verifying comprises applying a multi-stage filtering process to each of the one or more pieces of user-generated content; and   associating, with each of the one or more pieces of user-generated content, moderation status metadata specifying:
 a result of one or more of the multiple stages, 
 an entity that specified the result, and 
 one or more reasons for the entity reaching the result. 
   
     
     
         8 . The method of  claim 1 , wherein the transforming of the one or more pieces of user-generated content to match the determined substance is performed by applying at least one effect comprising one or more of:
 repositioning at least a portion of the one or more pieces of user-generated content;   scaling at least a portion of the one or more pieces of user-generated content;   color shifting at least a portion of the one or more pieces of user-generated content;   warping pixels within a region of the one or more pieces of user-generated content;   applying a beauty filter to at least a portion of the one or more pieces of user-generated content;   manipulating text in at least a portion of the one or more pieces of user-generated content; or   any combination thereof.   
     
     
         9 . The method of  claim 1 ,
 wherein the broadcast presentation was begun prior to generation of at least some of the one or more pieces of user-generated content;   wherein the broadcast presentation includes a URL or QR code for submitting user-generated content; and   wherein the receiving at least some of the one or more pieces of user-generated content is accomplished as a result of users using the URL or QR code.   
     
     
         10 . The method of  claim 1 ,
 wherein the one or more pieces of user-generated content each comprise one or more of video, audio, an image, or any combination thereof;   wherein the combination of the portion of the broadcast media and the transformed one or more pieces of user-generated content comprises video; and   wherein the broadcast presentation is a television presentation.   
     
     
         11 . The method of  claim 1  further comprising providing, to a device that provided a particular piece of user-generated content, a link to the combination, wherein the link is configured for inclusion in a social media system such that the link permits the combination to be viewed through the social media system. 
     
     
         12 . The method of  claim 1 , wherein the user-generated content comprises one or more of: video, audio, a photo, artwork, a comment, a message, a tag of one or more words or phrases, or any combination thereof. 
     
     
         13 . The method of  claim 1 , wherein the broadcast system is operated by one or more of: a company that streams media online, a television company, a radio company, a satellite company, a podcast service, a film studio, an advertising company, a movie theatre, a concert venue, or any combination thereof. 
     
     
         14 . The method of  claim 1 , wherein the broadcast media comprises one or more of: live media, near real-time media, pre-recorded programming, or any combination thereof. 
     
     
         15 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform operations for transforming user-generated content for inclusion with broadcast media, the operations comprising:
 receiving one or more pieces of user-generated content;   applying one or more pipelines or expressions, each pipeline or expression comprising one or more rules to modify at least one of the one or more pieces of user-generated content,
 wherein the modification transforms the at least one of the one or more pieces of user-generated content into a form suitable for inclusion in broadcast media; and 
   providing, to a device that provided a particular piece of user-generated content, a link to the modified version of a particular piece of user-generated content,
 wherein the link is suitable for inclusion in a social media system such that the link permits the modified version of the particular piece of user-generated content to be viewed through the social media system. 
   
     
     
         16 . The non-transitory computer-readable storage medium of  claim 15 ,
 wherein at least one of the one or more rules specifies one or more media items to incorporate into user-generated content such that the modification, when applying the at least one of the one or more rules, generates a video that shows the one or more media items in association with the user-generated content; and   wherein the one or more media items comprise one or more of: an intro video, an outro video, a video overlay, a video underlay, or a product image.   
     
     
         17 . The non-transitory computer-readable storage medium of  claim 15 , wherein at least one of the one or more rules specifies one or more media items to incorporate into user-generated content such that the modification, when applying the at least one of the one or more rules, generates a video that shows the one or more media items in association with the user-generated content. 
     
     
         18 . The non-transitory computer-readable storage medium of  claim 15 ,
 wherein at least a first of the one or more rules was specified by a consumer that supplied a piece of the one or more pieces of user-generated content; and   wherein at least a second of the one or more rules was specified by a broadcast system in control of the broadcast media.   
     
     
         19 . The non-transitory computer-readable storage medium of  claim 15 , wherein at least one rule, of the one or more rules, varies the modification of the at least one of the one or more pieces of user-generated content based on one or more of:
 time of day the at least one rule is applied,   a geo-location associated with the one or more pieces of user-generated content,   a social affinity identified for a user who submitted the one or more pieces of user-generated content, or   any combination thereof.   
     
     
         20 . The non-transitory computer-readable storage medium of  claim 15 , wherein the applying the one or more pipelines or expressions comprises selecting the one or more pipelines or expressions, from multiple pipelines or expressions, by matching characteristics of the one or more pieces of user-generated content to input parameters of the multiple pipelines or expressions. 
     
     
         21 . The non-transitory computer-readable storage medium of  claim 15 , wherein the user-generated content comprises one or more of: video, audio, a photo, artwork, a comment, a message, a tag of one or more words or phrases, or any combination thereof. 
     
     
         22 . The non-transitory computer-readable storage medium of  claim 15 , wherein operations further comprise interacting with a broadcast system to provide the modified version of the particular piece of user-generated content, and wherein the broadcast system is operated by one or more of: a company that streams media online, a television company, a radio company, a satellite company, a podcast service, a film studio, an advertising company, a movie theatre, a concert venue, or any combination thereof. 
     
     
         23 . The non-transitory computer-readable storage medium of  claim 15 , wherein the broadcast media comprises one or more of: live media, near real-time media, pre-recorded programming, or any combination thereof. 
     
     
         24 . A computing system for transforming user-generated content for incorporation into broadcast media, the computing system comprising:
 one or more processors; and   one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform operations comprising:
 receiving multiple pieces of user-generated content; 
 automatically selecting at least one piece of user-generated content from the multiple pieces of user-generated content,
 wherein the automatic selecting is performed by:
 obtaining analytics, for at least two pieces of the multiple pieces of user-generated content, specifying a level of interaction with the at least two pieces of user-generated content in at least one social media system; 
 wherein only a first of the at least two pieces of user-generated content is one of the selected at least one piece of user-generated content based on the analytics for the first piece of user-generated content; and 
 
 
 interacting with a broadcast system to provide at least one of the selected pieces of user-generated content,
 wherein at least some of the provided user-generated content is incorporated in a broadcast presentation. 
 
   
     
     
         25 . The computing system of  claim 24 , wherein receiving the multiple pieces of user-generated content comprises:
 receiving metadata identifying a third-party location of the multiple pieces of user-generated content; and   retrieving, from the identified third-party location, the multiple pieces of user-generated content.   
     
     
         26 . The computing system of  claim 24 ,
 wherein the analytics specifying a level of interaction with the at least two pieces of user-generated content are based on:
 known likes for one or both of the at least two pieces of user-generated content on the at least one social media system; 
 known favorite indicators for one or both of the at least two pieces of user-generated content on the at least one social media system; 
 known relationships, between users associated with one or both of the at least two pieces of user-generated content, on the at least one social media system; or 
 any combination thereof; 
   wherein selecting at least one piece of user-generated content from the multiple pieces of user-generated content is further based on:
 a geographical location associated with submission of the multiple pieces of user-generated content; 
 a local time of day associated with the submission of the multiple pieces of user-generated content; or 
 any combination thereof. 
   
     
     
         27 . The computing system of  claim 24 , wherein the user-generated content comprises one or more of: video, audio, a photo, artwork, a comment, a message, a tag of one or more words or phrases, or any combination thereof. 
     
     
         28 . The computing system of  claim 24 , wherein the broadcast system is operated by one or more of: a company that streams media online, a television company, a radio company, a satellite company, a podcast service, a film studio, an advertising company, a movie theatre, a concert venue, or any combination thereof. 
     
     
         29 . The computing system of  claim 24 , wherein the broadcast media comprises one or more of: live media, near real-time media, pre-recorded programming, or any combination thereof.