US10872116B1ActiveUtility

Systems, devices, and methods for contextualizing media

86
Assignee: TIMECODE ARCHIVE CORPPriority: Sep 24, 2019Filed: Sep 24, 2019Granted: Dec 22, 2020
Est. expirySep 24, 2039(~13.2 yrs left)· nominal 20-yr term from priority
Inventors:Ji YimBaik Hoh
G06F 16/639G06F 16/635G06F 3/165G06F 40/35G06F 40/30G06F 16/61G06F 16/65G06F 3/0484
86
PatentIndex Score
19
Cited by
22
References
30
Claims

Abstract

Disclosed herein are systems, devices, and methods for contextualizing media. In some variations, a method of organizing audio may comprise generating first graph data nodes from structured text data comprising a predetermined audio data model and generating second graph data nodes from unstructured data. The first and second graph data nodes may be associated with the audio. The one or more first graph data nodes may be linked to the one or more corresponding second graph data nodes using a natural language processing model.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. A method of organizing audio, comprising:
 generating first graph data nodes from structured text data comprising a predetermined audio data model; 
 processing unstructured data using a natural language processing (NLP) model to generate second graph data nodes, wherein the first and second graph data nodes are associated with the audio; and 
 linking the one or more first graph data nodes to the one or more corresponding second graph data nodes using the NLP model. 
 
     
     
       2. The method of  claim 1 , further comprising:
 processing the second graph data nodes using the NLP model to determine one or more relationships between the first and second graph data nodes, wherein linking is based on the one or more relationships. 
 
     
     
       3. The method of  claim 2 , further comprising:
 processing the second graph data nodes using the NLP model to generate a plurality of keywords; 
 associating the plurality of keywords with a respective word vector; and 
 calculating a similarity between the second graph data nodes based on a similarity between each of the word vectors. 
 
     
     
       4. The method of  claim 1 , wherein the unstructured data comprises image data. 
     
     
       5. The method of  claim 1 , further comprising:
 computing similarity between the second graph data nodes; 
 linking the second graph data nodes based on the similarity; and 
 generating a narrative associated with the audio based at least on the similarity. 
 
     
     
       6. A method of providing an audio program, comprising:
 playing one or more songs of the audio program; 
 providing a narrative comprising one or more sentences of unstructured data associated with one or more of the songs of the audio program in response to the one or more songs being played; 
 sequentially accompanying one or more of the songs being played with the narrative spoken by a virtual host, wherein providing the narrative is based at least on user activity and preferences; 
 receiving the user activity using a conversation simulator on a computing device; and 
 outputting one or more of the narrative using a natural language generation model and a suggested song using the conversation simulator in response to the user activity. 
 
     
     
       7. The method of  claim 6 , wherein the virtual host comprises a set of configurable voice characteristics. 
     
     
       8. The method of  claim 6 , wherein the virtual host comprises a plurality of voices. 
     
     
       9. The method of  claim 6 , wherein the narrative comprises one or more of a response to user activity, music, news, traffic, weather, events, and advertisements. 
     
     
       10. The method of  claim 6 , wherein the user activity comprises one or more of time and user geolocation. 
     
     
       11. The method of  claim 6 , wherein the narrative comprises an image displayed on a user interface. 
     
     
       12. The method of  claim 6 , wherein the conversation simulator comprises a natural language processing model and the natural language generation model. 
     
     
       13. The method of  claim 6 , further comprising providing a chatroom comprising a plurality of users simultaneously playing one or more of the songs and the narrative. 
     
     
       14. The method of  claim 6 , further comprising providing a graphical user interface for independent playback selection of one or more of the songs and the narrative comprising unstructured data to a playlist. 
     
     
       15. The method of  claim 6 , further comprising generating a shared playlist for a plurality of users, the shared playlist comprising the narrative and the song. 
     
     
       16. The method of  claim 15 , wherein the shared playlist is based on one or more of physical proximity of at least two users and online activity. 
     
     
       17. The method of  claim 6 , further comprising:
 generating the narrative from graph data; and 
 updating the graph data based on crowd-sourced input. 
 
     
     
       18. A method of displaying a graphical user interface for a virtual radio, comprising:
 displaying a graphical representation of a media player and search interface on a display; 
 processing user input to the search interface; and 
 displaying a narrative associated with a song being played by the media player in response to the user input, the narrative comprising one or more sentences generated from unstructured graph data. 
 
     
     
       19. The method of  claim 18 , further comprising displaying a graphical representation of a chatroom for a plurality of users simultaneously playing the song. 
     
     
       20. The method of  claim 18 , further comprising displaying a graphical representation of a playlist editor for independent playback selection of the song and the narrative in a playlist. 
     
     
       21. The method of  claim 18 , wherein the narrative comprises a first narrative, and the method further comprises displaying a graphical representation of a second narrative related to the first narrative. 
     
     
       22. The method of  claim 18 , further comprising displaying a graphical representation of a suggested song based on the narrative. 
     
     
       23. A method of providing an audio program, comprising:
 playing one or more songs of the audio program; 
 providing a narrative comprising one or more sentences of unstructured data associated with one or more of the songs of the audio program in response to the one or more songs being played; 
 sequentially accompanying one or more of the songs being played with the narrative spoken by a virtual host 
 generating graph data associated with the one or more songs based on the user activity of a plurality of users in response to playing the audio program and the narrative in a chatroom; and 
 processing the graph data using a natural language processing model. 
 
     
     
       24. The method of  claim 23 , wherein the virtual host comprises a set of configurable voice characteristics. 
     
     
       25. The method of  claim 23 , wherein the virtual host comprises a plurality of voices. 
     
     
       26. The method of  claim 23 , wherein the narrative comprises one or more of a response to user activity, music, news, traffic, weather, events, and advertisements. 
     
     
       27. The method of  claim 23 , wherein the user activity comprises one or more of time and user geolocation. 
     
     
       28. The method of  claim 23  wherein the narrative comprises an image displayed on a user interface. 
     
     
       29. The method of  claim 23 , wherein the conversation simulator comprises a natural language processing model and the natural language generation model. 
     
     
       30. The method of  claim 23 , further comprising providing a chatroom comprising a plurality of users simultaneously playing one or more of the songs and the narrative.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.