Analyzing captured sound and seeking a match for temporal and geographic presentation and navigation of linked cultural, artistic and historic content

Abstract

The system and method described here relate to the effective organization of a media database. The media database can include music and can bring together time, place, genre, and artist with curator and community commentary and recommendations, cultural events and elements, media content, and a facility for procurement of related materials. The consistent focus of these fundamental elements of music and principles of organization provides a unique user experience that is a key aspect of the current invention. The user can interact with the media database using voice commands.

1 . A computer-implemented method comprising:
 registering a collection of music and music-related information in a database and making the collection of music and the music-related information available to users, wherein the collection of music and the music-related information are classified in the database by time, location, genre and artist; and   generating a navigation facility for a user selection of a combination of the time, the location, the genre, and the artist in connection with the collection of music and the music-related information, wherein the navigation facility comprises an audio interface; and   presenting to a user, in response to the user selection, at least one visual representation depicting the time, the location, the genre and the artist, in connection with the music-related information.   
     
     
         2 . The method of  claim 1 , comprising:
 determining a mode of operation of a dual-mode system, wherein a first mode of the dual-mode system comprises receiving an audio extrinsic to the dual-mode system as an input to the dual-mode system, and a second mode of the dual-mode system comprises receiving an audio emitted by the dual-mode system as the input to the dual-mode system;   upon determining that the mode of operation is the second mode, receiving the audio emitted by the dual-mode system as the input to the dual-mode system;   identifying in the database a plurality of elements providing additional information about the received audio, the plurality of elements including the time, the location, the genre, or the artist; and   providing a visual representation of the plurality of elements.   
     
     
         3 . The method of  claim 2 , comprising:
 upon determining that the mode of operation is the first mode, receiving the audio extrinsic to the dual-mode system as the input;   identifying whether the input is a command or a search query;   selectively performing the command or identifying in the database the plurality of elements providing additional information about the audio extrinsic to the dual-mode system; and   upon said identifying, generating the visual representation of the plurality of elements.   
     
     
         4 . The method of  claim 2 , said determining comprising:
 determining whether the audio emitted by the dual-mode system is represented within the database associated with the dual-mode system; and   when the audio emitted by the dual-mode system is not represented within the database, determining to operate in the second mode.   
     
     
         5 . The method of  claim 2 , said determining comprising:
 determining whether the audio emitted by the dual-mode system is represented within the database associated with the dual-mode system;   when the audio emitted by the dual-mode system is represented within the database, determining whether the database contains one or more elements associated with the audio; and   when the database does not contain an element associated with the audio, determining to operate in the second mode.   
     
     
         6 . The method of  claim 2 , said determining comprising:
 determining whether the audio emitted by the dual-mode system is represented within the database associated with the dual-mode system;   when the audio emitted by the dual-mode system is represented within the database, determining whether the database contains one or more elements associated with the audio; and   comparing the one or more elements to a criterion, and, based on the comparison, determining to operate in the second mode.   
     
     
         7 . The method of  claim 6 , the criterion comprising a threshold number of elements, or a threshold number of elements associated with a category. 
     
     
         8 . The method of  claim 1 , comprising:
 receiving an audio input;   converting the audio input to text to obtain an audio with subtitles;   based on the audio with subtitles, finding the collection of music or the music-related information stored in the database and relating to the audio with subtitles; and   presenting the collection of music or the music-related information to the user.   
     
     
         9 . The method of  claim 8 , wherein the audio input comprises a podcast. 
     
     
         10 . The method of  claim 1 , comprising:
 receiving an audio input; and   interpreting the audio input using a phoneme pronunciation stored in the database and a context.   
     
     
         11 . The method of  claim 1 , comprising:
 receiving an audio input comprising music;   identifying an element in the database related to the audio input; and   presenting an animated visual representation of the element to the user.   
     
     
         12 . The method of  claim 1 , said presenting to the user at least one animated visual representation comprising:
 ranking information presented to the user comprising the time, the location, the genre and the artist, based on an importance provided by a curator, a popularity of the information presented to the user, or a user profile; and   animating a visual representation based on said ranking.   
     
     
         13 . A system comprising:
 at least one hardware processor; and   at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:
 register a collection of music and music-related information in a database and making the collection of music and the music-related information available to users, wherein the collection of music and the music-related information are classified in the database by time, location, genre and artist; 
 generate a navigation facility for a user selection of a combination of the time, the location, the genre, and the artist in connection with the collection of music and the music-related information, wherein the navigation facility comprises an audio interface; and 
 present to a user, in response to the user selection, at least one visual representation depicting the time, the location, the genre and the artist, in connection with the music-related information. 
   
     
     
         14 . The system of  claim 13 , comprising the instructions to:
 determine a mode of operation of a dual-mode system, wherein a first mode of the dual-mode system comprises receiving an audio extrinsic to the dual-mode system as an input to the dual-mode system, and a second mode of the dual-mode system comprises receiving an audio emitted by the dual-mode system as the input to the dual-mode system;   upon determining that the mode of operation is the second mode, receive the audio emitted by the dual-mode system as the input to the dual-mode system;   identify in the database a plurality of elements providing additional information about the received audio, the plurality of elements including the time, the location, the genre, or the artist; and   provide a visual representation of the plurality of elements.   
     
     
         15 . The system of  claim 14 , comprising the instructions to:
 upon determining that the mode of operation is the first mode, receive the audio extrinsic to the dual-mode system as the input;   identify whether the input is a command or a search query;   selectively perform the command or identifying in the database the plurality of elements providing additional information about the audio extrinsic to the dual-mode system; and   upon said identifying, generate the visual representation of the plurality of elements.   
     
     
         16 . The system of  claim 14 , the instructions to determine comprising the instructions to:
 determine whether the audio emitted by the dual-mode system is represented within the database associated with the dual-mode system; and   when the audio emitted by the dual-mode system is not represented within the database, determine to operate in the second mode.   
     
     
         17 . The system of  claim 14 , the instructions to determine comprising the instructions to:
 determining whether the audio emitted by the dual-mode system is represented within the database associated with the dual-mode system;   when the audio emitted by the dual-mode system is represented within the database, determining whether the database contains one or more elements associated with the audio; and   when the database does not contain an element associated with the audio, determining to operate in the second mode.   
     
     
         18 . The system of  claim 14 , the instructions to determine comprising the instructions to:
 determining whether the audio emitted by the dual-mode system is represented within the database associated with the dual-mode system;   when the audio emitted by the dual-mode system is represented within the database, determining whether the database contains one or more elements associated with the audio; and   comparing the one or more elements to a criterion, and, based on the comparison, determining to operate in the second mode.   
     
     
         19 . The system of  claim 13 , comprising the instructions to:
 receive an audio input;   convert the audio input to text to obtain an audio with subtitles;   based on the audio with subtitles, find the collection of music or the music-related information stored in the database and relating to the audio with subtitles; and   present the collection of music or the music-related information to the user.   
     
     
         20 . The system of  claim 13 , comprising the instructions to:
 receive an audio input; and   interpret the audio input using a phoneme pronunciation stored in the database and a context.