System and process for searching a network

Abstract

A system for searching a network for network based content related to a search query, such as multimedia and streaming media, includes an adapter for formatting the search query, a first database containing previous search results and a second database for storing currently returnable metadata, a search processor, and at least one search engine kernel comprising a search engine inherent database. The search engine coordinates searching of the first database and the second database, and provides the formatted search query to the search engine kernel. The search processor also provides and receives search results to and from the first database and the second database, and provides search results to the adapter. The system stores a predetermined amount of previous search results in the first database, such that search results for a current search are retrieved from the database, avoiding a search through search engine kernel comprising searchable metadata.

1 . A method in a computer system for searching a network for network based content related to a search query, said computer system comprising a tangible media and a processor, said method comprising the steps of: 
 receiving said search query;    formatting said search query;    searching a first database for network based content related to said search query, said first database comprising previous search results;    if no network based content related to said search query is found in said database, 
 providing said formatted search query to at least one search engine;  
 receiving network based content related to said search query from a search engine; and  
 updating said first database with the network based content related to said search query received from the search engine;  
   retrieving search results related to said search query from said first database; and    merging said search results related to said search query from said first database with related returnable metadata from a second database, said second database comprising returnable metadata related to said previous search results generated from searchable metadata.    
     
     
         2 . The method of  claim 1 , further comprising the step of updating a history file comprising search results.  
     
     
         3 . The method of  claim 1 , wherein said step of formatting said search query comprises formatting said search query to a format compatible with said at least one search engine.  
     
     
         4 . The method of  claim 1 , further comprising the step of updating said first database to comprise most recent search results, wherein: 
 said most recent search results replace least recent search results; and    search results residing in said first database for at least a predetermined amount of time are removed from said first database.    
     
     
         5 . The method of  claim 1 , wherein said step of formatting said merged search results comprises formatting said merged search results to one of a user provided format and requested format.  
     
     
         6 . The method of  claim 1 , wherein said search query comprises at least one of multimedia and streaming media.  
     
     
         7 . A system for searching a network for network based content related to a search query, said system comprising: 
 a processor;    an adapter for formatting said search query;    a first database comprising search results from previous search queries;    a second database comprising returnable metadata related to said search results generated from searchable metadata; and    a search engine for: 
 coordinating searching of said first database;  
 coordinating searching of said second database;  
   if no search results related to said search query are found in said first database, 
 searching at least a third database for results related to said search query; and  
 updating said first database with said results related to said search query from searching said third database; and  
   retrieving search results related to said search query from said first database and said second database.    
     
     
         8 . The system of  claim 7  further comprising a promoter for modifying data collected for use in a future search query.  
     
     
         9 . The system of  claim 8 , wherein said modifying comprises at least one of: optimizing a format of said collected data for supporting said search engine, optimizing a selection of said collected data for supporting said search engine, and producing said collected data for conversion into a displayable format.  
     
     
         10 . The system of  claim 9 , wherein said format of said collected data for supporting said search engine and said displayable format are different.  
     
     
         11 . The system of  claim 7 , further comprising a search persistent database for storing data formatted for use by said search engine and said second database.  
     
     
         12 . The system of  claim 7 , further comprising: 
 a plurality of adapters;    a respective plurality of search engines; and    a load balancer for approximately evenly distributing a processing load among each of said plurality of adapters and said respective search engines.    
     
     
         13 . The system of  claim 7 , wherein communication between said adapter, said search engine, said first database and said second database is in accordance with a system specific application programming interface protocol.  
     
     
         14 . The system of  claim 7 , wherein said search query comprises at least one of multimedia and streaming media.  
     
     
         15 . The system of  claim 7 , wherein said third database comprises said searchable metadata.  
     
     
         16 . The system of  claim 7 , wherein said first database comprises at least one of: a key generated from prior search query corresponding to said metadata in said second database, and a score generated from prior search query corresponding to said metadata in said second database.  
     
     
         17 . The system of  claim 7 , wherein: 
 said search engine returns a subset of data from said search results corresponding to said search query to said adapter for formatting, and    said formatting is for generating a displayed page from a plurality of displayed pages corresponding to said search results corresponding to said search query.    
     
     
         18 . A computer-readable medium having embodied thereon a program for causing a processor to search a network for network based content related to a search query, said computer-readable medium comprising: 
 means for causing said processor to receive said search query;    means for causing said processor to format said search query;    means for causing said processor to search a first database for said network based content related to a search query, said first database comprising previous search results;    if no network based content related to a search query is found in said first database, 
 means for causing said processor to provide said formatted search query to at least one search engine;  
 means for receiving network based content related to said search query from said at least one search engine; and  
 means for updating said first database with said network based content related to said search query received from said at least one search engine;  
   means for causing said processor to retrieve search results related to said search query from said first database; and    means for merging said search results related to said search query from said first database with related returnable metadata from a second database, said second database comprising returnable metadata related to said previous search results generated from searchable metadata.    
     
     
         19 . The computer-readable medium of  claim 18 , further comprising means for causing said processor to update a history file comprising search results.  
     
     
         20 . The computer-readable medium of  claim 18 , wherein said means for causing said processor to format said search query comprises means for causing said processor to format said search query to a format compatible with said at least one search engine.  
     
     
         21 . The computer-readable medium of  claim 18 , further comprising means for causing said processor to update said first database to comprise most recent search results, wherein: 
 said most recent search results replace least recent search results; and    search results residing in said first database for at least a predetermined amount of time are removed from said first database.    
     
     
         22 . The computer-readable medium of  claim 18 , wherein said means for causing said processor to format said merged search results comprises a means for causing said processor to format said merged search results to a user provided format and a requested data format.  
     
     
         23 . A program readable medium of  claim 18 , wherein said means merges said retrieved search results from a plurality of search engines.  
     
     
         24 . The computer-readable medium of  claim 18 , wherein said search query comprises at least one of multimedia and streaming media.  
     
     
         25 . One or more generated data signals collectively conveying a data structure, the data structure comprising: 
 a receive search query code segment for receiving a search query for searching a network for network based content related to said search query;    a format search query code segment for formatting said search query;    a search first database code segment for searching a first database for said network based content related to a search query, said first database comprising previous search results;    if no network based content related to a search query is found in said first database, 
 a provide formatted search query code segment for providing said formatted search query to at least one search engine;  
 a receive network based content code segment for receiving network based content related to said search query from said at least one search engine; and  
 an update said first database code segment for updating said first database with said network based content related to said search query received from said at least one search engine;  
   a retrieve search results code segment for retrieving search results related to said search query from said first database; and    a merge search results code segment for merging said search results related to said search query from said first database with related returnable metadata from a second database, said second database comprising returnable metadata related to said previous search results generated from searchable metadata.    
     
     
         26 . The data signals of  claim 25 , further comprising an update history file code segment for updating a history file comprising search results.  
     
     
         27 . The data signals of  claim 25 , wherein formatting said search query comprises formatting said search query to a format compatible with said at least one search engine.  
     
     
         28 . The data signals of  claim 25 , wherein said update said first database code segment further updates said first database to comprise most recent search results, wherein: 
 said most recent search results replace least recent search results; and    search results residing in said first database for at least a predetermined amount of time are removed from said first database.    
     
     
         29 . The data signals of  claim 28 , wherein said updating of said first database adds recent search results from a plurality of search engines when said search query is located in said first database.  
     
     
         30 . The data signals of  claim 28 , further comprising a format retrieved search results code segment for formatting said merged search results related to said search query from said first database and said returnable metadata from said second database.