Determining searchable criteria of network resources based on commonality of content

Abstract

A method, article of manufacture, apparatus for determining keywords to be used by a search engine. In one embodiment, a list of hyperlinks contained in an electronic document is identified by a searching program. The searching program then accesses the resource content (e.g., HTML) from each resource pointed to by the hyperlinks. The resource content of each resource is examined to determine whether a commonality exists in a manner directed to identifying keywords for each resource. These keywords may then be used by a search engine to return more accurate results to user queries.

1 . A method for determining keywords representative of the content of an electronic document located at a source network address, comprising:
 analyzing a document definition of the electronic document located at the source network address to identify one or more lists of hyperlinks to other electronic documents located at respective target network addresses;   for at least two hyperlinks in at least one identified list of hyperlinks, accessing the respective electronic documents pointed to by the at least two respective hyperlinks;   for each respective electronic document accessed, analyzing the respective document definition of the respective electronic document to determine a set of words representative of the respective electronic document;   comparing each determined set of words to determine whether a commonality exists between the set of words based on some predefined criteria; and   if the commonality exists, making at least a portion of the set of words keywords for the one or more of respective electronic documents defined by the respective document definitions.   
   
   
       2 . The method of  claim 1 , wherein the source network address is a website. 
   
   
       3 . The method of  claim 1 , wherein making at least a portion of the set of words keywords is conditioned on first establishing that the number of the hyperlinks in the at least one identified list is greater than a predefined threshold number. 
   
   
       4 . The method of  claim 1 , wherein making at least the portion of the set of words keywords comprises making the portion of the set of words keywords for each of the respective electronic documents defined by the respective document definitions. 
   
   
       5 . The method of  claim 1 , wherein determining whether a commonality exists between the set of words comprises determining whether there is a common word set between the set of words; and wherein making at least the portion of the set of words keywords comprises making the words in the common word set keywords, the keywords being defined as words accessed by search engines to determine a relevancy of the respective electronic document for a given keyword search. 
   
   
       6 . The method of  claim 5 , wherein making the words in the common word set keywords comprises making the words in the common word set keywords for each of the respective electronic documents defined by the respective document definitions. 
   
   
       7 . The method of  claim 5 , wherein making the words in the common word set keywords is conditioned on first establishing that the number of the words in the common word set is less than a predefined threshold number. 
   
   
       8 . A computer readable storage medium containing a program which, when executed, performs an operation for determining keywords representative of the content of an electronic document located at a source network address, the operation comprising:
 analyzing a document definition of the electronic document located at the source network address to identify one or more lists of hyperlinks to other electronic documents located at respective target network addresses;   for at least two hyperlinks in at least one identified list of hyperlinks, accessing the respective electronic documents pointed to by the at least two respective hyperlinks;   for each respective electronic document accessed, analyzing the respective document definition of the respective electronic document to determine a set of words representative of the respective electronic document;   comparing each determined set of words to an determine whether a commonality exists between the set of words based on some predefined criteria; and   if the commonality exists, making at least a portion of the set of words keywords for one or more of respective electronic documents defined by the respective document definitions.   
   
   
       9 . The computer readable medium of  claim 8 , wherein the source network address is a website. 
   
   
       10 . The computer readable storage medium of  claim 8 , wherein making at least a portion of the set of words keywords is conditioned on first establishing that the number of the hyperlinks in the at least one identified list is greater than a predefined threshold number. 
   
   
       11 . The computer readable storage medium of  claim 8 , wherein making at least the portion of the set of words keywords comprises making the portion of the set of words keywords for each of the respective electronic documents defined by the respective document definitions. 
   
   
       12 . The computer readable storage medium of  claim 8 , wherein determining whether a commonality exists between the set of words comprises determining whether there is a common word set between the set of words; and wherein making at least the portion of the set of words keywords comprises making the words in the common word set keywords, the keywords being defined as words accessed by search engines to determine a relevancy of the respective electronic document for a given keyword search. 
   
   
       13 . The computer readable storage medium of  claim 12 , wherein making the words in the common word set keywords comprises making the words in the common word set keywords for each of the respective electronic documents defined by the respective document definitions. 
   
   
       14 . The computer readable storage medium of  claim 12 , wherein making the words in the common word set keywords is conditioned on first establishing that the number of the words in the common word set is less than a predefined threshold number. 
   
   
       15 . A computer system, comprising:
 a processor configured to:
 analyze a document definition of an electronic document located at a source network address to identify one or more lists of hyperlinks to other electronic documents located at respective target network addresses; 
 for at least two hyperlinks in at least one identified list of hyperlinks, access the respective electronic documents pointed to by the at least two respective hyperlinks; 
 for each respective electronic document accessed, analyze the respective document definition of the respective electronic document to determine a set of words representative of the respective electronic document; 
 compare each determined set of words to an determine whether a commonality exists between the set of words based on some predefined criteria; and 
 if the commonality exists, make at least a portion of the set of words keywords for one or more of respective electronic documents defined by the respective document definitions. 
   
   
   
       16 . The computer system of  claim 15 , wherein the source network address is a website. 
   
   
       17 . The computer system of  claim 15 , wherein making at least a portion of the set of words keywords is conditioned on first establishing that the number of the hyperlinks in the at least one identified list is greater than a predefined threshold number. 
   
   
       18 . The computer system of  claim 15 , wherein making at least the portion of the set of words keywords comprises making the portion of the set of words keywords for each of the respective electronic documents defined by the respective document definitions. 
   
   
       19 . The computer system of  claim 15 , wherein determining whether a commonality exists between the set of words comprises determining whether there is a common word set between the set of words; and wherein making at least the portion of the set of words keywords comprises making the words in the common word set keywords, the keywords being defined as words accessed by search engines to determine a relevancy of the respective electronic document for a given keyword search. 
   
   
       20 . The computer system of  claim 19 , wherein making the words in the common word set keywords comprises making the words in the common word set keywords for each of the respective electronic documents defined by the respective document definitions. 
   
   
       21 . The computer system of  claim 19 , wherein making the words in the common word set keywords is conditioned on first establishing that the number of the words in the common word set is less than a predefined threshold number. 
   
   
       22 . A method for determining keywords representative of the content of an electronic document located at a source network address, comprising:
 analyzing a document definition of the electronic document located at the source network address to identify one or more lists of hyperlinks to other electronic documents located at respective target network addresses; wherein analyzing the document definition to identify one or more lists of hyperlinks comprises scanning the document definition for predefined markup language tags that define the beginning of a list of hyperlinks;   in response to identifying one or more lists of hyperlinks of the analyzed document:
 for at least two hyperlinks in at least one identified list of hyperlinks, accessing the respective electronic documents pointed to by the at least two respective hyperlinks; 
 for each respective electronic document accessed, analyzing the respective document definition of the respective electronic document to determine a set of words which occur above a predefined frequency in the respective electronic document wherein the determined set of words is representative of the respective electronic document; 
 comparing each determined set of words to determine whether a commonality exists between the set of words based on some predefined criteria; and 
 if the commonality exists, making at least a portion of the set of words keywords for the one or more of respective electronic documents defined by the respective document definitions; wherein making at least the portion of the set of words keywords is conditioned on:
 comparing the number of the hyperlinks in the at least one identified list to a predefined threshold number; and 
 determining that the number of the hyperlinks in the at least one identified list is greater than the predefined threshold number, 
 
 wherein determining whether a commonality exists between the set of words comprises determining whether there is a common word set between the set of words; and wherein making at least the portion of the set of words keywords comprises making the words in the common word set keywords.