User interface operation based on token frequency of use in text

Abstract

Operation of a user interface includes performing token based analysis of a baseline text corpus and a targeted text listing. For a selected token in the targeted text listing, a matching baseline token in identified. From a plurality of contexts corresponding to the matching baseline token, context-matched and non-context matched usage data for the matching baseline token is identified and provided to a user interface. Similar processing may be performed on the basis of a related, but matching, baseline token. In another embodiment, instances of similar spelling errors are identified on the basis of a plurality of tokens identified in the targeted text listing.

1 - 27 . (canceled) 
     
     
         28 . A method for identifying and correcting spelling and typographical errors, the method comprising:
 extracting a plurality of tokens from a text and characterizing each of the extracted tokens;   applying a plurality of filtering techniques to exclude one or more of the tokens as possible spelling errors;   identifying, based on a first filtering technique, instances of similar spelling errors related to unexcluded tokens;   identifying, based on a second filtering technique, instances of similar typographical errors related to the unexcluded tokens;   additionally excluding any tokens that are found in a dictionary as not constituting typographical errors; and   providing, based on the plurality of tokens, a user interface on a display identifying similar spelling error instances and the identified typographical error instances.   
     
     
         29 . The method for identifying and correcting spelling and typographical errors of  claim 28 , further comprising:
 characterizing each of the extracted tokens based on how often each of the extracted tokens occurs within the targeted text listing and based on an identification of other extracted tokens surrounding each extracted token.   
     
     
         30 . The method for identifying and correcting spelling and typographical errors of  claim 29 , wherein the surrounding extracted tokens occur within a certain measurement both before and after a given extracted token, and wherein a distance measurement of one identifies extracted tokens immediately preceding and following a given extracted token, and wherein a distance measurement of two identifies the two extracted tokens preceding the given extracted token and the two extracted tokens following the given extracted token. 
     
     
         31 . The method for identifying and correcting spelling and typographical errors of  claim 28 , further comprising:
 grouping the extracted tokens according to their character length during at least one word identification.   
     
     
         32 . The method for identifying and correcting spelling and typographical errors of  claim 28 , wherein the plurality of filtering techniques includes phrase filtering in which tokens occurring in a predefined phrase are excluded from being considered as similar spelling errors or similar typographical errors. 
     
     
         33 . The method for identifying and correcting spelling and typographical errors of  claim 28 , wherein the plurality of filtering techniques includes frequency filtering in which tokens occurring frequently are excluded from being considered as similar spelling errors or similar typographical errors. 
     
     
         34 . The method for identifying and correcting spelling and typographical errors of  claim 28 , wherein the plurality of filtering techniques includes exclusion filtering in which tokens satisfying an exclusion rule are excluded from being considered as similar spelling errors or similar typographical errors. 
     
     
         35 . The method for identifying and correcting spelling and typographical errors of  claim 28 , wherein the first filtering technique is different from the second filtering technique. 
     
     
         36 . An apparatus for identifying and correcting spelling and typographical errors, the apparatus comprising:
 at least one processor operatively connected to a display;   a storage device operatively connected to the at least one processors and having stored thereon instructions that, when executed by the at least one processor, cause the at least one processor to:   extract a plurality of tokens from a text and characterize each of the extracted tokens;   apply a plurality of filtering techniques to exclude one or more of the tokens as possible spelling errors;   identify, based on a first filtering technique, instances of similar spelling errors related to unexcluded tokens;   identify, based on a second filtering technique, instances of similar typographical errors related to the unexcluded tokens;   additionally exclude any tokens that are found in a dictionary as not constituting typographical errors; and   provide, based on the plurality of tokens, a user interface on the display identifying similar spelling error instances and the identified typographical error instances.   
     
     
         37 . The apparatus for identifying and correcting spelling and typographical errors of  claim 36 , wherein the storage device further comprises instructions that, when executed by the at least one processor, cause the at least one processor to:
 characterize each of the extracted tokens based on how often each of the extracted tokens occurs within the targeted text listing and based on an identification of other extracted tokens surrounding each extracted token.   
     
     
         38 . The apparatus for identifying and correcting spelling and typographical errors of  claim 37 , wherein the surrounding extracted tokens occur within a certain measurement both before and after a given extracted token, and wherein a measurement of one identifies extracted tokens immediately preceding and following a given extracted token, and wherein a measurement of two identifies the two extracted tokens preceding the given extracted token and the two extracted tokens following the given extracted token. 
     
     
         39 . The apparatus for identifying and correcting spelling and typographical errors of  claim 36 , wherein the storage device further comprises instructions that, when executed by the at least one processor, cause the at least one processor to:
 group the extracted tokens according to their character length during at least one word identification.   
     
     
         40 . The apparatus for identifying and correcting spelling and typographical errors of  claim 36 , wherein the plurality of filtering techniques includes phrase filtering in which tokens occurring in a predefined phrase are excluded from being considered as similar spelling errors or similar typographical errors. 
     
     
         41 . The apparatus for identifying and correcting spelling and typographical errors of  claim 36 , wherein the plurality of filtering techniques includes frequency filtering in which tokens occurring more frequently are excluded from being considered as similar spelling errors or similar typographical errors. 
     
     
         42 . The apparatus for identifying and correcting spelling and typographical errors of  claim 36 , wherein the plurality of filtering techniques includes exclusion filtering in which tokens satisfying an exclusion rule are excluded from being considered as similar spelling errors or similar typographical errors. 
     
     
         43 . The apparatus for identifying and correcting spelling and typographical errors of  claim 36 , wherein the first filtering technique is different from the second filtering technique. 
     
     
         44 . A non-transitory, machine-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to identify and correct spelling and typographical errors in a text by:
 extracting a plurality of tokens from the text and characterizing each of the extracted tokens;   applying a plurality of filtering techniques to exclude one or more of the tokens as possible spelling errors;   identifying based on a first filtering technique, instances of similar spelling errors related to unexcluded tokens;   identifying based on a second filtering technique, instances of similar typographical errors related to the unexcluded tokens;   additionally excluding any tokens that are found in a dictionary as not constituting typographical errors; and   providing, based on the plurality of tokens, a user interface on a display identifying similar spelling error instances and the identified typographical error instances.   
     
     
         45 . The machine-readable medium of  claim 44 , wherein the instructions cause the at least one processor to characterize each of the extracted tokens based on how often each of the extracted tokens occurs within the targeted text listing and based on an identification of other extracted tokens surrounding each extracted token. 
     
     
         46 . The machine-readable medium of  claim 45 , wherein the surrounding extracted tokens occur within a certain measurement both before and after a given extracted token, and wherein a measurement of one identifies extracted tokens immediately preceding and following a given extracted token, and wherein a measurement of two identifies the two extracted tokens preceding the given extracted token and the two extracted tokens following the given extracted token. 
     
     
         47 . The machine-readable medium of  claim 44 , wherein the instructions cause the at least one processor to group the extracted tokens according to their character length during at least one word identification.