Parsing Handwriting Into Online Events

Abstract

Illustrative embodiments of the system allow users to write handwritten notes, such as to-do items and calendar events, and have them converted into online objects and actions by a handwriting parser engine. The handwriting is processed and converted into commands that execute online actions or create online objects, which can be local to a device (e.g., creating a calendar entry in a calendar program) or can involve actions using or taken over a communication system (e.g., creating a calendar entry in an online calendar, making a purchase from an online service, transmitting a text or email message, etc.).

What is claimed is: 
     
         1 . A handwriting parser configured to perform computer processes comprising:
 receiving a digital representation of handwritten text the handwritten text including: (1) a key associated with a predetermined action, and (2) other handwritten content;   identifying a key in the digital representation of the handwritten text;   determining at least a portion of the other handwritten content that relates to the identified key, the at least a portion of the other handwritten content that relates to the identified key defining relevant handwritten content;   causing execution of the predetermined action associated with the identified key, the execution of the predetermined action using the relevant handwritten content.   
     
     
         2 . The handwriting parser of  claim 1 , wherein identifying the key comprises:
 identifying the key based on a position of the key in the digital representation.   
     
     
         3 . The handwriting parser of  claim 1 , wherein identifying the key comprises:
 identifying a key candidate in the digital representation;   accessing an alternate key table including a plurality of key candidates; and   accessing a valid key table to identify the key from among the plurality of key candidates.   
     
     
         4 . The handwriting parser of  claim 3 , wherein the alternate key table comprises, for each of the plurality of key candidates, a predetermined confidence metric. 
     
     
         5 . The handwriting parser of  claim 4 , wherein accessing the valid key table to identify the key from among the plurality of key candidates comprises:
 selecting a key candidate from among the plurality of key candidates based on the predetermined confidence metrics; and   comparing the selected key candidate to valid keys in the valid key table.   
     
     
         6 . The handwriting parser of  claim 1 , wherein the metadata specifies spacing information for locating the at least one parameter, and wherein processing the digital representation using the metadata comprises processing the digital representation using the spacing information. 
     
     
         7 . The handwriting parser of  claim 3 , further comprising:
 generating the alternate key table from an alternate character map specifying, for each of a number of possible characters, at least one possible alternate character and a corresponding confidence metric.   
     
     
         8 . The handwriting parser of  claim 1 , wherein obtaining the digital representation comprises:
 processing an image of the handwritten text using an optical character recognition engine configured to convert the handwritten text into a digital representation.   
     
     
         9 . The handwriting parser of  claim 8 , wherein obtaining the digital representation comprises:
 capturing the image using a camera of a mobile device.   
     
     
         10 . The handwriting parser of  claim 9 , wherein obtaining the digital representation comprises:
 receiving the handwriting on a touch screen.   
     
     
         11 . The handwriting parser of  claim 1 , wherein the predetermined action is creating a to-do list. 
     
     
         12 . The handwriting parser of  claim 1 , wherein the predetermined action triggers a purchase on an online marketplace. 
     
     
         13 . A method of causing execution of a digital action based on handwritten text, the method comprising:
 receiving a digital representation of handwritten text the handwritten text including: (1) a key associated with a predetermined action, and (2) other handwritten content;   identifying a key in the digital representation of the handwritten text;   determining at least a portion of the other handwritten content that relates to the identified key, the at least a portion of the other handwritten content that relates to the identified key defining relevant handwritten content;   causing execution of the predetermined action associated with the identified key, the execution of the predetermined action using the relevant handwritten content.   
     
     
         14 . The method of  claim 13 , wherein the key comprises a predetermined set of one or more characters. 
     
     
         15 . A tangible, non-transitory computer readable medium having stored thereon computer instructions which, when run on a computer processor, cause the computer processor to perform computer processes implementing a handwriting parser configured to perform computer processes comprising:
 receiving a digital representation of handwritten text the handwritten text including: (1) a key associated with a predetermined action, and (2) other handwritten content;   identifying a key in the digital representation of the handwritten text;   determining at least a portion of the other handwritten content that relates to the identified key, the at least a portion of the other handwritten content that relates to the identified key defining relevant handwritten content;   causing execution of the predetermined action associated with the identified key, the execution of the predetermined action using the relevant handwritten content.   
     
     
         16 . The method of  claim 15 , wherein the key comprises a predetermined set of one or more characters. 
     
     
         17 . The method of  claim 15 , wherein the key is identified based on a position of the key in the digital representation