Voice-enabled dialog interaction with web pages

Abstract

Voice enabled dialog with web pages is provided. An Internet address of a web page is received including an area with which a user of a client device can specify information. The web page is loaded using the received Internet address of the web page. A task structure of the web page is then extracted. An abstract representation of the web is then generated. A dialog script, based on the abstract representation of the web page is then provided. Spoken information received from the user is converted into text and the converted text is inserted into the area.

What is claimed is: 
     
         1 . A method of enabling voice interaction with a web page, the method comprising:
 receiving, via a processor, an Internet address of the web page, the web page comprising a graphical interface for a user to provide information;   determining that a client device does not have a physical keypad;   extracting a task structure of the web page;   generating a representation of the web page to facilitate the voice interaction with the web page; and   providing a dialog script based on the representation to provide the voice interaction with the user.   
     
     
         2 . The method of  claim 1 , further comprising:
 converting spoken information from the user into text; and   inserting the text is inserted into an area of the web page.   
     
     
         3 . The method of  claim 1 , further comprising:
 extracting forms, form constraints, and dependencies from the web page using a browser object model and a document object model.   
     
     
         4 . The method of  claim 1 , further comprising:
 generating a browser object model of the web page.   
     
     
         5 . The method of  claim 4 , wherein the browser object model comprises a state of hypertext markup language elements as the hypertext markup language elements would appear in a web browser. 
     
     
         6 . The method of  claim 4 , further comprising:
 generating a document object model of the web page.   
     
     
         7 . The method of  claim 6 , wherein the document object model comprises a tree of hypertext markup language elements. 
     
     
         8 . A system comprising:
 a processor; and   a computer-readable storage medium that stores executable instructions that, when executed by the processor, cause the processor to perform operations comprising:
 receiving an Internet address of a web page, the web page comprising a graphical interface for a user to provide information; 
 determining that a client device does not have a physical keypad; 
 extracting a task structure of the web page; 
 generating a representation of the web page to facilitate a voice interaction with the web page; and 
 providing a dialog script based on the representation to provide the voice interaction with the user. 
   
     
     
         9 . The system of  claim 8 , wherein the computer-readable storage medium stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 converting spoken information from the user into text; and   inserting the text is inserted into an area of the web page.   
     
     
         10 . The system of  claim 8 , wherein the computer-readable storage medium stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 extracting forms, form constraints, and dependencies from the web page using a browser object model and a document object model.   
     
     
         11 . The system of  claim 8 , wherein the computer-readable storage medium stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 generating a browser object model of the web page.   
     
     
         12 . The system of  claim 11 , wherein the browser object model comprises a state of hypertext markup language elements as the hypertext markup language elements would appear in a web browser. 
     
     
         13 . The system of  claim 11 , wherein the computer-readable storage medium stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 generating a document object model of the web page.   
     
     
         14 . The system of  claim 13 , wherein the document object model comprises a tree of hypertext markup language elements. 
     
     
         15 . A non-transitory computer-readable storage device storing instructions that enables voice interaction with a web page and that, when executed by a processor, causes the processor to perform operations comprising:
 receiving an Internet address of the web page, the web page comprising a graphical interface for a user to provide information;   determining that a client device does not have a physical keypad;   extracting a task structure of the web page;   generating a representation of the web page to facilitate the voice interaction with the web page; and   providing a dialog script based on the representation to provide the voice interaction with the user.   
     
     
         16 . The non-transitory computer-readable storage device of  claim 15 , wherein the non-transitory computer-readable storage device stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 converting spoken information from the user into text; and   inserting the text is inserted into an area of the web page.   
     
     
         17 . The non-transitory computer-readable storage device of  claim 15 , wherein the non-transitory computer-readable storage device stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 extracting forms, form constraints, and dependencies from the web page using a browser object model and a document object model.   
     
     
         18 . The non-transitory computer-readable storage device of  claim 15 , wherein the non-transitory computer-readable storage device stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 generating a browser object model of the web page.   
     
     
         19 . The non-transitory computer-readable storage device of  claim 18 , wherein the browser object model comprises a state of hypertext markup language elements as the hypertext markup language elements would appear in a web browser. 
     
     
         20 . The non-transitory computer-readable storage device of  claim 18 , wherein the non-transitory computer-readable storage device stores additional executable instructions that, when executed by the processor, cause the processor to perform further operations comprising:
 generating a document object model of the web page.