Fulfillment of actionable requests ahead of a user selecting a particular autocomplete suggestion for completing a current user input

Abstract

Implementations set forth herein relate to providing selectable autofill suggestions, which correspond to application actions that are at least partially fulfilled using server command data—prior to a user selecting a particular selectable autofill suggestion. Proactively fulfilling command data in this way mitigates latency between user selection of a suggestion and fulfillment of a particular action. Initially, a partial input can be processed to generate autofill suggestions, which can be communicated to a server device for further processing. The autofill suggestions can also be rendered for selection at a touch display interface, thereby allowing a user to select one of the autofill suggestions. As command fulfillment data is provided by the server, the command fulfillment data can be available to a corresponding application(s) in order that any corresponding actions can be at least partially fulfilled prior to user selection.

I claim: 
     
       1. A method implemented by one or more processors of a client device, the method comprising:
 receiving, via the client device, a first user input, the first user input being a partial user input that includes one or more natural language characters; 
 in response to receiving the partial user input via the client device:
 determining one or more autofill suggestions based on the one or more natural language characters, 
 causing the one or more autofill suggestions to be displayed at a user interface of the client device, the one or more autofill suggestions suggesting one or more actions performable by one or more applications, and 
 communicating autofill suggestion data that characterizes the one or more autofill suggestions to a server device; 
 
 receiving, from the server device, additional suggestion content generated by the server device based on the autofill suggestion data, wherein the additional suggestion content supplements the one or more autofill suggestions; and 
 causing the additional suggestion content to be displayed, along with the one or more autofill suggestions and after initial display of the one or more autofill suggestions, at the user interface of the computing device. 
 
     
     
       2. The method of  claim 1 , wherein the additional suggestion content includes graphical content that indicates a current status of a device that is controllable by a first application, of the one or more applications. 
     
     
       3. The method of  claim 2 , wherein the graphical content includes an interactive graphical user interface (GUI) element that indicates the current status of the device, and wherein the interactive GUI element enables modification to the current status of the device. 
     
     
       4. The method of  claim 1 , further comprising:
 subsequent to the additional suggestion content being displayed at the user interface to supplement the one or more autofill suggestions, receiving a second user input that selects an autofill suggestion, of the one or more autofill suggestions, and 
 in response to receiving the second user input, causing an application action suggested by the selected autofill suggestion to be performed. 
 
     
     
       5. The method of  claim 1 , wherein the one or more autofill suggestions include a particular autofill suggestion that suggests particular media content, and the additional suggestion content includes a preview of media content. 
     
     
       6. The method of  claim 5 , wherein the additional suggestion content further includes a portion of the media content, wherein the portion of the media content is buffered into a memory of the client device in response to receiving the additional suggestion content. 
     
     
       7. The method of  claim 1 , further comprising:
 receiving, from the server device, command data generated by the server device based on the autofill suggestion data, wherein the command data is received along with the additional suggestion content, and wherein the command data enables the one or more applications to perform the one or more actions. 
 
     
     
       8. The method of  claim 7 , wherein the command data includes an embedded link that, when executed, causes a first application, of the one or more applications, to perform a corresponding action. 
     
     
       9. The method of  claim 7 , wherein the command data includes network data for establishing a connection between the client device and one or more devices controllable by the one or more applications. 
     
     
       10. A method implemented by one or more processors of a client device, the method comprising:
 receiving, via the client device, a partial user input that includes one or more natural language characters; 
 in response to receiving the partial user input via the client device:
 determining one or more autofill suggestions based on the one or more natural language characters, 
 causing the one or more autofill suggestions to be displayed at a user interface of the client device, the one or more autofill suggestions suggesting one or more actions performable by one or more applications, and 
 communicating autofill suggestion data that characterizes the one or more autofill suggestions to a server device; 
 
 receiving, from the server device, command data and additional suggestion content generated by the server device based on the autofill suggestion data,
 wherein the command data enables the one or more applications to perform the one or more actions, and 
 wherein the additional suggestion content supplements the one or more autofill suggestions; and 
 causing the additional suggestion content to be displayed, along with the one or more autofill suggestions and after initial display of the one or more autofill suggestions, at the user interface of the computing device. 
 
 
     
     
       11. The method of  claim 10 , further comprising:
 subsequent to receiving the command data from the server device, receiving a further user input, via the client device, that selects an autofill suggestion, of the one or more autofill suggestions, wherein the selected autofill suggestion suggests a first action performable by a first application of the one or more applications; and 
 in response to receiving the further user input, causing the first application to perform the first action using the command data. 
 
     
     
       12. The method of  claim 11 , wherein the further user input is received subsequent to the additional suggestion content being displayed at the user interface of the computing device. 
     
     
       13. The method of  claim 11 , wherein the additional suggestion content includes graphical content that indicates a current status of a device that is controllable by the first application, of the one or more applications. 
     
     
       14. The method of  claim 13 , wherein the graphical content includes an interactive graphical user interface (GUI) element that indicates the current status of the device, and wherein the interactive GUI element enables modification to the current status of the device. 
     
     
       15. The method of  claim 10 , wherein the one or more autofill suggestions includes a particular autofill suggestion that suggests particular media content, and the additional suggestion content includes a preview of media content. 
     
     
       16. The method of  claim 15 , wherein the additional suggestion content further includes a portion of the media content, wherein the portion of the media content is buffered into a memory of the client device in response to receiving the additional suggestion content. 
     
     
       17. A method implemented by one or more processors of a client device, the method comprising:
 receiving, via an input interface of the client device, a partial user input that includes one or more natural language characters; 
 in response to receiving the partial user input via the input interface of the client device:
 determining one or more autofill suggestions based on the one or more natural language characters, 
 causing the one or more determined autofill suggestions to be displayed at a user interface of the client device, the one or more autofill suggestions suggesting one or more actions performable by one or more applications, and 
 communicating autofill suggestion data that characterizes the one or more autofill suggestions to a server device; 
 
 receiving, from the server device, command data generated by the server device based on the autofill suggestion data, wherein the command data enables the one or more applications to perform the one or more actions; 
 subsequent to receiving the command data from the server device, receiving a further user input, via the client device, that selects an autofill suggestion, of the one or more autofill suggestions, wherein the selected autofill suggestion suggests a first action performable by a first application of the one or more applications; and 
 in response to receiving the further user input, causing the first application to perform the first action using the command data. 
 
     
     
       18. The method of  claim 17 , wherein the command data includes an embedded link, when executed, causes the first application to perform the first action. 
     
     
       19. The method of  claim 17 , wherein the command data includes network data for establishing a connection between the client device and a device controllable by the first application. 
     
     
       20. The method of  claim 17 , wherein the first action is to modify a current status of a device that is controlled by the first application and that is separate from the client and server devices, and wherein the command data indicates the current status of the device.