Autonomously motile device with speech commands

Abstract

An autonomously motile device may be controlled by speech received by a user device. A first speech-processing system associated with the user device may determine that audio data includes a representation of a command; a second speech-processing system associated with the autonomously motile device may determine that the command should be executed by the autonomously motile device. A network connection is established between the user device and the autonomously motile device, and a device manager authorizes execution of the command.

1 - 20 . (canceled) 
     
     
         21 . A computer-implemented method for controlling an autonomously motile device (AMD), the method comprising:
 receiving, at a user device, audio data representing an utterance;   determining, using at least one speech-processing component, that the audio data represents a command corresponding to the AMD;   determining, by at least one component associated with the AMD, that the command is authorized to be executed by the AMD; and   causing the AMD to execute the command.   
     
     
         22 . The computer-implemented method of  claim 21 , wherein determining that the audio data represents a command corresponding to the AMD comprises:
 processing the audio data to determine an intent representing the command; and   determining the intent corresponds to the AMD.   
     
     
         23 . The computer-implemented method of  claim 21 , wherein determining that the audio data represents a command corresponding to the AMD comprises detecting a wakeword corresponding to the AMD. 
     
     
         24 . The computer-implemented method of  claim 21 , further comprising:
 determining the user device is associated with a first user account,   wherein determining that the command is authorized to be executed by the AMD is based at least in part on the AMD being associated with the first user account.   
     
     
         25 . The computer-implemented method of  claim 21 , further comprising:
 determining a connection exists between the user device and the AMD,   wherein determining that the command is authorized to be executed by the AMD is based at least in part on the connection.   
     
     
         26 . The computer-implemented method of  claim 21 , wherein:
 determining that the audio data represents a command corresponding to the AMD comprises performing speech processing on the audio data using a first speech processing component associated with the user device to determine output data; and   determining that the command is authorized to be executed by the AMD comprises processing the output data by the at least one component associated with the AMD.   
     
     
         27 . The computer-implemented method of  claim 26 , wherein performing the speech processing is performed by the user device. 
     
     
         28 . The computer-implemented method of  claim 21 , further comprising:
 determining, using the speech-processing component, a response to the command; and   causing, using the user device, an output corresponding to the response.   
     
     
         29 . The computer-implemented method of  claim 21 , wherein prior to determining that the command is authorized to be executed, the method further comprising:
 determining that a connection does not exist between the user device and the AMD;   sending, by the user device, a request to establish a communication connection between the user device and the AMD; and   causing the communication connection to be established.   
     
     
         30 . The computer-implemented method of  claim 21 , wherein the AMD is located in a physical environment and wherein a second AMD is also located in the physical environment, the method further comprising:
 determining that the utterance includes reference to a location in the physical environment; and   determining that the AMD is closer to the location than the second AMD,   wherein causing the AMD to execute the command comprises causing the AMD to move towards the location.   
     
     
         31 . A system for controlling an autonomously motile device (AMD), comprising:
 at least one processor; and   at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:
 receive, at a user device, audio data representing an utterance; 
 determine, using at least one speech-processing component, that the audio data represents a command corresponding to the AMD; 
 determine, by at least one component associated with the AMD, that the command is authorized to be executed by the AMD; and 
 cause the AMD to execute the command. 
   
     
     
         32 . The system of  claim 31 , wherein the instructions that cause the system to determine that the audio data represents a command corresponding to the AMD comprise instructions that, when executed by the at least one processor, cause the system to:
 process the audio data to determine an intent representing the command; and   determine the intent corresponds to the AMD.   
     
     
         33 . The system of  claim 31 , wherein the instructions that cause the system to determine that the audio data represents a command corresponding to the AMD comprise instructions that, when executed by the at least one processor, cause the system to detect a wakeword corresponding to the AMD. 
     
     
         34 . The system of  claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
 determine the user device is associated with a first user account,   wherein the instructions that cause the system to determine that the command is authorized to be executed by the AMD are based at least in part on the AMD being associated with the first user account.   
     
     
         35 . The system of  claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
 determine a connection exists between the user device and the AMD,   wherein the instructions that cause the system to determine that the command is authorized to be executed by the AMD are based at least in part on the connection.   
     
     
         36 . The system of  claim 31 , wherein:
 the instructions that cause the system to determine that the audio data represents a command corresponding to the AMD comprise instructions that, when executed by the at least one processor, cause the system to perform speech processing on the audio data using a first speech processing component associated with the user device to determine output data; and   the instructions that cause the system to determine that the command is authorized to be executed by the AMD comprise instructions that, when executed by the at least one processor, cause the system to process the output data by the at least one component associated with the AMD.   
     
     
         37 . The system of  claim 36 , wherein the instructions that cause the system to perform the speech processing cause the speech processing to be performed by the user device. 
     
     
         38 . The system of  claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
 determine, using the speech-processing component, a response to the command; and   cause, using the user device, an output corresponding to the response.   
     
     
         39 . The system of  claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to, prior to determination that the command is authorized to be executed:
 determine a connection does not exist between the user device and the AMD;   send, by the user device, a request to establish a communication connection between the user device and the AMD; and   cause the communication connection to be established.   
     
     
         40 . The system of  claim 31 , wherein the AMD is located in a physical environment and wherein a second AMD is also located in the physical environment, and wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
 determine that the utterance includes reference to a location in the physical environment; and   determine that the AMD is closer to the location than the second AMD,   wherein the instructions that cause the system to cause the AMD to execute the command comprise instructions that, when executed by the at least one processor, cause the system to cause the AMD to move towards the location.