Input detection windowing

Abstract

A device, such as Network Microphone Device or a playback device, detecting an event associated with the device or a system comprising the device. In response, an input detection window is opened for a given time period. During the given time period the device is arranged to receive an input sound data stream representing sound detected by a microphone. The input sound data stream is analyzed for a plurality of keywords and/or a wake-word for a Voice Assistant Service (VAS) and, based on the analysis, it is determined that the input sound data stream includes voice input data comprising a keyword or a wake-word for a VAS. In response, the device takes appropriate action such as causing the media playback system to perform a command corresponding to the keyword or sending at least part of the input sound data stream to the VAS.

The invention claimed is: 
     
       1. A playback device comprising:
 at least one microphone configured to detect sound; 
 at least one processor; and 
 data storage having instructions stored thereon that are executed by the at least one processor to cause the playback device to perform functions comprising:
 detecting a first input sound data stream comprising a wake word and a voice input; 
 performing an action based on the voice input; 
 after performing the action, detecting an event, the event being associated with the playback device or a media playback system comprising the playback device, wherein the event is not based on sound data captured via the at least one microphone; 
 responsive to the event, opening an input detection window for a given time period; 
 while the input detection window is open for the given time period:
 receiving a second input sound data stream from the at least one microphone before the input detection window ends, wherein the second input sound data stream represents sound detected by the at least one microphone; 
 
 analyzing the second input sound data stream by the at least one processor for a plurality of keywords supported by the playback device; 
 determining, based on the analysis, that the second input sound data stream includes voice input data comprising a keyword; 
 wherein the keyword is one of the plurality of keywords supported by the playback device; and 
 responsive to the determining that the second input sound data stream includes voice input data comprising a keyword, causing a command corresponding to the keyword to be performed. 
 
 
     
     
       2. The playback device of  claim 1 , wherein the event comprises one or more of:
 a track change indication; 
 reaching the end of a media item or track being played back by the playback device or media playback system comprising the playback device; 
 opening of an application associated with the playback device or a media playback system comprising the playback device; 
 detecting the presence of a person proximate the playback device; or 
 detecting a connection of a new device to a media playback system comprising the playback device. 
 
     
     
       3. The playback device according to  claim 1 , further comprising:
 storing historical data in the data storage, the historical data including determined events and any associated commands; and 
 analyzing the historical data to adjust the given time period associated with the input detection window. 
 
     
     
       4. The playback device according to  claim 3 , wherein the given time period is associated with a user account of the playback device or a system comprising the playback device. 
     
     
       5. The playback device according to  claim 1 , wherein outside of the input detection window, the second input sound data stream is not analyzed. 
     
     
       6. The playback device according to  claim 1 , further comprising:
 a network interface, and 
 the instructions stored on the data storage that are executed by the at least one processor further cause the playback device to perform functions comprising:
 transmitting, via the network interface and during the input detection window, at least part of the second input sound data stream to a remote server for analysis; 
 receiving data including a remote command from the remote server, the remote command being supported by the playback device; and 
 causing the media playback system to perform the remote command. 
 
 
     
     
       7. The playback device according to  claim 1 , wherein the analyzing the second input data stream comprises determining a keyword by at least one of:
 natural language processing to determine an intent, based on an analysis of the keyword in the second input sound data stream; and 
 pattern-matching based on a predefined library of keywords and associated keywords. 
 
     
     
       8. A method to be performed by a playback device comprising at least one microphone configured to detect sound, the method comprising:
 detecting a first input sound data stream comprising a wake word and a voice input; 
 performing an action based on the voice input; 
 after performing the action, detecting an event, the event being associated with the playback device or a media playback system comprising the playback device, wherein the event is not based on sound data captured via the at least one microphone; 
 responsive to the event, opening an input detection window for a given time period; 
 while the input detection window is open for the given time period:
 receiving a second input sound data stream from the at least one microphone before the input detection window ends, wherein the second input sound data stream represents sound detected by the at least one microphone; 
 
 analyzing the second input sound data stream by the at least one processor for a plurality of keywords supported by the playback device; 
 determining, based on the analysis, that the second input sound data stream includes voice input data comprising a keyword; 
 wherein the keyword is one of the plurality of keywords supported by the playback device; and 
 responsive to the determining that the second input sound data stream includes voice input data comprising a keyword, causing a command corresponding to the keyword to be performed. 
 
     
     
       9. The method of  claim 8 , wherein the event comprises one or more of:
 a track change indication; 
 reaching the end of a media item or track being played back by the playback device or media playback system comprising the playback device; 
 opening of an application associated with the playback device or a media playback system comprising the playback device; 
 detecting the presence of a person proximate the playback device; or 
 detecting a connection of a new device to a media playback system comprising the playback device. 
 
     
     
       10. The method of  claim 8 , further comprising:
 storing historical data in the data storage, the historical data including determined events and any associated commands; and 
 analyzing the historical data to adjust the given time period associated with the input detection window. 
 
     
     
       11. The method of  claim 10 , wherein the given time period is associated with a user account of the playback device or a system comprising the playback device. 
     
     
       12. The method of  claim 8 , wherein outside of the input detection window, the second input sound data stream is not analyzed. 
     
     
       13. The method of  claim 8 , further comprising:
 transmitting, via a network interface of the playback device and during the input detection window, at least part of the second input sound data stream to a remote server for analysis 
 receiving data including a remote command from the remote server, the remote command being supported by the playback device; and 
 causing the media playback system to perform the remote command. 
 
     
     
       14. The method of  claim 8 , wherein the analyzing the second input data stream comprises determining a keyword by at least one of:
 natural language processing to determine an intent, based on an analysis of the keyword in the second input sound data stream; and 
 pattern-matching based on a predefined library of keywords and associated keywords. 
 
     
     
       15. A non-transitory computer-readable medium having instructions stored thereon that are executable by one or more processors to cause a playback device to perform functions, the playback device comprising at least one microphone configured to detect sound, the functions comprising:
 detecting a first input sound data stream comprising a wake word and a voice input; 
 performing an action based on the voice input; 
 after performing the action, detecting an event, the event being associated with the playback device or a media playback system comprising the playback device, wherein the event is not based on sound data captured via the at least one microphone; 
 responsive to the event, opening an input detection window for a given time period; 
 while the input detection window is open for the given time period:
 receiving a second input sound data stream from the at least one microphone, wherein the second input sound data stream represents sound detected by the at least one microphone; 
 
 analyzing the second input sound data stream by the at least one processor for a plurality of keywords supported by the playback device; 
 determining, based on the analysis, that the second input sound data stream includes voice input data comprising a keyword; 
 wherein the keyword is one of the plurality of keywords supported by the playback device; and 
 responsive to the determining that the second input sound data stream includes voice input data comprising a keyword, causing a command corresponding to the keyword to be performed. 
 
     
     
       16. The computer-readable medium of  claim 15 , wherein the event comprises one or more of:
 a track change indication; 
 reaching the end of a media item or track being played back by the playback device or media playback system comprising the playback device; 
 opening of an application associated with the playback device or a media playback system comprising the playback device; 
 detecting the presence of a person proximate the playback device; or 
 detecting a connection of a new device to a media playback system comprising the playback device. 
 
     
     
       17. The computer-readable medium of  claim 15 , wherein the operations further comprise:
 storing historical data in the data storage, the historical data including determined events and any associated commands; and 
 analyzing the historical data to adjust the given time period associated with the input detection window. 
 
     
     
       18. The computer-readable medium of  claim 15 , wherein outside of the input detection window, the second input sound data stream is not analyzed. 
     
     
       19. The computer-readable medium of  claim 15 , wherein the operations further comprise:
 transmitting, via a network interface of the playback device and during the input detection window, at least part of the second input sound data stream to a remote server for analysis; 
 receiving data including a remote command from the remote server, the remote command being supported by the playback device; and 
 causing the media playback system to perform the remote command. 
 
     
     
       20. The computer-readable medium of  claim 15 , wherein the analyzing the second input data stream comprises determining a keyword by at least one of:
 natural language processing to determine an intent, based on an analysis of the keyword in the second input sound data stream; and 
 pattern-matching based on a predefined library of keywords and associated keywords.