Attention aware virtual assistant dismissal

Abstract

Systems and processes for operating an intelligent automated assistant are provided. An example process includes initiating a virtual assistant session responsive to receiving user input. In accordance with initiating the virtual assistant session, the process includes determining, based on data obtained using one or more sensors of the electronic device, whether one or more criteria representing expressed user disinterest are satisfied. In accordance with determining that the one or more criteria representing expressed user disinterest are satisfied prior to a first time, the process includes automatically deactivating the virtual assistant session prior to the first time. The first time is defined by a setting of the electronic device. In accordance with determining that the one or more criteria representing expressed user disinterest are not satisfied prior to the first time, the process includes automatically deactivating the virtual assistant session at the first time.

What is claimed is: 
     
       1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
 initiate a virtual assistant session responsive to receiving user input; 
 determine whether the user input is of a first type or of a second type; 
 in accordance with a determination that the user input is of the first type:
 determine, based on first data obtained using one or more sensors of the electronic device, whether one or more criteria representing expressed user disinterest are satisfied; and 
 in accordance with determining that the one or more criteria representing expressed user disinterest are satisfied prior to a first time, automatically deactivate the virtual assistant session prior to the first time, wherein the first time is defined by a setting of the electronic device; and 
 
 in accordance with a determination that the user input is of the second type:
 determine, based on second data obtained using the one or more sensors of the electronic device, whether one or more criteria representing expressed user engagement are satisfied; and 
 in accordance with determining that the one or more criteria representing expressed user engagement are satisfied prior to a second time, forgo deactivating the virtual assistant session at the second time, wherein the second time is a predetermined duration after a third time at which a final result for the virtual assistant session is presented. 
 
 
     
     
       2. The non-transitory computer readable storage medium of  claim 1 , wherein the first type of user input includes input received via a physical button on the electronic device or via a virtual button on the electronic device. 
     
     
       3. The non-transitory computer readable storage medium of  claim 1 , wherein the second type of user input includes input received from an external electronic device or audio input. 
     
     
       4. The non-transitory computer readable storage medium of  claim 1 , wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the electronic device to:
 in accordance with a determination that the user input is of the first type:
 in accordance with determining that the one or more criteria representing expressed user disinterest are not satisfied prior to the first time, automatically deactivate the virtual assistant session at the first time. 
 
 
     
     
       5. The non-transitory computer readable storage medium of  claim 1 , wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the electronic device to:
 in accordance with a determination that the user input is of the second type:
 in accordance with determining that the one or more criteria representing expressed user engagement are not satisfied prior to the second time, deactivate the virtual assistant session at the second time. 
 
 
     
     
       6. The non-transitory computer readable storage medium of  claim 1 , wherein the setting of the electronic device includes a user configurable setting associated with a screen lock time or a screen dimming time. 
     
     
       7. The non-transitory computer readable storage medium of  claim 1 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that a direction of a user gaze is not directed to the electronic device. 
     
     
       8. The non-transitory computer readable storage medium of  claim 1 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes determining that a direction of a user gaze is directed to the electronic device. 
     
     
       9. The non-transitory computer readable storage medium of  claim 1 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that the electronic device is facing down. 
     
     
       10. The non-transitory computer readable storage medium of  claim 1 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that the electronic device is in an enclosed space. 
     
     
       11. The non-transitory computer readable storage medium of  claim 1 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes detecting a touch on a button or on a screen of the electronic device. 
     
     
       12. The non-transitory computer readable storage medium of  claim 1 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes determining a raising of the electronic device. 
     
     
       13. The non-transitory computer readable storage medium of  claim 1 , wherein the one or more programs further comprise instructions, which when executed by the one or more processors, cause the electronic device to:
 determine whether a predetermined application is executing when the user input is received; 
 in accordance with a determination that the user input is of the first type:
 in accordance with a determination that the predetermined application is executing when the user input is received, deactivate the virtual assistant session a second predetermined duration after a fourth time associated with a presentation of a second final result for the virtual assistant session; and 
 
 in accordance with a determination that the user input is of the second type:
 in accordance with a determination that the predetermined application is executing when the user input is received, deactivate the virtual assistant session a third predetermined duration after the third time. 
 
 
     
     
       14. The non-transitory computer readable storage medium of  claim 1 , wherein:
 a second final result for the virtual assistant session is presented at a fourth time; and 
 determining whether the one or more criteria representing expressed user disinterest are satisfied is performed after the fourth time. 
 
     
     
       15. The non-transitory computer readable storage medium of  claim 1 , wherein:
 initiating the virtual assistant session includes displaying a user interface associated with the virtual assistant session. 
 
     
     
       16. The non-transitory computer readable storage medium of  claim 15 , wherein:
 automatically deactivating the virtual assistant session prior to the first time includes ceasing the display of the user interface associated with the virtual assistant session; and 
 forgoing deactivating the virtual assistant session at the second time includes continuing to display the user interface associated with the virtual assistant session. 
 
     
     
       17. An electronic device, comprising:
 one or more processors; 
 a memory; and 
 one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
 initiating a virtual assistant session responsive to receiving user input; 
 determining whether the user input is of a first type or of a second type; 
 in accordance with a determination that the user input is of the first type:
 determining, based on first data obtained using one or more sensors of the electronic device, whether one or more criteria representing expressed user disinterest are satisfied; and 
 in accordance with determining that the one or more criteria representing expressed user disinterest are satisfied prior to a first time, automatically deactivating the virtual assistant session prior to the first time, wherein the first time is defined by a setting of the electronic device; and 
 
 in accordance with a determination that the user input is of the second type:
 determining, based on second data obtained using the one or more sensors of the electronic device, whether one or more criteria representing expressed user engagement are satisfied; and 
 in accordance with determining that the one or more criteria representing expressed user engagement are satisfied prior to a second time, forgoing deactivating the virtual assistant session at the second time, wherein the second time is a predetermined duration after a third time at which a final result for the virtual assistant session is presented. 
 
 
 
     
     
       18. The electronic device of  claim 17 , wherein the first type of user input includes input received via a physical button on the electronic device or via a virtual button on the electronic device. 
     
     
       19. The electronic device of  claim 17 , wherein the second type of user input includes input received from an external electronic device or audio input. 
     
     
       20. The electronic device of  claim 17 , wherein the one or more programs further include instructions for:
 in accordance with a determination that the user input is of the first type:
 in accordance with determining that the one or more criteria representing expressed user disinterest are not satisfied prior to the first time, automatically deactivating the virtual assistant session at the first time. 
 
 
     
     
       21. The electronic device of  claim 17 , wherein the one or more programs further include instructions for:
 in accordance with a determination that the user input is of the second type:
 in accordance with determining that the one or more criteria representing expressed user engagement are not satisfied prior to the second time, deactivating the virtual assistant session at the second time. 
 
 
     
     
       22. The electronic device of  claim 17 , wherein the setting of the electronic device includes a user configurable setting associated with a screen lock time or a screen dimming time. 
     
     
       23. The electronic device of  claim 17 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that a direction of a user gaze is not directed to the electronic device. 
     
     
       24. The electronic device of  claim 17 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes determining that a direction of a user gaze is directed to the electronic device. 
     
     
       25. The electronic device of  claim 17 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that the electronic device is facing down. 
     
     
       26. The electronic device of  claim 17 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that the electronic device is in an enclosed space. 
     
     
       27. The electronic device of  claim 17 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes detecting a touch on a button or on a screen of the electronic device. 
     
     
       28. The electronic device of  claim 17 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes determining a raising of the electronic device. 
     
     
       29. The electronic device of  claim 17 , wherein the one or more programs further include instructions for:
 determining whether a predetermined application is executing when the user input is received; 
 in accordance with a determination that the user input is of the first type:
 in accordance with a determination that the predetermined application is executing when the user input is received, deactivating the virtual assistant session a second predetermined duration after a fourth time associated with a presentation of a second final result for the virtual assistant session; and 
 
 in accordance with a determination that the user input is of the second type:
 in accordance with a determination that the predetermined application is executing when the user input is received, deactivating the virtual assistant session a third predetermined duration after the third time. 
 
 
     
     
       30. The electronic device of  claim 17 , wherein:
 a second final result for the virtual assistant session is presented at a fourth time; and 
 determining whether the one or more criteria representing expressed user disinterest are satisfied is performed after the fourth time. 
 
     
     
       31. The electronic device of  claim 17 , wherein:
 initiating the virtual assistant session includes displaying a user interface associated with the virtual assistant session. 
 
     
     
       32. The electronic device of  claim 31 , wherein:
 automatically deactivating the virtual assistant session prior to the first time includes ceasing the display of the user interface associated with the virtual assistant session; and 
 forgoing deactivating the virtual assistant session at the second time includes continuing to display the user interface associated with the virtual assistant session. 
 
     
     
       33. A method for operating a virtual assistant, the method comprising:
 at an electronic device:
 initiating a virtual assistant session responsive to receiving user input; 
 determining whether the user input is of a first type or of a second type; 
 in accordance with a determination that the user input is of the first type:
 determining, based on first data obtained using one or more sensors of the electronic device, whether one or more criteria representing expressed user disinterest are satisfied; and 
 in accordance with determining that the one or more criteria representing expressed user disinterest are satisfied prior to a first time, automatically deactivating the virtual assistant session prior to the first time, wherein the first time is defined by a setting of the electronic device; and 
 
 in accordance with a determination that the user input is of the second type:
 determining, based on second data obtained using the one or more sensors of the electronic device, whether one or more criteria representing expressed user engagement are satisfied; and 
 in accordance with determining that the one or more criteria representing expressed user engagement are satisfied prior to a second time, forgoing deactivating the virtual assistant session at the second time, wherein the second time is a predetermined duration after a third time at which a final result for the virtual assistant session is presented. 
 
 
 
     
     
       34. The method of  claim 33 , wherein the first type of user input includes input received via a physical button on the electronic device or via a virtual button on the electronic device. 
     
     
       35. The method of  claim 33 , wherein the second type of user input includes input received from an external electronic device or audio input. 
     
     
       36. The method of  claim 33 , further comprising:
 in accordance with a determination that the user input is of the first type:
 in accordance with determining that the one or more criteria representing expressed user disinterest are not satisfied prior to the first time, automatically deactivating the virtual assistant session at the first time. 
 
 
     
     
       37. The method of  claim 33 , further comprising:
 in accordance with a determination that the user input is of the second type:
 in accordance with determining that the one or more criteria representing expressed user engagement are not satisfied prior to the second time, deactivating the virtual assistant session at the second time. 
 
 
     
     
       38. The method of  claim 33 , wherein the setting of the electronic device includes a user configurable setting associated with a screen lock time or a screen dimming time. 
     
     
       39. The method of  claim 33 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that a direction of a user gaze is not directed to the electronic device. 
     
     
       40. The method of  claim 33 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes determining that a direction of a user gaze is directed to the electronic device. 
     
     
       41. The method of  claim 33 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that the electronic device is facing down. 
     
     
       42. The method of  claim 33 , wherein determining that the one or more criteria representing expressed user disinterest are satisfied includes determining that the electronic device is in an enclosed space. 
     
     
       43. The method of  claim 33 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes detecting a touch on a button or on a screen of the electronic device. 
     
     
       44. The method of  claim 33 , wherein determining that the one or more criteria representing expressed user engagement are satisfied includes determining a raising of the electronic device. 
     
     
       45. The method of  claim 33 , further comprising:
 determining whether a predetermined application is executing when the user input is received; 
 in accordance with a determination that the user input is of the first type:
 in accordance with a determination that the predetermined application is executing when the user input is received, deactivating the virtual assistant session a second predetermined duration after a fourth time associated with a presentation of a second final result for the virtual assistant session; and 
 
 in accordance with a determination that the user input is of the second type:
 in accordance with a determination that the predetermined application is executing when the user input is received, deactivating the virtual assistant session a third predetermined duration after the third time. 
 
 
     
     
       46. The method of  claim 33 , wherein:
 a second final result for the virtual assistant session is presented at a fourth time; and 
 determining whether the one or more criteria representing expressed user disinterest are satisfied is performed after the fourth time. 
 
     
     
       47. The method of  claim 33 , wherein:
 initiating the virtual assistant session includes displaying a user interface associated with the virtual assistant session. 
 
     
     
       48. The method of  claim 47 , wherein:
 automatically deactivating the virtual assistant session prior to the first time includes ceasing the display of the user interface associated with the virtual assistant session; and 
 forgoing deactivating the virtual assistant session at the second time includes continuing to display the user interface associated with the virtual assistant session.