Generating and/or adapting automated assistant content according to a distance between user(s) and an automated assistant interface

Abstract

Methods, apparatus, systems, and computer-readable media are provided for generating and/or adapting automated assistant content according to a distance of a user relative to an automated assistant interface that renders the automated assistant content. For instance, the automated assistant can provide data for a client device to render. The client device can request additional data when the user relocates closer to, or further from, the client device. In some implementations, a request for additional data can identify a distance between the user and the client device. In this way, the additional data can be generated or selected according to the distance in the request. Other implementations can allow an automated assistant to determine an active user from a group of users in an environment, and determine a distance between the active user and the client device in order that any rendered content can be tailored for the active user.

We claim: 
     
       1. A method implemented by one or more processors, the method comprising:
 receiving a request to perform one or more actions using an automated assistant of a client device; 
 determining that a user, from a plurality of users in an environment with the client device, provided the request and that the user is a current active user of the client device; 
 in response to determining the user is the current active user of the automated assistant of the client device, determining a distance of the user relative to a display of the client device; 
 selecting, from a plurality of content items corresponding to the one or more actions and based on the determined distance of the user relative to the display of the client device, a subset of the plurality of content items, where one or more further content items of the plurality of content items are excluded from the subset; and 
 causing the client device to render output at the display based on the selected subset of content items corresponding to the one or more actions. 
 
     
     
       2. The method of  claim 1 , wherein determining the distance of the user relative to the display of the client device comprises determining the distance of the user, in lieu of one or more additional users of the plurality of users in the environment. 
     
     
       3. The method of  claim 2 , where determining that the user, from the plurality of users in the environment with the client device, provided the request and is the current active user of the client device comprises:
 determining whether the user is the current active user based on one or both of:
 a pose of the user determined based on one or more instances of vision data, and 
 a gaze of the user determined based on the one or more instances of vision data. 
 
 
     
     
       4. The method of  claim 1 , further comprising:
 receiving an additional request to perform one or more additional actions using the automated assistant of the client device; 
 determining that the user provided the additional request and is also the current active user for the additional request; 
 in response to determining that the user is the current active user for the additional request, determining an additional distance of the user relative to the display of the client device; 
 selecting, from a plurality of additional content items corresponding to the one or more additional actions and based on the determined additional distance of the user relative to the display of the client device, an additional subset of the plurality of additional content items, where one or more further additional content items of the plurality of additional content items are excluded from the additional subset; and 
 causing the client device to render output at the display based on the selected additional subset of content items corresponding to the one or more additional actions. 
 
     
     
       5. The method of  claim 4 , wherein the user moved from an initial position when making the request to perform the one or more actions to an additional position when making the additional request to perform the one or more additional actions, wherein the determined distance of the user relative to the display of the client device is based on the initial position of the user, wherein the determined additional distance of the user relative to the display of the client device is based on the additional position of the user. 
     
     
       6. The method of  claim 4 , wherein the user was in a given position when making the request to perform the one or more actions and remained in the given position when making the additional request to perform the one or more additional actions, the determined distance of the user relative to the display of the client device is based on the given position of the user, wherein the determined additional distance of the user relative to the display of the client device is based on the given position of the user. 
     
     
       7. A system comprising:
 one or more processors; and 
 memory configured to store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations that include:
 receiving a request to perform one or more actions using an automated assistant of a client device; 
 determining that a user, from a plurality of users in an environment with the client device, provided the request and that the user is a current active user of the client device; 
 in response to determining the user is the current active user of the automated assistant of the client device, determining a distance of the user relative to a display of the client device; 
 selecting, from a plurality of content items corresponding to the one or more actions and based on the determined distance of the user relative to the display of the client device, a subset of the plurality of content items, where one or more further content items of the plurality of content items are excluded from the subset; and 
 causing the client device to render output at the display based on the selected subset of content items corresponding to the one or more actions. 
 
 
     
     
       8. The system of  claim 7 , wherein determining the distance of the user relative to the display of the client device comprises determining the distance of the user, in lieu of one or more additional users of the plurality of users in the environment. 
     
     
       9. The system of  claim 8 , where determining that the user, from the plurality of users in the environment with the client device, provided the request and is the current active user of the client device comprises:
 determining whether the user is the current active user based on one or both of:
 a pose of the user determined based on one or more instances of vision data, and 
 a gaze of the user determined based on the one or more instances of vision data. 
 
 
     
     
       10. The system of  claim 7 , wherein the operations further include:
 receiving an additional request to perform one or more additional actions using the automated assistant of the client device; 
 determining that the user provided the additional request and is also the current active user for the additional request; 
 in response to determining that the user is the current active user for the additional request, determining an additional distance of the user relative to the display of the client device; 
 selecting, from a plurality of additional content items corresponding to the one or more additional actions and based on the determined additional distance of the user relative to the display of the client device, an additional subset of the plurality of additional content items, where one or more further additional content items of the plurality of additional content items are excluded from the additional subset; and 
 causing the client device to render output at the display based on the selected additional subset of content items corresponding to the one or more additional actions. 
 
     
     
       11. The system of  claim 10 , wherein the user moved from an initial position when making the request to perform the one or more actions to an additional position when making the additional request to perform the one or more additional actions, wherein the determined distance of the user relative to the display of the client device is based on the initial position of the user, wherein the determined additional distance of the user relative to the display of the client device is based on the additional position of the user. 
     
     
       12. The system of  claim 10 , wherein the user was in a given position when making the request to perform the one or more actions and remained in the given position when making the additional request to perform the one or more additional actions, the determined distance of the user relative to the display of the client device is based on the given position of the user, wherein the determined additional distance of the user relative to the display of the client device is based on the given position of the user. 
     
     
       13. A non-transitory computer readable medium configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:
 receiving a request to perform one or more actions using an automated assistant of a client device; 
 determining that a user, from a plurality of users in an environment with the client device, provided the request and that the user is a current active user of the client device; 
 in response to determining the user is the current active user of the automated assistant of the client device, determining a distance of the user relative to a display of the client device; 
 selecting, from a plurality of content items corresponding to the one or more actions and based on the determined distance of the user relative to the display of the client device, a subset of the plurality of content items, where one or more further content items of the plurality of content items are excluded from the subset; and 
 causing the client device to render output at the display based on the selected subset of content items corresponding to the one or more actions. 
 
     
     
       14. The non-transitory computer readable medium of  claim 13 , wherein determining the distance of the user relative to the display of the client device comprises determining the distance of the user, in lieu of one or more additional users of the plurality of users in the environment. 
     
     
       15. The non-transitory computer readable medium of  claim 14 , where determining that the user, from the plurality of users in the environment with the client device, provided the request and is the current active user of the client device comprises:
 determining whether the user is the current active user based on one or both of:
 a pose of the user determined based on one or more instances of vision data, and 
 a gaze of the user determined based on the one or more instances of vision data. 
 
 
     
     
       16. The non-transitory computer readable medium of  claim 13 , wherein the operations further include:
 receiving an additional request to perform one or more additional actions using the automated assistant of the client device; 
 determining that the user provided the additional request and is also the current active user for the additional request; 
 in response to determining that the user is the current active user for the additional request, determining an additional distance of the user relative to the display of the client device; 
 selecting, from a plurality of additional content items corresponding to the one or more additional actions and based on the determined additional distance of the user relative to the display of the client device, an additional subset of the plurality of additional content items, where one or more further additional content items of the plurality of additional content items are excluded from the additional subset; and 
 causing the client device to render output at the display based on the selected additional subset of content items corresponding to the one or more additional actions. 
 
     
     
       17. The non-transitory computer readable medium of  claim 16 , wherein the user moved from an initial position when making the request to perform the one or more actions to an additional position when making the additional request to perform the one or more additional actions, wherein the determined distance of the user relative to the display of the client device is based on the initial position of the user, wherein the determined additional distance of the user relative to the display of the client device is based on the additional position of the user. 
     
     
       18. The non-transitory computer readable medium of  claim 16 , wherein the user was in a given position when making the request to perform the one or more actions and remained in the given position when making the additional request to perform the one or more additional actions, the determined distance of the user relative to the display of the client device is based on the given position of the user, wherein the determined additional distance of the user relative to the display of the client device is based on the given position of the user.