User interface customization based on speaker characteristics

Abstract

Characteristics of a speaker are estimated using speech processing and machine learning. The characteristics of the speaker are used to automatically customize a user interface of a client device for the speaker.

1 . A computer-implemented method comprising:
 selecting, at a client device, a user profile associated with a user interface;   obtaining, at the client device, an audio signal encoding an utterance of a speaker;   providing the audio signal as an input to a neural network;   identifying a particular characteristic that (i) is indicated, based on an output of the neural network, as likely associated with the speaker, and (ii) is associated with at least one person other than the speaker;   determining one or more particular customizations that correspond to the particular characteristic based on customizations for the at least one person other than the speaker; and   customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations.   
     
     
         2 . The method of  claim 1 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises changing a font size of the user interface based on the one or more particular customizations. 
     
     
         3 . The method of  claim 1 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises changing a color scheme of the user interface based on the one or more particular customizations. 
     
     
         4 . The method of  claim 1 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises restricting access to one or more applications on the user interface based on the one or more particular customizations. 
     
     
         5 . The method of  claim 1 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises providing access to one or more applications on the user interface based on the one or more particular customizations. 
     
     
         6 . (canceled) 
     
     
         7 . The method of  claim 1 , wherein selecting, at a client device, a user profile comprises selecting, at a client device, a user profile based on one or more of a password, voice recognition, speech recognition, fingerprint recognition, or facial recognition. 
     
     
         8 . The method of  claim 1 , wherein selecting, at a client device, a user profile comprises selecting, at a client device, a default user profile for the client device. 
     
     
         9 . The method of  claim 1 , wherein the particular characteristic comprises one or more of an age, a gender, an emotion, or an dialect. 
     
     
         10 . (canceled) 
     
     
         11 . The method of  claim 1 , further comprising providing the particular characteristic to a third-party application to allow the third-party application to modify operation of the third-party application using the particular characteristic. 
     
     
         12 . A computer-implemented method comprising:
 obtaining, at a client device, an audio signal encoding an utterance of a speaker;   performing speech recognition, voice recognition, or both on the audio signal to select a user profile associated with a user interface;   providing the audio signal as an input to a neural network;   identifying a particular characteristic that (i) is indicated, based on an output of the neural network, as likely associated with the speaker, and (ii) is associated with at least one person other than the speaker;   determining one or more particular customizations that correspond to the particular characteristic based on customizations for the at least one person other than the speaker; and   customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations.   
     
     
         13 . A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
 selecting, at a client device, a user profile associated with a user interface;   obtaining, at the client device, an audio signal encoding an utterance of a speaker;   providing the audio signal as an input to a neural network;   identifying a particular characteristic that (i) is indicated, based on an output of the neural network, as likely associated with the speaker, and (ii) is associated with at least one person other than the speaker;   determining one or more particular customizations that correspond to the particular characteristic based on customizations for the at least one person other than the speaker; and   customizing, by the client device, the user interface associated with the user profile based on one or more particular customizations.   
     
     
         14 . The computer-readable medium of  claim 13 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises changing a font size of the user interface based on the one or more particular customizations. 
     
     
         15 . The computer-readable medium of  claim 13 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises changing a color scheme of the user interface based on the one or more particular customizations. 
     
     
         16 . The computer-readable medium of  claim 13 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises restricting access to one or more applications on the user interface based on the one or more particular customizations. 
     
     
         17 . The computer-readable medium of  claim 13 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises providing access to one or more applications on the user interface based on the one or more particular customizations. 
     
     
         18 . (canceled) 
     
     
         19 . The computer-readable medium of  claim 13 , wherein selecting, at a client device, a user profile comprises selecting, at a client device, a user profile based on one or more of a password, voice recognition, speech recognition, fingerprint recognition, or facial recognition. 
     
     
         20 . The computer-readable medium of  claim 13 , wherein selecting, at a client device, a user profile comprises selecting, at a client device, a default user profile for the client device. 
     
     
         21 . The method of  claim 1 , wherein customizing, by the client device, the user interface associated with the user profile based on the one or more particular customizations comprises restricting access to one or more features of an application based on the one or more particular customizations. 
     
     
         22 . The method of  claim 21 , wherein restricting access to one or more features of the application based on the one or more particular customizations comprises providing a safe mode operation of the application. 
     
     
         23 . The method of  claim 1 , further comprising disabling, by the client device based on the one or more particular customizations, updating of search logs. 
     
     
         24 . The method of  claim 1 , further comprising disabling, by the client device based on the one or more particular customizations, adaptation of a speaker profile in response to any utterances by the speaker.