System and method for dynamic robot configuration for enhanced digital experiences

Abstract

The present teaching relates to method, system, medium, and implementations for configuring an animatronic device. Information is received about performance of a user exhibited in a dialogue between the user and an animatronic device which conducts the dialogue with the user in accordance with a configuration. The effectiveness of the configuration with respect to the user is assessed based on the information about the performance of the user and is used for machine learning at least one model, which is then used to adjust the configuration to generate an updated configuration for the animatronic device to use to continue the dialogue.

We claim: 
     
         1 . A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for human machine dialogue management, comprising:
 detecting presence of a user to be engaged in a human machine dialogue with the animatronic device in a dialogue scene;   selecting a first program, from a plurality of programs, based on a registration status of the user;   selecting a second program, from the plurality of programs, based on an observation with respect to the user in the dialogue scene; and   determining a program to be used by the animatronic device to drive the human machine dialogue with the user based on the first program and the second program.   
     
     
         2 . The method of  claim 1 , wherein the step of selecting the first program comprises:
 determining whether the user is pre-registered with one or more programs of the plurality of programs;   selecting, if the user is pre-registered, one of the one or more programs as the first program; and   selecting, if the user is not pre-registered, one of the plurality of programs for a new user as the first program.   
     
     
         3 . The method of  claim 1 , wherein the step of selecting the second program comprises:
 obtaining sensor data capturing the user and a surrounding thereof in the dialogue scene;   analyzing the sensor data to determine
 a state of the user based on information captured by the sensor data about the user, and 
 an environment around the user in the surrounding captured by the sensor data; and 
   determining the second program based on the state of the user and the environment around the user.   
     
     
         4 . The method of  claim 1 , wherein the step of determining the program comprises:
 determining, when the first and the second programs are consistent, the program to be one of the first and the second programs based on confidence scores associated with the first and the second programs;   resolving, when the first and the second programs are not consistent, a discrepancy between the first and the second programs based on a program progression model.   
     
     
         5 . The method of  claim 4 , wherein the step of resolving the discrepancy comprises:
 accessing the program progression model that specifies one or more rules on priorities of the plurality of programs; and   determining the program to be the first program or the second program based on their respective priorities according to the program progression model.   
     
     
         6 . The method of  claim 4 , wherein the step of resolving the discrepancy comprises:
 accessing the program progression model that specifies one or more schemes to combine different programs;   selecting one of the one or more schemes; and   combining the first and the second programs to form the program in accordance with the program progression model.   
     
     
         7 . The method of  claim 1 , further comprising
 monitoring interactions of the user with the animatronic device and/or the dialogue scene;   analyzing the interactions to assess performance of the user with respect to an intended goal of the program; and   adjusting the program based on the performance of the user.   
     
     
         8 . Machine readable and non-transitory medium having information recorded thereon for human machine dialogue management, wherein the information, when read by the machine, causes the machine to perform the following steps:
 detecting presence of a user to be engaged in a human machine dialogue with the animatronic device in a dialogue scene;   selecting a first program, from a plurality of programs, based on a registration status of the user;   selecting a second program, from the plurality of programs, based on an observation with respect to the user in the dialogue scene; and   determining a program to be used by the animatronic device to drive the human machine dialogue with the user based on the first program and the second program.   
     
     
         9 . The medium of  claim 8 , wherein the step of selecting the first program comprises:
 determining whether the user is pre-registered with one or more programs of the plurality of programs;   selecting, if the user is pre-registered, one of the one or more programs as the first program; and   selecting, if the user is not pre-registered, one of the plurality of programs for a new user as the first program.   
     
     
         10 . The medium of  claim 8 , wherein the step of selecting the second program comprises:
 obtaining sensor data capturing the user and a surrounding thereof in the dialogue scene;   analyzing the sensor data to determine
 a state of the user based on information captured by the sensor data about the user, and 
 an environment around the user in the surrounding captured by the sensor data; and 
   determining the second program based on the state of the user and the environment around the user.   
     
     
         11 . The medium of  claim 8 , wherein the step of determining the program comprises:
 determining, when the first and the second programs are consistent, the program to be one of the first and the second programs based on confidence scores associated with the first and the second programs;   resolving, when the first and the second programs are not consistent, a discrepancy between the first and the second programs based on a program progression model.   
     
     
         12 . The medium of  claim 11 , wherein the step of resolving the discrepancy comprises:
 accessing the program progression model that specifies one or more rules on priorities of the plurality of programs; and   determining the program to be the first program or the second program based on their respective priorities according to the program progression model.   
     
     
         13 . The medium of  claim 11 , wherein the step of resolving the discrepancy comprises:
 accessing the program progression model that specifies one or more schemes to combine different programs;   selecting one of the one or more schemes; and   combining the first and the second programs to form the program in accordance with the program progression model.   
     
     
         14 . The medium of  claim 8 , wherein the information, when read by the machine, further causes the machine to perform the following steps:
 monitoring interactions of the user with the animatronic device and/or the dialogue scene;   analyzing the interactions to assess performance of the user with respect to an intended goal of the program; and   adjusting the program based on the performance of the user.   
     
     
         15 . A system for human machine dialogue management, comprising:
 a presence detector implemented by a processor and configured for detecting presence of a user to be engaged in a human machine dialogue with the animatronic device in a dialogue scene;   a user registration based program selector implemented by a processor and configured for selecting a first program, from a plurality of programs, based on a registration status of the user;   a sensor information based program selector implemented by a processor and configured for selecting a second program, from the plurality of programs, based on an observation with respect to the user in the dialogue scene; and   a program adjuster implemented by a processor and configured for determining a program to be used by the animatronic device to drive the human machine dialogue with the user based on the first program and the second program.   
     
     
         16 . The system of  claim 15 , wherein the step of selecting the first program comprises:
 determining whether the user is pre-registered with one or more programs of the plurality of programs;   selecting, if the user is pre-registered, one of the one or more programs as the first program; and   selecting, if the user is not pre-registered, one of the plurality of programs for a new user as the first program.   
     
     
         17 . The system of  claim 15 , wherein the step of selecting the second program comprises:
 obtaining sensor data capturing the user and a surrounding thereof in the dialogue scene;   analyzing the sensor data to determine
 a state of the user based on information captured by the sensor data about the user, and 
 an environment around the user in the surrounding captured by the sensor data; and 
   determining the second program based on the state of the user and the environment around the user.   
     
     
         18 . The system of  claim 15 , wherein the step of determining the program comprises:
 determining, when the first and the second programs are consistent, the program to be one of the first and the second programs based on confidence scores associated with the first and the second programs;   resolving, when the first and the second programs are not consistent, a discrepancy between the first and the second programs based on a program progression model.   
     
     
         19 . The system of  claim 4 , wherein the step of resolving the discrepancy comprises:
 accessing the program progression model that specifies one or more rules on priorities of the plurality of programs; and   determining the program to be the first program or the second program based on their respective priorities according to the program progression model.   
     
     
         20 . The system of  claim 19 , wherein the step of resolving the discrepancy comprises:
 accessing the program progression model that specifies one or more schemes to combine different programs;   selecting one of the one or more schemes; and   combining the first and the second programs to form the program in accordance with the program progression model.   
     
     
         21 . The system of  claim 1 , further comprising
 an interaction analyzer implemented by a processor and configured for
 monitoring interactions of the user with the animatronic device and/or the dialogue scene, and 
 analyzing the interactions to assess performance of the user with respect to an intended goal of the program; and 
   the program adjuster is further configured for adjusting the program based on the performance of the user.