Method, system, and device for interfacing with a component in a plurality of interaction modes

Abstract

The present application discloses a method, device, and system for interfacing with a component in a plurality of interaction modes. The method includes obtaining an input, determining that the input corresponds to an interaction event in a first interaction mode, the first interaction mode being a non-touch interaction mode, determining a component corresponding to the interaction event based at least in part on registration information for the first interaction mode, wherein the component is mapped to a plurality of interaction events for a plurality of interaction modes, and performing a response operation based at least in part on the registration information associated with the component and the interaction event.

What is claimed is: 
     
         1 . A method, comprising:
 obtaining, by a terminal, an input; determining a context of the terminal with respect to which the input is obtained;   determining, by the terminal, that the input corresponds to an interaction event in a first interaction mode based at least in part on the context and a mapping of interaction events to interaction modes, the first interaction mode being a non-touch interaction mode;   determining, by the terminal, a component and an application corresponding to the interaction event based at least in part on registration information for the first interaction mode, wherein the component is mapped to a plurality of interaction events for a plurality of interaction modes; and   performing a response operation based at least in part on the registration information associated with the component and the interaction event.   
     
     
         2 . The method of  claim 1 , wherein the context of the terminal includes one or more of (i) applications, (ii) processes, (iii) functions, (iv) interfaces, and (v) web services. 
     
     
         3 . The method of  claim 1 , wherein the component corresponds to an element provided on a graphical user interface displayed by the terminal. 
     
     
         4 . The method of  claim 3 , wherein the element is one or more of: a button, a hyperlink, an image, a set of text information, and/or an icon. 
     
     
         5 . The method of  claim 1 , further comprising:
 obtaining the registration information associated with the component, wherein the registration information comprises the interaction event and an identifier corresponding to the component; and   storing the registration information.   
     
     
         6 . The method of  claim 5 , wherein storing the registration information comprises:
 storing a mapping of the identifier associated with the component corresponding to the interaction event; and   registering the interaction event with an interaction engine associated with the first interaction mode.   
     
     
         7 . The method of  claim 1 , wherein the first interaction mode includes a voice interaction mode, and the interaction event comprises: speech information corresponding to the component. 
     
     
         8 . The method of  claim 7 , wherein the speech information corresponds to text information displayed in relation to the component, or the speech information corresponds to predefined text information that is mapped to the component. 
     
     
         9 . The method of  claim 1 , wherein the first interaction mode includes a gesture interaction mode, and the interaction event comprises: set gesture features. 
     
     
         10 . The method of  claim 1 , wherein a determination that the input corresponds to the interaction event in the first interaction mode is based at least in part on the registration information associated with the first interaction mode. 
     
     
         11 . The method of  claim 10 , wherein the input is determined to correspond to the interaction event in response to a determination that the registration information associated with the first interaction mode comprises a type of the input or one or more characteristics associated with the input. 
     
     
         12 . The method of  claim 10 , further comprising: determining that the input corresponds to the first interaction mode based on a type of the input or one or more characteristics associated with the input. 
     
     
         13 . The method of  claim 1 , wherein the determining the component corresponding to the interaction event comprises:
 obtaining the registration information associated with the first interaction mode; and   determining that the registration information comprises a mapping of the component to the first interaction mode.   
     
     
         14 . The method of  claim 1 , wherein the response operation is determined based at least in part on a mapping of the response operation to the component. 
     
     
         15 . The method of  claim 1 , wherein the response operation comprises navigating to a page provided by an application executing on the terminal. 
     
     
         16 . The method of  claim 1 , wherein the response operation comprises obtaining information corresponding to a service provided by an application executing on the terminal. 
     
     
         17 . The method of  claim 1 , wherein the response operation comprises invoking a function. 
     
     
         18 . The method of  claim 1 , wherein the input is determined to be obtained in accordance with the first interaction mode based at least in part on a determination of one or more interactive engines from which a coordination scheduler receives the input. 
     
     
         19 . A device, comprising:
 one or more processors configured to:
 obtain an input; 
 determine a context of the terminal with respect to which the input is obtained; 
 determine that the input corresponds to an interaction event in a first interaction mode based at least in part on the context and a mapping of interaction events to interaction modes, the first interaction mode being a non-touch interaction mode; 
 determine a component and an application corresponding to the interaction event based at least in part on registration information for the first interaction mode, wherein the component is mapped to a plurality of interaction events for a plurality of interaction modes; and 
 perform a response operation based at least in part on the registration information associated with the component and the interaction event; and 
 one or more memories coupled to the one or more processors, configured to provide the one or more processors with instructions. 
   
     
     
         20 . A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
 obtaining, by a terminal, an input;   determining a context of the terminal with respect to which the input is obtained;   determining, by the terminal, that the input corresponds to an interaction event in a first interaction mode based at least in part on the context and a mapping of interaction events to interaction modes, the first interaction mode being a non-touch interaction mode;   determining, by the terminal, a component and an application corresponding to the interaction event based at least in part on registration information for the first interaction mode, wherein the component is mapped to a plurality of interaction events for a plurality of interaction modes; and   performing a response operation based at least in part on the registration information associated with the component and the interaction event.