Display apparatus for performing voice control and voice controlling method thereof

Abstract

A display apparatus and a voice controlling method thereof are provided. The voice controlling method includes receiving a voice of a user; converting the voice into text; and sequentially changing and applying a plurality of different determination criteria to the text until a control operation corresponding to the text is determined; and performing the determined control operation to control the display apparatus.

What is claimed is: 
     
         1 . A voice controlling method of a display apparatus, the voice controlling method comprising:
 receiving a voice of a user;   converting the voice into text;   determining a control operation corresponding to the text by sequentially applying a plurality of different determination criteria to the text; and   performing the control operation to control the display apparatus,   wherein the plurality of different determination criteria comprise criteria of whether the text corresponds to a title of an object displayed on a screen of the display apparatus, and whether the text corresponds to a stored command, a criterion of whether the text corresponds to a title of an object displayed on a screen of the display apparatus being applied before a criterion of whether the text corresponds to a stored command, and   wherein the determining the control operation comprises:
 determining whether the text corresponds to the title of the object; 
 in response to determining that the text corresponds to the title of the object, determining the control operation based on the object; 
 in response to determining that the text does not correspond to the title of the object, determining whether the text corresponds to the stored command; and 
 in response to determining that the text corresponds to the stored command, determining an operation corresponding to the stored command as the control operation. 
   
     
     
         2 . The voice controlling method of  claim 1 , wherein the determining the control operation based on the object comprises:
 determining an operation corresponding to the object as the control operation.   
     
     
         3 . The voice controlling method of  claim 1 , wherein the determining whether the text corresponds to the title of the object comprises, in response to a part of the title of the object being displayed and the text corresponding to at least a portion of the displayed part of the object, determining that the text corresponds to the title of the object. 
     
     
         4 . The voice controlling method of  claim 1 , wherein the determining whether the text corresponds to the title of the object comprises, in response to only a part of one word included in the title of the object being displayed and the text corresponding to the whole one word, determining that the text corresponds to the title of the object. 
     
     
         5 . The voice controlling method of  claim 1 , wherein the object comprises at least one of a content title, an image title, a text icon, a menu name, and a number that are displayed on the screen. 
     
     
         6 . The voice controlling method of  claim 1 , wherein the stored command comprises at least one of a command for controlling power of the display apparatus, a command for controlling a channel of the display apparatus, and a command for controlling a volume of the display apparatus. 
     
     
         7 . The voice controlling method of  claim 1 , further comprising:
 in response to determining that the text does not correspond to the stored command, determining whether a meaning of the text is analyzable; and   in response to determining that the meaning of the text is analyzable, analyzing the meaning of the text and determining an operation of displaying a response message corresponding to a result of the analyzing as the control command.   
     
     
         8 . The voice controlling method of  claim 7 , further comprising:
 in response to determining that the meaning of the text is not analyzable, determining an operation of a search using the text as a keyword, as the control operation.   
     
     
         9 . The method of  claim 1 , wherein the plurality of different determination criteria further comprise criteria of whether the text is grammatically analyzable, and whether the text refers to a keyword. 
     
     
         10 . A display apparatus comprising:
 a voice input circuit configured to receive a voice of a user;   a voice converter configured to convert the voice into text;   a storage configured to store a plurality of determination criteria that are different from one another; and   a controller configured to determine a control operation corresponding to the text by sequentially applying a plurality of different determination criteria to the text, and perform the control operation,   wherein the plurality of different determination criteria comprise criteria of whether the text corresponds to a title of an object displayed on a screen of the display apparatus, and whether the text corresponds to a stored command, a criterion of whether the text corresponds to a title of an object displayed on a screen of the display apparatus being applied before a criterion of whether the text corresponds to a stored command, and   wherein the controller is further configured to determine whether the text corresponds to the title of the object, determine the control operation based on the object in response to determining that the text corresponds to the title of the object, determine whether the text corresponds to the stored command in response to determining that the text does not correspond to the title of the object, and determine an operation corresponding to the stored command as the control operation in response to determining that the text corresponds to the stored command.   
     
     
         11 . The display apparatus of  claim 10 , wherein the controller is further configured to, in response to determining that the text corresponds to the title of the object, determine an operation corresponding to the object as the control operation. 
     
     
         12 . The display apparatus of  claim 10 , wherein the controller is further configured to, in response to only a part of the title of the object being displayed and determining that the text corresponds to the part of the title of the object being displayed, determine that the text corresponds to the title of the object. 
     
     
         13 . The display apparatus of  claim 10 , wherein the controller is further configured to, in response to only a part of one word included in the title of the object being displayed and determining that the text corresponds to the whole one word, determine that the text corresponds to the title of the object. 
     
     
         14 . The display apparatus of  claim 10 , wherein the object comprises at least one of a content title, an image title, a text icon, a menu name, and a number that are displayed on the screen. 
     
     
         15 . The display apparatus of  claim 10 , wherein the stored command comprises at least one of a command for controlling power of the display apparatus, a command for controlling a channel of the display apparatus, and a command for controlling a volume of the display apparatus. 
     
     
         16 . The display apparatus of  claim 10 , wherein the controller is further configured to, in response to determining that the text does not correspond to the stored command, determine whether a meaning of the text is analyzable, and, in response to determining that the meaning of the text is analyzable, analyze the meaning of the text and determine an operation of displaying a response message corresponding to the analysis result, as the control operation. 
     
     
         17 . The display apparatus of  claim 16 , wherein the controller is further configured to, in response to determining that the meaning of the text is not analyzable, determine an operation of a search using the text as a keyword, as the control operation. 
     
     
       18. A display device comprising:
 a display;   a voice receiving unit configured to receive a voice input from a user; and   at least one processor configured to:
 control the display to display at least one object on a screen of the display; 
 receive, via the voice receiving unit, the voice input while the at least one object is displayed on the screen of the display; 
 obtain text resulting from processing the received voice input; 
 identify an operation of the display device corresponding to the voice input based on whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and whether the obtained text matches any of instructions for controlling the display device; 
 based on identifying that the obtained text corresponds to the text that is displayed on the screen of the display and associated with an object displayed on the screen of the display, control the display to display a content corresponding to the object displayed on the screen of the display. the object including a thumbnail image indicating the content, wherein the text that is displayed on the screen of the display and associated with the object is at least a portion of a title of the content; and 
 based on identifying that the obtained text does not correspond to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and that the obtained text matches an instruction among the instructions for controlling the display device, perform an operation of the display device corresponding to the obtained text by executing the instruction, and control the display to display, on the screen of the display, a user interface indicating a result of performing the operation of the display device corresponding to the obtained text together with the at least one object, 
   wherein the at least one processor is further configured to identify whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object before identifying whether the obtained text matches any of the instructions.   
     
     
       19. The display device of  claim 18 ,
 wherein the at least one processor is further configured to, in response to the obtained text corresponding to the text that is displayed on the screen of the display and associated with the object of the at least one object displayed on the screen of the display obtain first control information for displaying the content irrespective of whether the text matches any of the instructions for controlling the display device.   
     
     
       20. The display device of  claim 19 ,
 wherein the at least one processor is further configured to:   in response to the obtained text not corresponding to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and matching the instruction among the instructions for controlling the display device, obtain second control information for executing the operation.   
     
     
       21. The display device of  claim 20 ,
 wherein the at least one processor is further configured to:   transmit the voice input to a first server connected to the display device; and   receive text corresponding to the transmitted voice input from the first server.   
     
     
       22. The display device of  claim 21 ,
 wherein the first control information and the second control information are obtained from a second server connected to the display device and the first server.   
     
     
       23. The display device of  claim 18 ,
 wherein the display device further comprises a microphone, and   wherein the voice input of the user is received through the microphone.   
     
     
       24. The display device of  claim 18 ,
 wherein the voice input of the user is received from a remote control device for controlling the display device.   
     
     
       25. A method of a display device, comprising:
 displaying at least one object on a screen of a display;   receiving a voice input while the at least one object is displayed on the screen of the display;   obtaining text resulting from processing the received voice input;   identifying an operation of the display device corresponding to the voice input based on whether the obtained text corresponds to text that is displayed on the screen of the display and associated with an object among the at least one object displayed on the screen of the display and whether the obtained text matches any of instructions for controlling the display device;   based on identifying that the obtained text corresponds to the text that is displayed on the screen of the display and associated with the object displayed on the screen of the display, controlling the display to display a content corresponding to the object displayed on the screen of the display, the object including a thumbnail image indicating the content, wherein the text that is displayed on the screen of the display and associated with the object is at least a portion of a title of the content; and   based on identifying that the obtained text does not correspond to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and that the obtained text matches an instruction among the instructions for controlling the display device; performing an operation of the display device corresponding to the obtained text by executing the instruction; and controlling the display to display, on the screen of the display, a user interface indicating a result of performing the operation of the display device corresponding to the obtained text together with the at least one object,   wherein identifying whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object is performed before identifying whether the obtained text matches any of the instructions.   
     
     
       26. The method of  claim 25 ,
 wherein the controlling the display to display the content comprises, in response to the obtained text corresponding to the text that is displayed on the screen of the display and associated with the object of the at least one object displayed on the screen of the display device, obtaining first control information for displaying the content irrespective of whether the text matches any of the instructions for controlling the display device.   
     
     
       27. The method of  claim 26 ,
 wherein the controlling the display to display the content further comprises:   in response to the obtained text not corresponding to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display device and matching the instruction, obtaining second control information for executing the operation.   
     
     
       28. A computer readable medium which includes a program for executing a method of a display device, comprising:
 receiving a voice input while at least one object is displayed on a screen of a display;   obtaining text resulting from processing the received voice input;   identifying an operation of the display device corresponding to the voice input based on whether the obtained text corresponds to text that is displayed on the screen of the display and associated with an object among the at least one object displayed on the screen of the display and whether the obtained text matches any of instructions for controlling the display device;   based on identifying that the obtained text corresponds to the text that is displayed on the screen of the display and associated with the object displayed on the screen of the display, controlling the display to display a content corresponding to the object displayed on the screen of the display, the object including a thumbnail image indicating the content, wherein the text that is displayed on the screen of the display and associated with the object is at least a portion of a title of the content; and   based on identifying that the obtained text does not correspond to text that is displayed on the screen of the display and associated with any of the at least one object displayed on the screen of the display and that the obtained text matches an instruction among the instructions for controlling the display device, performing an operation of the display device corresponding to the obtained text by executing the instruction; and controlling the display to display, on the screen of the display, a user interface indicating a result of performing the operation of the display device corresponding to the obtained text together with the at least one object,   wherein identifying whether the obtained text corresponds to text that is displayed on the screen of the display and associated with any of the at least one object is performed before identifying whether the obtained text matches any of the instructions.