USRE48423EActiveUtility

Display apparatus, electronic device, interactive system, and controlling methods thereof

91
Assignee: SAMSUNG ELECTRONICS CO LTDPriority: Jun 29, 2012Filed: Nov 2, 2018Granted: Feb 2, 2021
Est. expiryJun 29, 2032(~6 yrs left)· nominal 20-yr term from priority
H04N 21/42203H04N 21/42221G08C 19/28H04N 21/42222H04Q 9/00G10L 15/00
91
PatentIndex Score
5
Cited by
38
References
40
Claims

Abstract

A display apparatus, an electronic device, an interactive system, and controlling methods thereof are provided. The display apparatus includes: a storage unit which stores peripheral device control information in which a remote control signal for controlling a peripheral device of the display apparatus matches with a control signal corresponding to a user voice; a voice collector which the user voice; a communicator which transmits the collected user voice to the display apparatus and receives the control signal corresponding to the user voice from the display apparatus; an infrared ray (IR) transmitter which transmits the remote control signal for controlling the peripheral device; and a controller which, if the control signal is received from the display apparatus, controls the IR transmitter to transmit a remote control signal corresponding to the received control signal among remote control signals stored in the storage unit, to the peripheral device.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. An electronic device which communicates with a display apparatus, the electronic device comprising:
 a storage which stores peripheral device control information, said peripheral device control information being related to a remote control signal for controlling a peripheral device of the display apparatus that matches with a control signal corresponding to a user voice;   a voice collector which collects the user voice;   a communicator which transmits the collected user voice to the display apparatus and receives the control signal corresponding to the user voice from the display apparatus;   an infrared ray (IR) transmitter which transmits the remote control signal for controlling the peripheral device; and   a controller which, if the control signal is received from the display apparatus, controls the IR transmitter to transmit the remote control signal corresponding to the received control signal among remote control signals stored in the storage unit, to the peripheral device.   
     
     
       2. The electronic device of  claim 1 , further comprising:
 an IR receiver which receives the remote control signal from a remote controller which controls the peripheral device of the display apparatus,   wherein the controller transmits the collected user voice to the display apparatus in response to the received remote control signal and receives the control signal corresponding to the user voice from the display apparatus to generate the peripheral device control information.   
     
     
       3. The electronic device of  claim 1 , wherein:
 the peripheral device control information further comprises information about a received external input mode;   the communicator receives the control signal and the information about the external input mode of the display apparatus; and   if the control signal and the information about the external input mode are received from the display apparatus, the controller controls the IR transmitter to transmit the remote control signal corresponding to the received control signal and the external input mode to the peripheral device.   
     
     
       4. The electronic device of  claim 3 , further comprising:
 an IR receiver which receives the remote control signal from a remote controller which controls the peripheral device of the display apparatus,   wherein the controller transmits the collected user voice to the display apparatus in response to the remote control signal and receives the control signal corresponding to the user voice and the information about the external input mode of the display apparatus from the display apparatus to generate the peripheral device control information.   
     
     
       5. The electronic device of  claim 1 , wherein the electronic device is one from among an IR blaster and a multiband remote controller (MBR). 
     
     
       6. A display apparatus which communicates with a first device which is to control a second device, the display apparatus comprising:
 a first communicator which communicates with the first device;   a second communicator which communicates with a server which performs a voice recognition function; and   a controller which, if a user voice is received from the first device, transmits the received user voice to the server, receives a control signal corresponding to the user voice from the server, and transmits the control signal to the first device,   wherein the control signal is a signal which corresponds to a remote control signal for controlling the second device in the electronic device.   
     
     
       7. The display apparatus of  claim 6 , wherein if the user voice is received, the controller controls to determine an external input mode, transmits information about the determined external input mode and the user voice to the server, receives the information about the external input mode and a control signal corresponding to the user voice from the server, and transmits the information about the external input mode and the control signal to the first device. 
     
     
       8. The display apparatus of  claim 6 , wherein if the user voice is received, the controller controls to determine an external input mode and transmit information about the determined external input mode and the control signal received from the server to another server. 
     
     
       9. The display apparatus of  claim 6 , wherein the first device is an electronic device and the second device is a peripheral device of the display apparatus. 
     
     
       10. A method of controlling a first device, the method comprising:
 storing second device control information in which a remote control signal for controlling a second device of a display apparatus matches with a control signal corresponding to a user voice;   collecting a user voice;   transmitting the collected user voice to the display apparatus;   receiving the control signal corresponding to the user voice from the display apparatus; and   transmitting one of pre-stored remote control signals corresponding to the received control signal to the second device.   
     
     
       11. The method of  claim 10 , wherein the storing of the second device control information comprises:
 receiving the remote control signal from a remote controller which controls the second device of the display apparatus;   collecting the user voice in response to the remote control signal;   transmitting the collected user voice to the display apparatus;   receiving the control signal corresponding to the user voice from the display apparatus; and   generating and storing the second device control information in which the received remote control signal and the control signal match with each other.   
     
     
       12. The method of  claim 10 , wherein:
 the second device control information further comprises information about an external input mode;   the reception of the control signal comprises receiving the control signal and information about the external input mode of the display apparatus; and   the transmission of the one of the pre-stored remote control signals to the second device comprises transmitting the received control signal and the remote control signal corresponding to the information about the external input mode, to the second device.   
     
     
       13. The method of  claim 12 , wherein the storing of the second device control information comprises:
 receiving the remote control signal from the remote controller which controls the second device of the display apparatus;   collecting the user voice in response to the remote control signal;   transmitting the collected user voice to the display apparatus;   receiving the control signal corresponding to the user voice and the information about the external input mode of the display apparatus from the display apparatus; and   generating and storing the second device control information in which the received remote control signal, the control signal, and the information about the external input mode match with one another.   
     
     
       14. The method of  claim 10 , wherein the electronic device is one of an infrared ray (IR) blaster and a multiband remote controller (MBR). 
     
     
       15. A method of controlling a display apparatus which communicates with a first device which is to control a second device, the method comprising:
 receiving a user voice from the first device;   transmitting the received user voice to a server which performs a voice recognition function;   receiving a control signal corresponding to the user voice from the server; and   transmitting the received control signal to the first device,   wherein the control signal is a signal in the first device which corresponds to a remote control signal which controls the second device.   
     
     
       16. The method of  claim 15 , further comprising:
 if the user voice is received, determining an external input mode; and   transmitting information about the external input mode,   wherein the receiving of the control signal comprises receiving the information related to the external input mode and the control signal corresponding to the user voice from the server.   
     
     
       17. The method of  claim 15 , further comprising:
 if the user voice is received, determining an external input mode; and   transmitting information about the determined external input mode to the first device.   
     
     
       18. The method of  claim 15 , wherein the first device is an electronic device and the second device is a peripheral device of the display apparatus. 
     
     
       19. An interactive system comprising a display apparatus and a first device which is to control a second device of the display apparatus,
 wherein:   the first device transmits a collected user voice to the display apparatus, receives a control signal corresponding to the user voice, and transmits one of pre-stored remote control signals corresponding to the received control signal to the second device; and   the display apparatus transmits the user voice to a server which performs a voice recognition function if the display apparatus receives the user voice from the first device, receives the control signal corresponding to the user voice from the server, and transmits the control signal to the first device.   
     
     
       20. The interactive system of  claim 19 , wherein the first device is an electronic device and the second device is a peripheral device of the display apparatus. 
     
     
       21. A display apparatus which is operable to communicate with a first device, comprising:
 a first communicator;   a second communicator;   a controller configured to:
 based on a user voice input received from the first device through the first communicator, control the second communicator to transmit a first signal corresponding to the user voice input to an external server, 
 based on response information, corresponding to the user voice input, received from the external server, obtain control command information corresponding to the user voice input for controlling a second device, and 
 control the first communicator to transmit a second signal corresponding to the obtained control command information to the first device, which when received by the first device using a first communication method, causes the first device to transmit a control command for controlling the second device, corresponding to the second signal, to the second device using a second communication method, 
   wherein the second communication method of the first device is different from the first communication method of the first device.   
     
     
       22. The display apparatus as claimed in claim 21, wherein the first communication method is based on at least one of Wifi, Bluetooth, Infrared Data Association (IRDA), Radio Frequency (RF), IEEE 802.11, WLAN, HR WPAN, UWB, LR WPAN, and IEEE 1394. 
     
     
       23. The display apparatus as claimed in claim 21, wherein the second communication method is Infrared Ray (IR) communication. 
     
     
       24. The display apparatus as claimed in claim 21, wherein:
 the external server comprises a first server and a second server; and   the controller is configured to control the second communicator to transmit the first signal according to the user voice input to the first server, receive text information to which the user voice input is converted from the first server, transmit the received text information to the second server, and receive the response information corresponding to the text information from the second server.   
     
     
       25. The display apparatus as claimed in claim 21, wherein:
 the first device is a remote controller for controlling the display apparatus; and   the second signal is a control signal matching with a remote control signal for controlling the second device.   
     
     
       26. The display apparatus as claimed in claim 21, wherein the response information is transmitted by the external server based on a voice recognition performed associated with the user voice input. 
     
     
       27. The display apparatus as claimed in claim 21, wherein the controller is configured to, based on the user voice input being received, identify an external input mode, control the second communicator to transmit information regarding the identified external input mode to the external server along with the first signal, and receive the information regarding the external input mode and the response information from the external server, and control the first communicator to transmit the received information regarding the external input mode and the control command information to the first device. 
     
     
       28. The display apparatus as claimed in claim 21, wherein the controller is configured to control the first communicator to, based on the user voice input being received, transmit information regarding an external input mode of the display apparatus to the first device along with the control command information. 
     
     
       29. A method for allowing a first device for controlling a display apparatus to control a second device, the method comprising:
 receiving, from the first device by the display apparatus using a first communication method, a user voice input for controlling the second device;   transmitting, to an external server by the display apparatus, a first signal corresponding to the user voice input;   based on response information, corresponding to the user voice input, received from the external server, obtaining control command information corresponding to the user voice input for controlling the second device; and   transmitting, to the first device by the display apparatus using the first communication method, a second signal corresponding to the obtained control command information, which when received by the first device using the first communication method, causes the first device to transmit a control command for controlling the second device, corresponding to the second signal to the second device using a second communication method,   wherein the second communication method of the first device is different from the first communication method of the first device.   
     
     
       30. The method as claimed in claim 29, further comprising:
 receiving, from the external server by the display apparatus, the control command information corresponding to the user voice input for controlling the second device.   
     
     
       31. The method as claimed in claim 29, wherein the first communication method is based on at least one of Wifi, Bluetooth, Infrared Data Association (IRDA), Radio Frequency (RF), IEEE 802.11, WLAN, HR WPAN, UWB, LR WPAN, and IEEE 1394. 
     
     
       32. The method as claimed in claim 29, wherein the second communication method is Infrared Ray (IR) communication. 
     
     
       33. The method as claimed in claim 29, wherein:
 the external server comprises a first server and a second server; and   the method further comprises:
 transmitting, by the display apparatus, the first signal according to the user voice input to the first server; 
 receiving, by the display apparatus from the first server, text information, to which the user voice input is converted; 
 transmitting, by the display apparatus, the received text information to the second server; and 
 receiving, by the display apparatus, the response information corresponding to the text information from the second server. 
   
     
     
       34. The method as claimed in claim 29 wherein:
 the first device is a remote controller for controlling the display apparatus; and   the second signal is a control signal matching with a remote control signal for controlling the second device.   
     
     
       35. The method as claimed in claim 29, wherein the response information is transmitted by the external server based on a voice recognition performed associated with the user voice input. 
     
     
       36. The method as claimed in claim 29, further comprising:
 based on the user voice input being received, transmitting, by the display apparatus to the external server, information regarding an external input mode of the display apparatus,   receiving, by the display apparatus from the external server, the information regarding the external input mode and the response information for controlling the second device.   
     
     
       37. The method as claimed in claim 29, further comprising:
 based on the user voice input being received, transmitting, by the display apparatus to the first device, information regarding an external input mode of the display apparatus.   
     
     
       38. A display system comprising:
 a first device; and   a display apparatus comprising:
 a first communicator configured to communicate with the first device; 
 a second communicator; 
 a controller configured to:
 based on a user voice input received from the first device through the first communicator, control the second communicator to transmit a first signal corresponding to the user voice input to an external server, 
 based on response information, corresponding to the user voice input, received from the external server, obtain control command information corresponding to the user voice input for controlling a second device, and 
 control the first communicator to transmit a second signal corresponding to the obtained control command information to the first device, 
 
   wherein, based on the second signal received by the first device using a first communication method, the first device is configured to transmit a control command for controlling the second device, corresponding to the second signal, to the second device using a second communication method, and   wherein the second communication method of the first device is different from the first communication method of the first device.   
     
     
       39. The display system as claimed in claim 38, wherein:
 the first device is a remote controller for controlling the display apparatus; and   the second signal is a control signal matching with a remote control signal for controlling the second device.   
     
     
       40. The display system as claimed in claim 38, wherein the first communication method is Bluetooth communication and the second communication method is IR communication.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.