Wearable electronic device controlling noise canceling of external wearable electronic device and method of operating the same

Abstract

According to certain embodiments, an electronic device comprises: at least one display module; at least one communication module; at least one microphone; at least one camera; and a processor, wherein the processor is configured to: capture at least one image through the at least one camera, identify at least one object located around the electronic device, based at least in part on the at least one image, identify sound information attributable to the identified at least one object from first sound data input through the at least one microphone, control the at least one display module to display at least one virtual object corresponding to the identified at least one object at a position corresponding to the at least one object, wherein the position is determined based on the sound information, obtain a first user input associated with a first virtual object among the at least one virtual object, and determine a noise cancellation (NC) level of a first object corresponding to the first virtual object, based on the first user input.

What is claimed is: 
     
       1. An electronic device comprising:
 at least one display module; 
 at least one communication module; 
 at least one microphone; 
 at least one camera; 
 at least one processor; and 
 memory storing instructions that, when executed by the at least one processor cause the electronic device to: 
 capture at least one image through the at least one camera, 
 identify at least one object located around the electronic device, based at least in part on the at least one image, 
 obtain first sound data input through the at least one microphone, wherein the first sound data includes sound from a first object and a second object, 
 based on the first sound data, identify a first sound forming a portion of the first sound data that is associated with the first object. and a second sound forming another portion of the first sound data associated with the second object, 
 control the at least one display module to display a first virtual object corresponding to the first object to determine a noise cancellation (NC) level corresponding to the first object, and a second virtual object corresponding to the second object to determine a noise cancellation (NC) level corresponding to the second object, 
 obtain a first user input associated with the first virtual object, and 
 based on the first user input, determine the NC level for adjusting the first sound forming the portion of the first sound data. 
 
     
     
       2. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to identify the first object and the second object, based at least in part on surrounding environment information obtained through the at least one communication module. 
     
     
       3. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to determine whether or not to display the first virtual object, based on volume of the first sound corresponding to the first object. 
     
     
       4. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to identify a gaze direction of a user of the electronic device using the at least one camera, and determine whether or not to display the first virtual object and the second virtual object, based on the gaze direction. 
     
     
       5. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to identify at least a part of a body of a user of the electronic device using the at least one camera, and determine whether or not to display the first virtual object and the second virtual object, based on a position of the at least the part of the body of the user. 
     
     
       6. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to:
 identify a second user input, 
 control the at least one display module to display the second virtual object corresponding to the second user input, and 
 control the at least one communication module to transmit, to an external device, a signal for adjusting a sound of the second object among the at least one object, based on a position at which the second virtual object is displayed. 
 
     
     
       7. The electronic device of  claim 6 , wherein the instructions, when executed by the at least one processor, cause the electronic device to determine a method of adjusting the second sound, based on a predetermined property corresponding to the second virtual object. 
     
     
       8. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to identify a type of an application executed in the electronic device and determine the NC level, based on the type of the application. 
     
     
       9. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to control the at least one communication module to transmit the first sound data input through the at least one microphone to an external device. 
     
     
       10. The electronic device of  claim 1 , wherein the instructions, when executed by the at least one processor, cause the electronic device to receive second sound data from an external device through the at least one communication module and wherein identifying the first sound corresponding to the first object and the second sound corresponding to the second object is based at least in part on the second sound data. 
     
     
       11. The electronic device of  claim 10 , wherein the instructions. when executed by the at least one processor, cause the electronic device to control the at least one communication module to transmit a signal including information about the determined NC level to the external device through the at least one communication module. 
     
     
       12. A method of operating an electronic device, the method comprising:
 capturing at least one image through at least one camera of the electronic device, 
 identifying at least one object located around the electronic device, based at least in part on the at least one image, 
 obtaining first sound data input through at least one microphone, wherein the first sound data includes sound from a first object and a second object, 
 based on the first sound data, identifying a first sound forming a portion of the first sound data that is associated with the first object, and a second sound forming another portion of the first sound data associated with the second object, 
 displaying a first virtual object corresponding to the first object to determine a noise cancellation (NC) level corresponding to the first object, and a second virtual object corresponding to the second object to determine a noise cancellation (NC) level corresponding to the second object, 
 obtaining a first user input associated with the first virtual object, and 
 based on the first user input, determining the (NC) level for adjusting the first sound forming the portion of the first sound data. 
 
     
     
       13. The method of  claim 12 , wherein the identifying of the first object and the second object comprises identifying the at least one object located around the electronic device, based at least in part on surrounding environment information obtained through at least one communication module of the electronic device. 
     
     
       14. The method of  claim 12 , further comprising determining whether or not to display the first virtual object, based on volume of the first sound corresponding to the first object. 
     
     
       15. The method of  claim 12 , further comprising identifying a gaze direction of a user of the electronic device using the at least one camera, and
 determining whether or not to display the first virtual object and the second virtual object, based on the gaze direction. 
 
     
     
       16. The method of  claim 12 , further comprising identifying at least a part of a body of a user of the electronic device using the at least one camera, and
 determining whether or not to display the first virtual object and the second virtual object, based on a position of the at least the part of the body of the user. 
 
     
     
       17. The method of  claim 12 , further comprising identifying a second user input,
 displaying a second virtual object corresponding to the second user input, and 
 transmitting, to an external device, a signal for adjusting the second sound through at least one communication module, based on a position at which the second virtual object is displayed. 
 
     
     
       18. The method of  claim 17 , further comprising determining a method of adjusting the second sound, based on a predetermined property corresponding to the second virtual object. 
     
     
       19. The method of  claim 12 , further comprising identifying a type of an application executed in the electronic device, and
 determining the NC level, based on the type of the application. 
 
     
     
       20. The method of  claim 12 , further comprising transmitting the first sound data input through the at least one microphone to an external device through at least one communication module of the electronic device.