US10807002B2ActiveUtilityA1

Visual method and apparatus for compensating sound information, storage medium and electronic device

49
Assignee: NETEASE HANGZHOU NETWORK CO LTDPriority: Aug 30, 2017Filed: Aug 23, 2018Granted: Oct 20, 2020
Est. expiryAug 30, 2037(~11.1 yrs left)· nominal 20-yr term from priority
Inventors:Jin Ge
A63F 13/215A63F 13/54G06F 3/165A63F 13/533A63F 13/5375G06F 3/0488G06F 3/16A63F 2300/305
49
PatentIndex Score
0
Cited by
18
References
23
Claims

Abstract

The present disclosure provides a visual method and apparatus for compensating sound information, a storage medium, and an electronic device, and relates to the field of human-computer interaction technologies. The method includes: detecting a sound in a first preset range of the game scene, and acquiring a type of the sound, and an orientation of the sound source of the sound relative to the virtual object; providing a visual control on the graphical user interface, the visual control including a virtual component associated with the type of the sound; and controlling a pointing direction of the virtual component according to the orientation of the sound source of the sound relative to the virtual object.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A visual method for compensating sound information, applied to a touch terminal capable of presenting a graphical user interface, the graphical user interface at least partially comprising a game scene, and at least part of a virtual object, wherein the method comprises:
 detecting a sound in a first preset range of the game scene, and acquiring a type of the sound, and an orientation of a sound source of the sound relative to the virtual object; 
 providing a visual control on the graphical user interface, the visual control comprising a virtual component associated with the type of the sound; and 
 controlling a pointing direction of the virtual component according to the orientation of the sound source of the sound relative to the virtual object, 
 wherein the first preset range is a range determined according to an auditory range of the virtual object, an entire area of the game scene, or an area of the game scene currently displayed on the graphical user interface. 
 
     
     
       2. The visual method for compensating sound information according to  claim 1 , wherein the method further comprises:
 acquiring a distance between the sound source of the sound and the virtual object; and 
 controlling a display form of the virtual component according to the distance between the sound source of the sound and the virtual object. 
 
     
     
       3. The visual method for compensating sound information according to  claim 1 , wherein before the step of providing the visual control on the graphical user interface, the method further comprises:
 determining the sound source of the sound is located within a second preset range and out of a third preset range. 
 
     
     
       4. The visual method for compensating sound information according to  claim 1 , wherein the virtual component comprises an ideographic image and a direction identifier, the ideographic image is corresponding to the type of the sound, and a pointing direction of the direction identifier is corresponding to the orientation of the sound source of the sound relative to the virtual object. 
     
     
       5. The visual method for compensating sound information according to  claim 2 , wherein the controlling the display form of the virtual component according to the distance between the sound source of the sound and the virtual object comprises:
 controlling a display form of at least one of a transparency, a size, and a brightness of the virtual component according to the distance between the sound source of the sound and the virtual object. 
 
     
     
       6. A visual method for compensating sound information, applied to a touch terminal capable of presenting a graphical user interface, the graphical user interface at least partially comprising a game scene, and at least part of a virtual object, wherein the method comprises:
 detecting a plurality of sounds in a first preset range of the game scene, and acquiring a type of each of the sounds, and an orientation of a sound source of each of the sounds relative to the virtual object; 
 providing a visual control on the graphical user interface, the visual control comprising a virtual component associated with a type of a first sound in the plurality of sounds; and 
 controlling a pointing direction of the virtual component according to the orientation of the sound source of the first sound relative to the virtual object, 
 wherein the first preset range is a range determined according to an auditory range of the virtual object, an entire area of the game scene, or an area of the game scene currently displayed on the graphical user interface. 
 
     
     
       7. The visual method for compensating sound information according to  claim 6 , wherein the virtual component comprises an ideographic image and a plurality of directional identifiers, the number of the directional identifiers is the same as the sounds, the ideographic image is corresponding to the type of the first sound, and the plurality of direction identifiers are provided in one-to-one correspondence with the plurality of sounds; and
 the step of controlling the pointing direction of the virtual component according to the orientation of the sound source of the first sound relative to the virtual object comprises: 
 controlling a pointing direction of each of the direction identifiers according to the orientation of the sound source of a respective one of the sounds relative to the virtual object. 
 
     
     
       8. The visual method for compensating sound information according to  claim 6 , wherein the method further comprises:
 acquiring a distance between the sound source of the first sound and the virtual object; and 
 controlling a display form of the virtual component according to the distance between the sound source of the first sound and the virtual object. 
 
     
     
       9. A visual method for compensating sound information, applied to a touch terminal capable of presenting a graphical user interface, the graphical user interface at least partially comprising a game scene, and at least part of a virtual object, wherein the method comprises:
 detecting a plurality of sounds in a first preset range of the game scene, and acquiring a type of each sound, and an orientation of a sound source of each of the sounds relative to the virtual object; 
 providing a plurality of visual controls on the graphical user interface, the number of the visual controls being the same as the sounds, wherein the plurality of visual controls are provided in one-to-one correspondence with the plurality of sounds, and each of the visual controls comprises a virtual component associated with the type of a respective one of the sounds; and 
 controlling a pointing direction of each of the virtual components according to the orientation of the sound source of a respective one of the sounds relative to the virtual object, 
 wherein the first preset range is a range determined according to an auditory range of the virtual object, an entire area of the game scene, or an area of the game scene currently displayed on the graphical user interface. 
 
     
     
       10. The visual method for compensating sound information according to  claim 9 , wherein the method further comprises:
 acquiring a distance between a sound source of a respective one of the sounds and the virtual object; and 
 controlling a display form of each of the virtual components according to the distance between the sound source of a respective one of the sounds and the virtual object. 
 
     
     
       11. A non-transitory computer readable storage medium storing a computer program thereon, wherein the computer program is executed by a processor to implement the visual method for compensating sound information according to  claim 1 . 
     
     
       12. A non-transitory computer readable storage medium storing a computer program thereon, wherein the computer program is executed by a processor to implement the visual method for compensating sound information according to  claim 6 . 
     
     
       13. A non-transitory computer readable storage medium storing a computer program thereon, wherein the computer program is executed by a processor to implement the visual method for compensating sound information according to  claim 9 . 
     
     
       14. An electronic device, comprising:
 a processor; and 
 a memory for storing executable instructions of the processor; 
 wherein the processor is configured to execute the visual method for compensating sound information according to  claim 1  via executing the executable instructions. 
 
     
     
       15. The electronic device according to  claim 14 , wherein the processor is further configured to:
 acquire a distance between the sound source of the sound and the virtual object; and 
 control a display form of the virtual component according to the distance between the sound source of the sound and the virtual object. 
 
     
     
       16. The electronic device according to  claim 14 , wherein the processor is further configured to: before the step of providing the visual control on the graphical user interface,
 determine the sound source of the sound is located within a second preset range and out of a third preset range. 
 
     
     
       17. The electronic device according to  claim 14 , wherein the virtual component comprises an ideographic image and a direction identifier, the ideographic image is corresponding to the type of the sound, and a pointing direction of the direction identifier is corresponding to the orientation of the sound source of the sound relative to the virtual object. 
     
     
       18. The electronic device according to  claim 14 , wherein the processor is further configured to:
 control a display form of at least one of a transparency, a size or a brightness of the virtual component according to the distance between the sound source of the sound and the virtual object. 
 
     
     
       19. An electronic device, comprising:
 a processor; and 
 a memory for storing executable instructions of the processor; 
 wherein, the processor is configured to execute the visual method for compensating sound information according to  claim 6  via executing the executable instructions. 
 
     
     
       20. The electronic device according to  claim 19 , wherein the virtual component comprises an ideographic image and a plurality of directional identifiers, the number of the directional identifiers is the same as the sounds, the ideographic image is the corresponding to the type of the first sound, and the plurality of direction identifiers are provided in one-to-one correspondence with the plurality of sounds; and
 the processor is further configured to: 
 controlling a pointing direction of each of the direction identifiers according to the orientation of the sound source of a respective one of the sounds relative to the virtual object. 
 
     
     
       21. The electronic device according to  claim 19 , wherein the processor is further configured to:
 acquire a distance between the sound source of the first sound and the virtual object; and 
 control a display form of the virtual component according to the distance between the sound source of the first sound and the virtual object. 
 
     
     
       22. An electronic device, comprising:
 a processor; and 
 a memory for storing executable instructions of the processor; 
 wherein, the processor is configured to execute the visual method for compensating sound information according to  claim 9  via executing the executable instructions. 
 
     
     
       23. The electronic device according to  claim 22 , wherein the processor is further configured to:
 acquire a distance between a sound source of a respective one of the sounds and the virtual object; and 
 control a display form of each of the virtual components according to the distance between the sound source of a respective one of the sounds and the virtual object.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.