Sound reproduction apparatus for reproducing virtual speaker based on image information

Abstract

A sound source reproducing device which communicates with an electronic device providing images and original sound may be provided. The sound source reproducing device includes: an interface which receives position information of at least one virtual object included in the image and the original sound from the electronic device; and a controller which generates virtual speaker position information corresponding to the position information of the at least one virtual object received from the interface, and converts the original sound received from the interface into a sound source signal for a plurality of speakers on the basis of the virtual speaker position information.

The invention claimed is: 
     
       1. A sound source reproducing device which communicates with an electronic device providing images and original sound, the sound source reproducing device comprising:
 an interface which receives position information of at least one virtual object included in an image and the original sound from the electronic device; 
 a controller which generates virtual speaker position information corresponding to the position information of the at least one virtual object received from the interface, and converts the original sound received from the interface into a sound source signal for a plurality of speakers on the basis of the virtual speaker position information; and 
 a memory; 
 wherein the image comprises a preview image based on augmented reality, and wherein the at least one virtual object, together with the preview image, is displayed on the preview image on the electronic device; and 
 wherein the position information of the at least one virtual object comprises moving path information on the preview image, wherein the moving path information is stored in advance in the memory, and wherein the controller generates the virtual speaker position information by making reference to the moving path information stored in advance in the memory. 
 
     
     
       2. The sound source reproducing device of  claim 1 , further comprising a speaker unit comprising the plurality of speakers, wherein the controller outputs the sound source signal for the plurality of speakers to the speaker unit. 
     
     
       3. The sound source reproducing device of  claim 1 , wherein the controller converts the original sound into the sound source signal which allows the original sound to sounds as if the original sound is reproduced at a position of the virtual speaker by using a transfer function between the sound source signal input to each speaker and a sound pressure output from the position of each virtual speaker. 
     
     
       4. The sound source reproducing device of  claim 3 , wherein the controller calculates a coefficient for converting the original sound in order that the original sound sounds as if the original sound is reproduced at the position of the virtual speaker by using the transfer function, and converts the original sound into the sound source signal by filtering the original sound by using the coefficient. 
     
     
       5. The sound source reproducing device of  claim 3 , wherein the transfer function for the position of at least a portion of the virtual speaker is stored in advance in the memory. 
     
     
       6. The sound source reproducing device of  claim 1 , wherein the virtual speaker position information corresponding to at least a portion of the position information of the at least one virtual object is stored in the memory. 
     
     
       7. The sound source reproducing device of  claim 1 , wherein the electronic device is a head mounted display. 
     
     
       8. A sound source reproducing device which communicates with an electronic device, the sound source reproducing device comprising:
 a memory which stores original sound and images including at least one virtual object; and 
 a controller which generates virtual speaker position information corresponding to position information of the at least one virtual object, and converts the original sound into a sound source signal for a plurality of speakers on the basis of the virtual speaker position information, 
 wherein the controller transmits an image including the at least one virtual object to the electronic device; 
 wherein the image comprises a preview image based on augmented reality, and wherein the at least one virtual object, together with the preview image, is displayed on the preview image on the electronic device; and 
 wherein the position information of the at least one virtual object comprises moving path information on the preview image, wherein the moving path information is stored in advance in the memory, and wherein the controller generates the virtual speaker position information by making reference to the moving path information stored in advance in the memory. 
 
     
     
       9. The sound source reproducing device of  claim 8 , further comprising a speaker unit comprising the plurality of speakers, wherein the controller outputs the sound source signal for the plurality of speakers to the speaker unit. 
     
     
       10. The sound source reproducing device of  claim 8 , wherein the controller converts the original sound into the sound source signal which allows the original sound to sounds as if the original sound is reproduced at a position of the virtual speaker by using a transfer function between the sound source signal input to each speaker and a sound pressure output from the position of each virtual speaker. 
     
     
       11. The sound source reproducing device of  claim 10 , wherein the controller calculates a coefficient for converting the original sound in order that the original sound sounds as if the original sound is reproduced at the position of the virtual speaker by using the transfer function, and converts the original sound into the sound source signal by filtering the original sound by using the coefficient. 
     
     
       12. The sound source reproducing device of  claim 10 , wherein the transfer function for the position of at least a portion of the virtual speaker is stored in advance in the memory. 
     
     
       13. The sound source reproducing device of  claim 8 , wherein the virtual speaker position information corresponding to at least a portion of the position information of the at least one virtual object is stored in the memory. 
     
     
       14. The sound source reproducing device of  claim 8 , wherein the electronic device is a head mounted display.