Systems and methods for rendering spatial audio using spatialization shaders

Abstract

Systems and methods spatial audio rendering using spatialization shaders in accordance with embodiments of the invention are illustrated. One embodiment includes a spatial audio system, including a plurality of loudspeakers, where each loudspeaker includes at least one driver, a processor, and a memory containing a spatial audio rendering application, where the spatial audio rendering application directs the processor to obtain a plurality of audio stems, obtain a position and a rotation of each loudspeaker in the plurality of loudspeakers, obtain a relative location for each audio stem to be rendered, calculate a plurality of tuning parameters for each loudspeaker in the plurality of loudspeakers, provide the plurality of tuning parameters, the position and rotation of each loudspeaker to a spatialization shader, generate a driver feed for each driver in the plurality of loudspeakers using the spatialization shader, and render each audio stem at their respective location using the loudspeakers.

What is claimed is: 
     
       1. A spatial audio system, comprising:
 a plurality of loudspeakers capable of rendering spatial audio, where each loudspeaker comprises at least one driver; 
 a processor; and 
 a memory containing a spatial audio rendering application, where the spatial audio rendering application directs the processor to:
 obtain a plurality of audio stems; 
 obtain a position and a rotation of each loudspeaker in the plurality of loudspeakers, where the position of three given loudspeakers in the plurality of loudspeakers form a scalene triangle; 
 obtain a relative location for each audio stem to be rendered; 
 calculate a plurality of tuning parameters for each of the three given loudspeakers in the plurality of loudspeakers, where the plurality of tuning parameters comprises a delay parameter and a gain parameter, and where to calculate the delay parameter and the gain parameter, the spatial audio rendering application directs the processor to:
 determine a position d max  as the longest distance from a listener position to any of the three given loudspeakers; 
 calculate the delay parameter for each of the three given loudspeakers as distance from the given loudspeaker to the listening position minus d max , all divided by the speed of sound in air; and 
 calculate the gain parameter for each of the three given loudspeakers as distance from the given loudspeaker to the listening position divided by d max ; 
 
 provide the plurality of tuning parameters, the position and rotation of each loudspeaker to a spatialization shader; 
 generate a driver feed for each driver in the plurality of loudspeakers using the spatialization shader; and 
 render each audio stem at their respective location using the plurality of loudspeakers and the driver feeds. 
 
 
     
     
       2. The spatial audio system of  claim 1 , wherein the plurality of tuning parameters comprises a source focus parameter that defines energy distribution between loudspeakers in the plurality of loudspeakers and directivity behavior for each loudspeaker in the plurality of loudspeakers. 
     
     
       3. The spatial audio system of  claim 1 , wherein the plurality of tuning parameters comprises a bass-crossfeed parameter. 
     
     
       4. The spatial audio system of  claim 1 , wherein the spatial audio rendering application further directs the processor to:
 track a listener position; and 
 move the location of each audio stem to maintain relative position to the tracked listener position. 
 
     
     
       5. The spatial audio system of  claim 1 , wherein the spatial audio rendering application further directs the processor to:
 regularize the loudspeaker positions in a virtual map; 
 calculate a minimum bounding box for the regularized loudspeaker positions in the virtual map; 
 denote the center of the minimum bounding box as a reference position, where the reference position reflects the centroid of a polygon defined by the positions of the loudspeakers; and 
 use the reference position to translate the virtual space of a user interface to the location of the loudspeaker positions. 
 
     
     
       6. A method for spatial audio rendering, comprising:
 obtaining a plurality of audio stems; 
 obtaining a position and a rotation for each loudspeaker in a plurality of loudspeakers, where each loudspeaker has at least one driver, and where the position of three given loudspeakers in the plurality of loudspeakers form a scalene triangle; 
 obtaining a location for each audio stem is to be rendered;
 calculating a plurality of tuning parameters, the plurality of tuning parameters comprising a delay parameter and a gain parameter, for each of the three given loudspeakers in the plurality of loudspeakers by:
 determining a position d max  as the longest distance from a listener position to any of the three given loudspeakers; 
 calculating the delay parameter for each of the three given loudspeakers as distance from the given loudspeaker to the listening position minus d max , all divided by the speed of sound in air; and 
 calculating the gain parameter for each of the three given loudspeakers as distance from the given loudspeaker to the listening position divided by d max ; 
 
 
 providing the plurality of tuning parameters, the position and rotation of each loudspeaker to a spatialization shader; 
 generating a driver feed for each driver in the plurality of loudspeakers using the spatialization shader; and 
 rendering each audio stem at their respective location using the plurality of loudspeakers and the driver feeds. 
 
     
     
       7. The method of spatial audio rendering of  claim 6 , wherein the plurality of tuning parameters comprises a source focus parameter that defines energy distribution between loudspeakers in the plurality of loudspeakers and directivity behavior for each loudspeaker in the plurality of loudspeakers. 
     
     
       8. The method of spatial audio rendering of  claim 6 , wherein the plurality of tuning parameters comprises a bass-crossfeed parameter. 
     
     
       9. The method of spatial audio rendering of  claim 6 , further comprising:
 tracking a listener position; and 
 moving the location of each audio stem to maintain relative position to the tracked listener position. 
 
     
     
       10. The method of spatial audio rendering of  claim 6 , further comprising:
 regularizing the loudspeaker positions in a virtual map; 
 calculating a minimum bounding box for the regularized loudspeaker positions in the virtual map; 
 denoting the center of the minimum bounding box as a reference position, where the reference position reflects the centroid of a polygon defined by the positions of the loudspeakers; and 
 using the reference position to translate the virtual space of a user interface to the location of the loudspeaker positions. 
 
     
     
       11. A loudspeaker for spatial audio rendering, comprising:
 at least one driver; 
 a processor; and 
 a memory containing a spatial audio rendering application, where the spatial audio rendering application directs the processor to:
 obtain a plurality of audio stems; 
 obtain a position and a rotation of each loudspeaker in a plurality of secondary loudspeakers communicatively coupled to the loudspeaker, where each secondary loudspeaker comprises at least one driver, and where the position of the loudspeaker and at least two given secondary loudspeakers in the plurality of secondary loudspeakers form a scalene triangle; 
 obtain a location for where each audio stem is to be rendered; 
 calculate a plurality of tuning parameters for each of the loudspeaker and the at least two given secondary loudspeakers in the plurality of secondary loudspeakers, where the plurality of tuning parameters comprises a delay parameter and a gain parameter, and where to calculate the delay parameter and the gain parameter, the spatial audio rendering application directs the processor to:
 determine a position d max  as the longest distance from a listener position to any of the at least two given secondary loudspeakers and the loudspeaker; 
 calculate the delay parameter for each of the at least two given secondary loudspeakers and the loudspeaker as distance from the loudspeaker or at least two given secondary loudspeakers, respectively to the listening position minus d max , all divided by the speed of sound in air; and 
 calculate a gain parameter for each of the at least two given secondary loudspeakers and the loudspeaker as distance from the loudspeaker or the at least two secondary loudspeakers, respectively to the listening position divided by d max ; 
 
 provide the plurality of tuning parameters, the position and rotation of each loudspeaker to a spatialization shader; 
 generate a driver feed for each driver in the plurality of loudspeakers using the spatialization shader; 
 transmit the driver feed to its respective driver; and 
 render each audio stem at their respective location using the plurality of loudspeakers and the driver feeds. 
 
 
     
     
       12. The loudspeaker for spatial audio rendering of  claim 11 , wherein the plurality of tuning parameters comprises a source focus parameter that defines energy distribution between loudspeakers in the plurality of loudspeakers and directivity behavior for each loudspeaker in the plurality of loudspeakers. 
     
     
       13. The loudspeaker for spatial audio rendering of  claim 11 , wherein the spatial audio rendering application further directs the processor to:
 track a listener position; and 
 move the location of each audio stem to maintain relative position to the tracked listener position. 
 
     
     
       14. The loudspeaker for spatial audio rendering of  claim 11 , wherein the spatial audio rendering application further directs the processor to:
 regularize the loudspeaker positions in a virtual map; 
 calculate a minimum bounding box for the regularized loudspeaker positions in the virtual map; 
 denote the center of the minimum bounding box as a reference position, where the reference position reflects the centroid of a polygon defined by the positions of the loudspeakers; and 
 use the reference position to translate the virtual space of a user interface to the location of the loudspeaker positions.