Methods and systems for designing and applying numerically optimized binaural room impulse responses

Abstract

Methods and systems for designing binaural room impulse responses (BRIRs) for use in headphone virtualizers, and methods and systems for generating a binaural signal in response to a set of channels of a multi-channel audio signal, including by applying a BRIR to each channel of the set, thereby generating filtered signals, and combining the filtered signals to generate the binaural signal, where each BRIR has been designed in accordance with an embodiment of the design method. Other aspects are audio processing units configured to perform any embodiment of the inventive method. In accordance with some embodiments, BRIR design is formulated as a numerical optimization problem based on a simulation model (which generates candidate BRIRs) and at least one objective function (which evaluates each candidate BRIR), and includes identification of a best one of the candidate BRIRs as indicated by performance metrics determined for the candidate BRIRs by each objective function.

What is claimed is: 
     
       1. A method for generating an output binaural signal in response to a set of N audio input signals, the method comprising:
 receiving the N audio input signals, wherein each of the N audio input signals corresponds to a spatial location, and wherein one or more of the N audio input signals is a channel audio signal associated with a static spatial location; 
 determining N direct response and early reflection binaural room impulse response, BRIR, portions, wherein each direct response and early reflection BRIR portion corresponds to the spatial location of one of the audio input signals; 
 determining a late response BRIR portion, wherein a subset of the late response BRIR portion temporally overlaps with subsets of the direct response and early reflection BRIR portions, and wherein the temporally overlapping subset of the late response BRIR portion models the transition from the direct response and early reflection BRIR portions to the late response BRIR portion; 
 generating, for each audio input signal, a binaural signal, by processing the audio input signal to apply the corresponding direct response and early reflection BRIR portion; 
 generating a first binaural signal by combining the binaural signals for each audio input signal; 
 generating a second binaural signal by processing a downmix of the N audio input signals to apply the late response BRIR portion; 
 generating the output binaural signal by combining the first binaural signal and the second binaural signal. 
 
     
     
       2. The method of  claim 1 , wherein one or more of the N audio input signals is an object audio signal associated with at time-varying spatial location. 
     
     
       3. A non-transitory computer readable storage medium comprising a sequence of instructions, wherein, when an audio signal processing device executes the sequence of instructions, the audio signal processing device performs the method of  claim 1 . 
     
     
       4. An audio signal processing device for generating an output binaural signal in response to a set of N audio input signals, wherein the audio signal processing device comprises one or more processing components configured to:
 receive the N audio input signals, wherein each of the N audio input signals corresponds to a spatial location, and wherein one or more of the N audio input signals is a channel audio signal associated with a static spatial location; 
 determine N direct response and early reflection binaural room impulse response, BRIR, portions, wherein each direct response and early reflection BRIR portion corresponds to the spatial location of one of the audio input signals; 
 determine a late response BRIR portion, wherein a subset of the late response BRIR portion temporally overlaps with subsets of the direct response and early reflection BRIR portions, and wherein the temporally overlapping subset of the late response BRIR portion models the transition from the direct response and early reflection BRIR portions to the late response BRIR portion; 
 generate, for each audio input signal, a binaural signal, by processing the audio input signal to apply the corresponding direct response and early reflection BRIR portion; 
 generate a first binaural signal by combining the binaural signals for each audio input signal; 
 generate a second binaural signal by processing a downmix of the N audio input signals to apply the late response BRIR portion; 
 generate the output binaural signal by combining the first binaural signal and the second binaural signal.