Concept for combining multiple parametrically coded audio sources
Abstract
According to the present invention, multiple parametrically encoded audio signals can be efficiently combined using an audio signal generator, which generates an audio output signal by combining the down-mix channels and the associated parameters of the audio signals directly within the parameter domain, i.e. without reconstructing or decoding the individual input audio signals prior to the generation of the audio output signal. This is achieved by direct mixing of the associated down-mix channels of the individual input signals. It is one key feature of the present invention that the combination of the down-mix channels is achieved by simple, computationally inexpensive arithmetic operations.
Claims
exact text as granted — not AI-modifiedThe invention claimed is:
1 . Audio signal generator for generating an audio output signal, comprising:
an audio signal receiver for receiving:
a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel; and
a second audio signal comprising a second down-mix channel having information on at least one second original channel;
a channel combiner for deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel; a parameter calculator for deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel, and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to the common reference channel; and an output interface for outputting the audio output signal comprising the combined down-mix channel, the first and second combined parameters.
2 . Audio signal generator in accordance with claim 1 , in which the channel combiner is operative to derive the combined down-mix channel using a linear combination of the first and the second down-mix channel.
3 . Audio signal generator in accordance with claim 2 , in which the channel combiner is operative to use a linear combination having coefficients depending on the energy E(sA2(n)) within the first down-mix channel and on the energy E(sB2(n)) within the second down-mix channel.
4 . Audio signal generator in accordance with claim 3 , in which the channel combiner is operative to use a linear combination having a coefficient gA for the first down-mix channel, and a coefficient gB for the second down-mix channel derived using the following equation:
g
B
g
A
E
{
s
A
2
(
n
)
}
E
{
s
B
2
(
n
)
}
.
5 . Audio signal generator in accordance with claim 2 , in which the channel combiner is operative to use a linear combination having coefficients depending on the number U of the first original channels and the number V of the second original channels.
6 . Audio signal generator in accordance with claim 5 , in which the channel combiner is operative to use a linear combination having a coefficient gA of the first down-mix channel and a coefficient gB of the second down-mix channel derived according to one of the following equations:
g
A
=
U
(
U
+
V
)
,
g
B
=
V
(
U
+
V
)
or
g
A
=
U
(
U
+
V
)
,
g
B
=
V
(
U
+
V
)
.
7 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to use a predetermined channel of the first original channels or the at least one second original channel as common reference channel.
8 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to use the reference channel of the first audio signal as the common reference channel.
9 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to use the combined down-mix channel as the common reference channel.
10 . Audio signal generator in accordance with claim 1 , which the parameter calculator is operative to use the original channel as the common reference channel which has the highest energy.
11 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to calculate the energy E{sAref} of the reference channel by deriving the energy E{sA 2 } of the first down-mix channel and parameters ai{i=1, . . . , n} associated to channels other than the reference channel according to the equation:
E
{
s
A
ref
}
=
E
{
s
A
2
(
n
)
}
1
+
∑
i
a
i
.
12 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to use the reference channel as the common reference channel and the original parameter a 2 as first combined parameter yu and to derive the second combined parameter yu+1 for the at least one second original channel with respect to the reference channel.
13 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to derive the combined parameters using the energy E{sA 2 (n)} of the first down-mix channel and the energy E{sB 2 (n)} of the second down-mix channel.
14 . Audio signal generator in accordance with claim 13 , in which the parameter calculator is operative to further use coefficients gA associated to the first down-mix channel and gB associated to the second down-mix channel, the coefficients used for the linear combination of the first and second down-mix used by the channel combiner.
15 . Audio signal generator in accordance with claim 14 , in which the parameter calculator is operative to calculate the second combined parameter yU+1 for the at least one second original channel according to the following equation:
y
U
+
1
=
g
B
2
g
A
2
·
E
{
s
B
1
2
(
n
)
}
E
{
s
A
1
2
(
n
)
}
,
wherein E{s A 1 2 (n)} is the energy of the reference channel derived using the energy of the first down-mix channel E{s A 2 (n)} according to the following formula:
E
{
s
A
1
2
(
n
)
}
=
E
{
s
A
2
(
n
)
}
(
1
+
a
2
)
,
wherein a 2 is the original parameter relating a first original channel to the reference channel.
16 . Audio signal generator in accordance with claim 1 , in which the parameter calculator is operative to process frequency-portions of the first and the second down-mix channels associated with discrete frequency intervals such that combined parameters are derived for each discrete frequency interval.
17 . Audio signal generator in accordance with claim 1 , in which the audio signal receiver is operative to receive audio signals comprising down-mix channels represented by sampling parameters sampled with a predetermined sample frequency.
18 . Method of generating an audio output signal, the method comprising:
receiving a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel and a second audio signal comprising a second down-mix channel having information on at least one second original channel; deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel; deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to a common reference channel; and outputting the audio output signal comprising the combined down-mix channel and the first and second combined parameters.
19 . Conferencing System having an audio signal generator for generating an audio output signal, comprising:
an audio signal receiver for receiving:
a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel; and
a second audio signal comprising a second down-mix channel having information on at least one second original channel;
a channel combiner for deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel; a parameter calculator for deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel, and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to the common reference channel; and an output interface for outputting the audio output signal comprising the combined down-mix channel, the first and second combined parameter.
20 . A non-transitory storage medium having stored thereon a computer program for, when running on a computer, implementing a method for generating an audio output signal, the method comprising:
receiving a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel and a second audio signal comprising a second down-mix channel having information on at least one second original channel; deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel; deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to a common reference channel; and outputting the audio output signal comprising the combined down-mix channel and the first and second combined parameters.
21. Audio signal generator for generating an audio output signal, comprising:
an audio signal receiver for receiving: a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel; and a second audio signal comprising a second down-mix channel having information on at least one second original channel; a channel combiner for deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel; a parameter calculator for deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel, and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to the common reference channel; and an output interface for outputting the audio output signal comprising the combined down-mix channel, the first and second combined parameters, wherein the first combined parameter is based on coherence measures.
22. A method in accordance with claim 37 , further comprising:
using, for deriving the combined down-mix channel, a linear combination having coefficients depending on the energy within the first down-mix channel and on the energy within the second down-mix channel.
23. A method in accordance with claim 37 , further comprising:
using a linear combination having a coefficient g a for the first down-mix channel, and a coefficient g A for the second down-mix channel derived using the following equation:
g
B
g
A
=
E
{
s
A
2
(
n
)
}
E
{
s
B
2
(
n
)
}
,
wherein E{s A 2 (n)} denotes the energy within the first down-mix channel and E{s B 2 (n)} denotes the energy within the second down-mix channel.
24. A method in accordance with claim 37 , further comprising:
using a linear combination having coefficients depending on the number U of the first original channels and the number V of the second original channels.
25. A method in accordance with claim 24 , further comprising:
using a linear combination having a coefficient g a of the first down-mix channel and a coefficient g B of the second down-mix channel derived according to one of the following equations:
g
A
=
U
(
U
+
V
)
,
g
B
=
V
(
U
+
V
)
or
g
A
=
U
(
U
+
V
)
,
g
B
=
V
(
U
+
V
)
.
26. A method in accordance with claim 37 , further comprising:
using a predetermined channel of the first original channels or the at least one second original channel as common reference channel.
27. A method in accordance with claim 37 , further comprising:
using the reference channel of the first audio signal as the common reference channel.
28. A method in accordance with claim 37 , further comprising:
using the combined down-mix channel as the common reference channel.
29. A method in accordance with claim 37 further comprising:
using the original channel as the common reference channel which has the highest energy.
30. A method in accordance with claim 37 , further comprising:
calculating the energy E{s A ref } of the reference channel by deriving the energy E{s A 2 (n)} of the first down-mix channel and parameters a 1 {i=1, . . . , n} associated to channels other than the reference channel according to the equation:
E
{
s
A
ref
}
=
E
{
s
A
2
(
n
)
}
1
+
∑
i
a
i
.
31. A method in accordance with claim 37 , further comprising:
using a reference channel as the common reference channel and the original parameter a 2 as first combined parameter y U and deriving the second combined parameter y U+1 for the at least one second original channel with respect to the reference channel.
32. A method in accordance with claim 37 , further comprising:
deriving the combined parameters using the energy E {s A 2 (n)} of the first down-mix channel and the energy E{s B 2 (n)} of the second down-mix channel.
33. A method in accordance with claim 32 , further comprising:
using coefficients g A associated to the first down-mix channel and g B associated to the second down-mix channel, the coefficients used for the linear combination of the first and second down-mix used by a channel combiner.
34. A method in accordance with claim 33 , further comprising:
calculating the second combined parameter y U+1 for the at least one second original channel according to the following equation:
y
U
+
1
=
g
B
2
g
A
2
·
E
{
s
B
1
2
(
n
)
}
E
{
s
A
1
2
(
n
)
}
,
wherein E{s A 1 2 (n)}0 is the energy of the reference channel derived using the energy of the first down-mix channel E {s A 2 (n)} according to the following formula:
E
{
s
A
1
2
(
n
)
}
=
E
{
s
A
2
(
n
)
}
(
1
+
a
2
)
,
wherein a 2 is the original parameter relating a first original channel to the reference channel.
35. A method in accordance with claim 37 , further comprising:
processing frequency-portions of the first and the second down-mix channels associated with discrete frequency intervals such that combined parameters are derived for each discrete frequency interval.
36. A method in accordance with claim 37 , further comprising:
receiving audio signals comprising down-mix channels represented by sampling parameters sampled with a predetermined sample frequency.
37. Method of generating an audio output signal, the method comprising:
receiving a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel and a second audio signal comprising a second down-mix channel having information on at least one second original channel; deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel: deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to a common reference channel; and outputting the audio output signal comprising the combined down-mix channel and the first and second combined parameters, wherein the first combined parameter is based on coherence measures.
38. Conferencing System having an audio signal generator for generating an audio output signal, comprising:
an audio signal receiver for receiving:
a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel; and
a second audio signal comprising a second down-mix channel having information on at least one second original channel; a channel combiner for deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel;
a parameter calculator for deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel, and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to the common reference channel; and an output interface for outputting the audio output signal comprising the combined down-mix channel, the first and second combined parameters, wherein the first combined parameter is based on coherence measures.
39. A non-transitory storage medium having stored thereon a computer
program for, when running on a computer, implementing a method for generating an audio output signal, the method comprising: receiving a first audio signal comprising a first down-mix channel having information on two or more first original channels, and comprising an original parameter associated with one of the first original channels describing a property of one of the first original channels with respect to a reference channel and a second audio signal comprising a second down-mix channel having information on at least one second original channel; deriving a combined down-mix channel by combining the first down-mix channel and the second down-mix channel; deriving a first combined parameter describing the property of one of the first original channels with respect to a common reference channel and a second combined parameter describing the property of another one of the first original channels or of the at least one second original channel with respect to a common reference channel; and outputting the audio output signal comprising the combined down-mix channel and the first and second combined parameters, wherein the first combined parameter is based on coherence measures.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.