Method and device for determining mixing parameters based on decomposed audio data

Abstract

The present invention provides a method for processing audio data, comprising the steps of providing a first audio track of mixed input data, said mixed input data representing an audio signal containing a plurality of different timbres, decomposing the mixed input data to obtain decomposed data representing an audio signal containing at least one, but not all, of the plurality of different timbres, providing a second audio track, analyzing audio data, including at least the decomposed data, to determine at least one mixing parameter, and generating an output track based on the at least one mixing parameter, said output track comprising first output data obtained from the first audio track and second output data obtained from the second audio track.

1 . A method for processing audio data, comprising:
 providing a first audio track of mixed input data, the mixed input data representing an audio signal containing a plurality of different timbres,   decomposing the mixed input data to obtain decomposed data representing an audio signal comprising at least one, but not all, of the plurality of different timbres,   providing a second audio track,   analyzing audio data, including at least the decomposed data, to determine at least one mixing parameter,   generating an output track based on the at least one mixing parameter, said output track comprising first output data obtained from the first audio track and second output data obtained from the second audio track.   
     
     
         2 . The method of  claim 1 , wherein the output track comprises a first portion comprising the first output data, wherein the first output data represents a predominant timbre of the first audio track, and a second portion arranged after said first portion and comprising the second output data wherein the second output data represents a predominant timbre of the second audio track. 
     
     
         3 . The method of  claim 2 ,
 wherein analyzing the audio data comprises analyzing the decomposed data to determine a transition point as the mixing parameter, and   wherein the output track is generated using the transition point such that the first portion is arranged before the transition point and the second portion is arranged after the transition point.   
     
     
         4 . The method of  claim 3 , wherein the output track further comprises a transition portion arranged between the first portion and the second portion, and associated to the transition point, wherein in the transition portion one or more of (A) a volume level of the first output data is reduced or (B) a volume level of the second output data is increased. 
     
     
         5 . The method of  claim 1 , wherein analyzing the audio data comprises determining at least one mixing parameter referring to one or more of:
 (A) a tempo of one or more of the first audio track or the second audio track,   (B) a beats per minute (BPM) of one or more of the first audio track or the second audio track,   (C) a beat grid of one or more of the first audio track or the second audio track,   (D) a beat phase of one or more of the first audio track or the second audio track,   (E) a downbeat position within one or more of the first audio track or the second audio track,   (F) a beat shift between the first audio track and the second audio track,   (G) a key of one or more of the first audio track or the second audio track,   (H) a chord progression of one or more of the first audio track or the second audio track,   (I) a timbre or group of timbres of one or more of the first audio track or the second audio track, or   (J) a song part junction of one or more of the first audio track or the second audio track.   
     
     
         6 . The method of  claim 1 , wherein analyzing the audio data comprises detecting silence data within the decomposed data. 
     
     
         7 . The method of  claim 1 , wherein analyzing the audio data comprises detecting silence data continuously extending over a predetermined time span within the decomposed data. 
     
     
         8 . The method of  claim 1 , wherein analyzing the audio data comprises determining at least a first mixing parameter based on the decomposed data, and at least a second mixing parameter based on the first mixing parameter, the second mixing parameter being the transition point. 
     
     
         9 . The method of  claim 1 ,
 wherein analyzing the audio data comprises determining a tempo of one or more of the first audio track or the second audio track as the at least one mixing parameter, and   wherein generating the output track comprises a tempo matching processing based on the determined tempo, the tempo matching processing comprising a time stretching or resampling of audio data obtained from one or more of the first audio track or the second audio track, such that the first output data and the second output data have mutually matching tempos.   
     
     
         10 . The method of  claim 1 ,
 wherein analyzing the audio data comprises determining a key of one or more of the first audio track or the second audio track as the at least one mixing parameter, and   wherein generating the output track comprises a key matching processing, the key matching processing comprising a pitch shifting of audio data obtained from one or more of the first audio track or the second audio track, such that the first output data and the second output data have mutually matching keys.   
     
     
         11 . The method of  claim 1 , wherein decomposing the mixed input data comprises processing the mixed input data within an artificial intelligence (AI) system comprising a trained neural network. 
     
     
         12 . The method of  claim 1 , wherein one or more of (A) analyzing the audio data or (B) generating the output track comprises processing of audio data within an artificial intelligence (AI) system comprising a trained neural network. 
     
     
         13 . The method of  claim 1 , further comprising playing the output track. 
     
     
         14 . A device for processing audio data, comprising
 a first input unit for receiving a first audio track of mixed input data, the mixed input data representing an audio signal comprising a plurality of different timbres,   a second input unit for receiving a second audio track,   a decomposition unit for decomposing the mixed input data to obtain decomposed data representing an audio signal comprising at least one, but not all, of the plurality of different timbres,   an analyzing unit for analyzing audio data, including at least the decomposed data, to determine at least one mixing parameter,   an output generation unit for generating an output track based on the at least one mixing parameter, the output track comprising first output data obtained from the first audio track and second output data obtained from the second audio track.   
     
     
         15 . The device of  claim 14 , comprising a tempo matching unit adapted for time stretching or resampling of audio data obtained from one or more of the first audio track or the second audio track, to generate the first output data and the second output data having mutually matching tempos. 
     
     
         16 . The device of  claim 14 , comprising a key matching unit adapted for pitch shifting of audio data obtained from one or more of the first audio track or the second audio track to generate the first output data and the second output data having mutually matching keys. 
     
     
         17 . The device of  claim 14 , wherein at least one of the decomposition unit, the analyzing unit and the output generation unit includes an artificial intelligence (AI) system comprising a trained neural network. 
     
     
         18 . The device of  claim 14 , comprising a playback unit for playing the output track. 
     
     
         19 . A method for processing audio data, comprising:
 providing an audio track of mixed input data, the mixed input data representing an audio signal comprising a plurality of different timbres;   decomposing the mixed input data to obtain decomposed data representing an audio signal containing at least one, but not all, of the plurality of different timbres; and   analyzing the decomposed data to determine a transition point or a song part junction between a first song part and a second song part within the audio track, or analyzing the decomposed data to determine another track parameter.   
     
     
         20 . A method for processing audio data, comprising:
 providing a set of audio tracks, each audio track of the set of audio tracks including mixed input data, the mixed input data representing audio signals comprising a plurality of different timbres;   decomposing each audio track of the set of audio tracks to obtain a decomposed track associated with the respective audio track, wherein the decomposed track represents an audio signal comprising at least one, but not all, of the plurality of different timbres of the respective audio track, thereby obtaining a set of decomposed tracks;   analyzing each decomposed track of the set of decomposed tracks to determine one or more track parameters of the respective audio track with which the decomposed track is associate;   selecting or allowing a user to select at least one selected audio track out of the set of audio tracks, based on at least one of the one or more track parameters; and   generating an output track based on the at least one selected audio track.   
     
     
         21 . The method of  claim 20 , wherein the track parameter refers to at least one timbre of the respective audio track. 
     
     
         22 . The method of  claim 20 , wherein the track parameter refers to at least one of a tempo, a beat, a beats per minute (BPM) value, a beat grit, a beat phase, a key, and a chord progression of the respective audio track. 
     
     
         23 . The method of  claim 20 , comprising notifying a user about at least one track parameter of the one or more track parameters, preferably displaying the at least one track parameter as associated to the respective audio track. 
     
     
         24 . The method of  claim 23 , comprising displaying a graphical representation of an audio track of the set of audio tracks, wherein the graphical representation corresponds to the associated track parameter of the audio track. 
     
     
         25 . The method of  claim 20 , comprising playing a selected audio track. 
     
     
         26 . The method of  claim 1 , wherein the second audio track contains mixed input data, the mixed input data representing an audio signal comprising a plurality of different timbres, wherein the mixed input data are decomposed to obtain decomposed data representing an audio signal comprising at least one, but not all, of the plurality of different timbres, and wherein analyzing is carried out taking into account the decomposed data obtained from the second audio track. 
     
     
         27 . The method of  claim 1 , wherein the mixed input data of one or more of the first audio track or the second audio track are decomposed (A) to obtain at least decomposed data of a vocal timbre, decomposed data of a harmonic timbre and decomposed data of a drum timbre or (B) to obtain three decomposed tracks, the three decomposed tracks comprising (1) a decomposed track of a vocal timbre, (2) a decomposed track of a harmonic timbre, and (3) a decomposed track of a drum timbre, wherein the three decomposed tracks sum up to an audio track substantially equal to one or more of the first audio track or the second audio track, respectively. 
     
     
         28 . The method of  claim 6 , wherein the silence data represents an audio signal having a volume level smaller than negative thirty decibels (−30 dB).