Rhythm matching parallel processing apparatus in music synchronization system of motion capture data and computer program thereof

Abstract

Computation time of correlation comparison between rhythm features obtained from motion capture (MoCap) data and rhythm features obtained from music data is shortened. A rhythm matching parallel processing apparatus includes a feature holding unit which holds beat information of a music segment of input music data and MoCap data having motion beat features of high correlation with beat features of the input music data, a correlative value computation parallel execution procedure registering unit which registers a correlation value computation parallel execution procedure, and a correlation value parallel computing unit which computes in parallel correlation values between the motion beat features of the MoCap data and the beat information of the music segment held in the feature holding unit. The correlation value parallel computing unit obtains in parallel a highest correlation value between the beat features of the music segment and the motion beat features of the MoCap data.

1. A rhythm matching parallel processing apparatus in a music synchronization system of MoCap (Motion Capture) Data for synchronizing rhythm features obtained from the MoCap data and rhythm features obtained from music data, comprising:
 a feature holding unit which holds beat information of a music segment of input music data and MoCap data having motion beat features of high correlation with beat features of the input music data; 
 a correlative value computation parallel execution procedure registering unit which registers a correlation value computation parallel execution procedure; and 
 a correlation value parallel computing unit which computes in parallel correlation values between the motion beat features of the MoCap data and the beat information of the music segment held in the feature holding unit, in accordance with the correlation value computation parallel execution procedure registered in the correlative value computation parallel execution procedure registering unit, 
 wherein the correlation value parallel computing unit obtains in parallel a highest correlation value between the beat features of the music segment and the motion beat features of the MoCap data. 
 
     
     
       2. The rhythm matching parallel processing apparatus in the music synchronization system of MoCap data according to  claim 1 , wherein the beat information of the music segment is beat information of each of frames into which the music segment is divided. 
     
     
       3. The rhythm matching parallel processing apparatus in the music synchronization system of MoCap data according to  claim 1 , wherein the correlative value computation parallel execution procedure registering unit and the correlation value parallel computing unit are realized in a CUDA architecture. 
     
     
       4. A computer program of rhythm matching processing in a music synchronization system of MoCap (Motion Capture) Data for making a computer function as:
 means for obtaining beat information of each of frames into which a music segment of input music data is divided; 
 means for extracting MoCap data having motion beat features of high correlation with beat features of the input music data from a MoCap data database; 
 correlation value parallel computing means for computing in parallel correlation values between the motion beat features of the MoCap data extracted and the beat information of the frame, in accordance with a correlation value computation parallel execution procedure registered in advance; and 
 means for performing threshold processing on the correlation values obtained by the correlation value parallel computing means and separating a part of the correlation values that satisfies a threshold from the MoCap data to output as a motion segment.