Apparatus and method for detecting performer's motion to interactively control performance of music or the like

Abstract

Performance interface system includes a motion detector provided for movement with a performer, and a control system for receiving detection data transmitted from the motion detector and controlling a performance of a tone in response to the received detection data. State of a performer's motion is detected via a sensor of the motion detector, and detection data representative of the detected motion state is transmitted to the control system. The control system receives the detection data from the motion detector, analyzes the performer's motion on the basis of the detection data, and then controls a tone performance in accordance with the analyzed data. With this arrangement, the performer can readily take part in the tone performance in the control system. For example, as the performer moves his or her hand, leg or trunk while listening to a manual or automatic performance of a music piece being carried out by a performance apparatus of the control system, the motion detector detects the performer's motion and transmits corresponding detection data to the control system, which in turn variably controls a predetermined one of tonal factors in the music piece performance. This arrangement can readily provide interactive performance control and thereby allows an inexperienced or unskilled performer to take part in a performance with enjoyment.

1. A performance system comprising:
 a motion detector held by or attached to a performer, said motion detector detecting an operating state of the motion detector responsive to a motion made by the performer and outputting operation signals of a plurality of components indicative of the operating state; 
 a living body state detector held by or attached to the performer, said living body state detector detecting a body state of the performer from a body region of the performer and outputting a body signal indicative of the body state; 
 an identification section that compares the operation signals of the plurality of components and, based on results of the comparison between the operation signals, identifies, from among a plurality of types of motions, a type of motion corresponding to the motion being made by the performer; 
 an analysis section that analyzes the body state of the performer on the basis of the body signal; and 
 a generation section that, in accordance with the identified type of motion and the analyzed body state, generates control information to be used for control of a tone performance. 
 
     
     
       2. The performance system as claimed in  claim 1  wherein the body state detected via said living body state detector is at least one of a pulse, heart rate, number of breaths, skin resistance, blood pressure, body temperature, brain wave and eyeball movement. 
     
     
       3. The performance system as claimed in  claim 1  which further comprises: a guide data generation section that generates guide data for providing a guide or assistance as to a motion to be made by the performer; and a guide mechanism that receives the guide data and performs the guide or assistance as to the motion to be made by the performer in accordance with the received guide data. 
     
     
       4. The performance system as claimed in  claim 1  wherein the control of the tone performance controls a tone volume of the tone to be performed. 
     
     
       5. The performance system as claimed in  claim 1  wherein the control of the tone performance controls a tempo of the tone to be performed. 
     
     
       6. The performance system as claimed in  claim 1  wherein the control of the tone controls performance timing of the tone to be performed. 
     
     
       7. The performance system as claimed in  claim 1  wherein the control of the tone performance controls a tone color of the tone to be performed. 
     
     
       8. The performance system as claimed in  claim 1  wherein the control of the tone performance controls an effect of the tone to be performed. 
     
     
       9. The performance system as claimed in  claim 1  wherein the control of the tone performance controls a tone pitch of the tone to be performed. 
     
     
       10. The performance system as claimed in  claim 1  wherein the tone performance is carried out on the basis of automatic performance data. 
     
     
       11. The performance system as claimed in  claim 1  wherein said performer is a human being. 
     
     
       12. The performance system as claimed in  claim 1  wherein said performer is an animal. 
     
     
       13. A performance system as claimed in  claim 1  wherein said motion detector includes a three-axis sensor, and the operation signals contain signals of components of three-axis directions. 
     
     
       14. A performance system as claimed in  claim 13  wherein said identification section compares said signals of components of three-axis directions and identifies the type of the motion by determining that said signals of components of three-axis directions meet a predetermined relationship. 
     
     
       15. A performance system as claimed in  claim 1  which further comprises a transmitter, and both said living body state detector and said motion detector are provided in said transmitter. 
     
     
       16. A performance system as claimed in  claim 1  which further comprises a plurality of transmitters, and said living body state detector and said motion detector are provided in different ones of the transmitters. 
     
     
       17. A method for controlling, by use of a motion detector held by or attached to a performer and a living body state detector held by or attached to the performer, a tone performance in a control system carrying out the tone performance, said motion detector detecting an operating state of the motion detector responsive to a motion made by the performer, said living body state detector detecting a body state of the performer from a body region of the performer, said method comprising the steps of:
 receiving operation signals of a plurality of components indicative of the operating state detected by the motion detector; 
 receiving a body signal indicative of the body state detected by the living body state detector; 
 comparing the received operation signals of the plurality of components and based on results of the comparison between the received operation signals, identifying, from among a plurality of types of motions, a type of motion corresponding to the motion being made by the performer; 
 analyzing the body state of the performer on the basis of the received body signal; and 
 generating control information to be used for control of the tone performance in accordance with the identified type of motion and the analyzed body state. 
 
     
     
       18. A computer-readable storage medium containing a group of instructions to cause a computer to implement a method for controlling, by use of a motion detector held by or attached to a performer and a living body state detector held by or attached to the performer, a tone performance in a control system carrying out the tone performance, said motion detector detecting an operating state of the motion detector responsive to a motion made by the performer, said living body state detector detecting a body state of the performer from a body region of the performer, said method comprising the steps of:
 receiving operation signals of a plurality of components indicative of the operating state detected by the motion detector; 
 receiving a body signal indicative of the body state detected by the living body state detector; 
 comparing the received operation signals of the plurality of components and based on results of the comparison between the received operation signals, identifying, from among a plurality of types of motions, a type of motion corresponding to the motion being made by the performer; 
 analyzing the body state of the performer on the basis of the received body signal; and 
 generating control information to be used for control of the tone performance in accordance with the identified type of motion and the analyzed body state.