Boxing game processing method, display control method, position detection method, cursor control method, energy consumption calculating method and exercise system

Abstract

Glove type input articles 7 L and 7 R are imaged by an imaging unit 51 of a cartridge 3 in order to calculate the positions thereof. Virtual screens are prepared respectively for the input articles 7 L and 7 R. Each virtual screen is divided into an immovable area, a straight area and a cross area, and determines the areas in which the current positions of the input articles 7 L and 7 R are located in the virtual screens, the origins of which are located in past positions of the input articles 7 L and 7 R as determined twice before. If the current position is located in the straight area, a straight punch is displayed; if the current position is located in the cross area, a cross punch is displayed; and if the current position is located in the immovable area, globes are displayed in accordance with the positions of the input articles 7 L and 7 R. The left and right hands are distinguished on the basis of positions predicted from the past positions of the input articles 7 L and 7 R.

1 . A boxing game processing method comprising:
 an illumination step of emitting infrared light in a predetermined cycle to illuminate a left-handed glove type input article and a right-handed glove type input article which are provided respectively with retroreflective surfaces;   an image generation step of imaging the left-handed glove type input article and the right-handed glove type input article both when the infrared light is emitted and when the infrared light is not emitted, and generating image data obtained with illumination and image data obtained without illumination;   a differential data generation step of generating differential data between the image data obtained with illumination and the image data obtained without illumination;   a position calculation step of calculating positional information of the left-handed glove type input article and the right-handed glove type input article on the basis of the differential data;   an area determination step of determining in which area the position of the left-handed glove type input article is located in a first virtual screen which is divided into a straight area, a cross area and an immovable area, wherein said position of the left-handed glove type input article is a relative position which is indicated by current positional information of the left-handed glove type input article and converted into a coordinate system, the origin of which is located in the position indicated by past positional information obtained by tracing back for a predetermined number of times;   an area determination step of determining in which area the position of the right-handed glove type input article is located in a second virtual screen which is divided into a straight area, a cross area and an immovable area, wherein said position of the right-handed glove type input article is a relative position which is indicated by current positional information of the right-handed glove type input article and converted into a coordinate system, the origin of which is located in the position indicated by past positional information obtained by tracing back for a predetermined number of times;   a display step of displaying a left glove image which represents the left-handed glove type input article and a right glove image which represents the right-handed glove type input article in accordance with the result of determination in said area determination steps for the left-handed glove type input article and the right-handed glove type input article, wherein   the first virtual screen and the second virtual screen are provided as mirror images each other in the right and left direction, and wherein   in said area determination step for the left-handed glove type input article, an image showing that a left straight punch is thrown is displayed as the left glove image when the relative position indicated by the current positional information of the left-handed glove type input article is located in the straight area which does not include the origin, an image showing that a left cross punch is thrown is displayed as the left glove image when the relative position indicated by the current positional information of the left-handed glove type input article is located in the cross area which does not include the origin, an image showing that no left punch is thrown is displayed as the left glove image when the relative position indicated by the current positional information of the left-handed glove type input article is located in the immovable area which includes the origin,   in said area determination step for the right-handed glove type input article, an image showing that a right straight punch is thrown is displayed as the right glove image when the relative position indicated by the current positional information of the right-handed glove type input article is located in the straight area which does not include the origin, an image showing that a right cross punch is thrown is displayed as the right glove image when the relative position indicated by the current positional information of the right-handed glove type input article is located in the cross area which does not include the origin, an image showing that no right punch is thrown is displayed as the right glove image when the relative position indicated by the current positional information of the right-handed glove type input article is located in the immovable area which includes the origin.   
   
   
       2 . The boxing game processing method as claimed in  claim 1  further comprising:
 a step of obtaining a first extraction point indicative of the position of the left-handed glove type input article or the left-handed glove type input article on the basis of the differential data;   a step of obtaining a second extraction point indicative of the position of the left-handed glove type input article or the left-handed glove type input article on the basis of the differential data;   a step of predicting the current position of the left-handed glove type input article on the basis of past positional information of the left-handed glove type input article;   a step of predicting the current position of the right-handed glove type input article on the basis of past positional information of the right-handed glove type input article;   a step of calculating a first distance which is a distance between the first extraction point and the current position as predicted of the left-handed glove type input article;   a step of calculating a second distance which is a distance between the first extraction point and the current position as predicted of the right-handed glove type input article;   a step of setting the current position of the right-handed glove type input article to the first extraction point if the first distance is larger than the second distance, and setting the current position of the left-handed glove type input article to the first extraction point if the second distance is larger than the first distance;   a step of calculating a third distance which is a distance between the second extraction point and the current position as predicted of the left-handed glove type input article;   a step of calculating a fourth distance which is a distance between the second extraction point and the current position as predicted of the right-handed glove type input article;   a step of setting the current position of the right-handed glove type input article to the second extraction point if the third distance is larger than the fourth distance, and setting the current position of the left-handed glove type input article to the second extraction point if the fourth distance is larger than the third distance.   
   
   
       3 . The boxing game processing method as claimed in  claim 2  further comprising:
 a step of obtaining a maximum horizontal coordinate of pixels that have luminance values larger than a predetermined threshold value in an image on the basis of the differential data;   a step of obtaining a minimum horizontal coordinate of pixels that have luminance values larger than the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a maximum vertical coordinate of pixels that have luminance values larger than the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a minimum vertical coordinate of pixels that have luminance values larger than the predetermined threshold value in the image on the basis of the differential data, wherein   said step of obtaining the first extraction point comprising:   a step of obtaining a first horizontal distance which is a horizontal distance from a starting position of the minimum horizontal coordinate and the minimum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a second horizontal distance which is a horizontal distance from a starting position of the maximum horizontal coordinate and the minimum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of setting the maximum horizontal coordinate to the horizontal coordinate of the first extraction point and the minimum vertical coordinate to the vertical coordinate of the first extraction point if the first horizontal distance is larger than the second horizontal distance, and setting the minimum horizontal coordinate to the horizontal coordinate of the first extraction point and the minimum vertical coordinate to the vertical coordinate of the first extraction point if the second horizontal distance is larger than the first horizontal distance;   said step of obtaining the second extraction point comprising:   a step of obtaining a third horizontal distance which is a horizontal distance from a starting position of the minimum horizontal coordinate and the maximum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a fourth horizontal distance which is a horizontal distance from a starting position of the maximum horizontal coordinate and the maximum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of setting the maximum horizontal coordinate to the horizontal coordinate of the second extraction point and the maximum vertical coordinate to the vertical coordinate of the second extraction point if the third horizontal distance is larger than the fourth horizontal distance, and setting the minimum horizontal coordinate to the horizontal coordinate of the second extraction point and the maximum vertical coordinate to the vertical coordinate of the second extraction point if the fourth horizontal distance is larger than the third horizontal distance;   
   
   
       4 . The boxing game processing method as claimed in  claim 3  further comprising:
 a step of moving a cursor on a screen to follow the variation of the position of the left-handed glove type input article and/or the right-handed glove type input article;   a step of displaying an input area on the screen for receiving an input from an operator;   a step of moving the position of the cursor to a predetermined position in the input area if the cursor is located in a predetermined area including the input area irrespective of the positions of the left-handed glove type input article and the right-handed glove type input article;   a step of displaying an image indicative of the elapsed time after the cursor is located in the predetermined position and/or the remaining time until a predetermined time elapses on the screen; and   a step of performing a predetermined process when the cursor is located in the predetermined area at least in the predetermined time.   
   
   
       5 . A display control method comprising:
 an illumination step of emitting infrared light in a predetermined cycle to illuminate a plurality of input articles which are provided respectively with retroreflective portions   an image generation step of imaging the plurality of input articles both when the infrared light is emitted and when the infrared light is not emitted, and generating image data obtained with illumination and image data obtained without illumination;   a differential data generation step of generating differential data between the image data obtained with illumination and the image data obtained without illumination; and a position calculation step of calculating positional information of the plurality of input articles respectively in the image on the basis of the differential data, wherein   a plurality of virtual screens are provided respectively corresponding to the plurality of input articles, said display control method further comprising: an area determination step of determining in which area the position of the input article is located in the corresponding virtual screen which is divided into a plurality of areas, wherein said position of the input article is a relative position which is indicated by current positional information of the input article and converted into a corresponding coordinate system, the origin of which is located in the position indicated by past positional information of the input article obtained by tracing back for a predetermined number of times, wherein   an image corresponding to each of the plurality of input articles is displayed in accordance with the result of area determination of the each of the plurality of input articles by said area determination step.   
   
   
       6 . The display control method as claimed in  claim 5  wherein the predetermined number of times is a plural number. 
   
   
       7 . The display control method as claimed in  claim 5  wherein the virtual screen is divided into at least two areas including a first area and a second area, and wherein in said area determination step, an image is displayed as an image corresponding to the input article for showing that an input is made when the relative position indicated by the current positional information of the input article is located in the first area which does not include the origin, and an image is displayed as an image corresponding to the input article for showing that no input is made when the relative position indicated by the current positional information of the input article is located in the second area which includes the origin. 
   
   
       8 . The display control method as claimed in  claim 5  wherein the virtual screen is divided into at least three areas including a first area, a second area and a third area, and wherein in said area determination step, an image is displayed as an image corresponding to the input article for showing that a first input is made when the relative position indicated by the current positional information of the input article is located in the first area which does not include the origin, an image which is different from the image showing that the first input is made is displayed as an image corresponding to the input article for showing that a second input is made when the relative position indicated by the current positional information of the input article is located in the second area which does not include the origin, and an image is displayed as an image corresponding to the input article for showing that no input is made when the relative position indicated by the current positional information of the input article is located in the third area which includes the origin. 
   
   
       9 . A position detection method comprising:
 a step of emitting infrared light in a predetermined cycle to illuminate a first input article and a second input article which are provided respectively with retroreflective portions   a step of imaging the first input article and the second input article both when the infrared light is emitted and when the infrared light is not emitted, and generating image data obtained with illumination and image data obtained without illumination;   a step of generating differential data between the image data obtained with illumination and the image data obtained without illumination;   a step of obtaining a first extraction point indicative of the position of the first input article or the second input article on the basis of the differential data;   a step of obtaining a second extraction point indicative of the position of the first input article or the second input article on the basis of the differential data;   a step of predicting the current position of the first input article on the basis of past positional information of the first input article;   a step of predicting the current position of the second input article on the basis of past positional information of the second input article;   a step of calculating a first distance which is a distance between the first extraction point and the current position as predicted of the first input article;   a step of calculating a second distance which is a distance between the first extraction point and the current position as predicted of the second input article;   a step of calculating a third distance which is a distance between the second extraction point and the current position as predicted of the first input article;   a step of calculating a fourth distance which is a distance between the second extraction point and the current position as predicted of the second input article;   a step of setting the current position of the second input article to the first extraction point if the first distance is larger than the second distance, and setting the current position of the first input article to the first extraction point if the second distance is larger than the first distance;   a step of setting the current position of the second input article to the second extraction point if the third distance is larger than the fourth distance, and setting the current position of the first input article to the second extraction point if the fourth distance is larger than the third distance.   
   
   
       10 . The position detection method as claimed in  claim 9  further comprising:
 a step of obtaining a maximum horizontal coordinate of pixels that have luminance values larger than a predetermined threshold value in an image on the basis of the differential data;   a step of obtaining a minimum horizontal coordinate of pixels that have luminance values larger than the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a maximum vertical coordinate of pixels that have luminance values larger than the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a minimum vertical coordinate of pixels that have luminance values larger than the predetermined threshold value in the image on the basis of the differential data, wherein   said step of obtaining the first extraction point comprising:   a step of obtaining a first horizontal distance which is a horizontal distance from a starting position of the minimum horizontal coordinate and the minimum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a second horizontal distance which is a horizontal distance from a starting position of the maximum horizontal coordinate and the minimum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of setting the maximum horizontal coordinate to the horizontal coordinate of the first extraction point and the minimum vertical coordinate to the vertical coordinate of the first extraction point if the first horizontal distance is larger than the second horizontal distance, and setting the minimum horizontal coordinate to the horizontal coordinate of the first extraction point and the minimum vertical coordinate to the vertical coordinate of the first extraction point if the second horizontal distance is larger than the first horizontal distance;   said step of obtaining the second extraction point comprising:   a step of obtaining a third horizontal distance which is a horizontal distance from a starting position of the minimum horizontal coordinate and the maximum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of obtaining a fourth horizontal distance which is a horizontal distance from a starting position of the maximum horizontal coordinate and the maximum vertical coordinate to the position of the pixel having the luminance value of which first exceeds the predetermined threshold value in the image on the basis of the differential data;   a step of setting the maximum horizontal coordinate to the horizontal coordinate of the second extraction point and the maximum vertical coordinate to the vertical coordinate of the second extraction point if the third horizontal distance is larger than the fourth horizontal distance, and setting the minimum horizontal coordinate to the horizontal coordinate of the second extraction point and the maximum vertical coordinate to the vertical coordinate of the second extraction point if the fourth horizontal distance is larger than the third horizontal distance.   
   
   
       11 . A cursor control method comprising:
 a step of emitting infrared light in a predetermined cycle to illuminate an input article which is provided with a retroreflective portion;   a step of imaging the input article both when the infrared light is emitted and when the infrared light is not emitted, and generating image data obtained with illumination and image data obtained without illumination;   a step of generating differential data between the image data obtained with illumination and the image data obtained without illumination;   a step of calculating the position of the input article on the basis of the differential data;   a step of moving a cursor on a screen to follow the variation of the position of the input article;   a step of displaying an input area on the screen for receiving an input from an operator;   a step of moving the position of the cursor to a predetermined position in the input area if the cursor is located in a predetermined area including the input area irrespective of the position of the input article;   a step of displaying an image indicative of the elapsed time after the cursor is located in the predetermined position and/or the remaining time until a predetermined time elapses on the screen; and   a step of performing a predetermined process when the cursor is located in the input area at least for the predetermined time.   
   
   
       12 . An energy consumption calculating method comprising:
 a step of emitting infrared light in a predetermined cycle to illuminate an operation article operated by a user;   a step of imaging the operation article both when the infrared light is emitted and when the infrared light is not emitted, and generating image data obtained with illumination and image data obtained without illumination;   a step of generating differential data between the image data obtained with illumination and the image data obtained without illumination;   a step of calculating state information of the operation article the basis of the differential data; and   a step of calculating energy consumption when the user operates the operation article on the basis of the state information.   
   
   
       13 . The energy consumption calculating method as claimed in  claim 12  wherein said step of calculating said energy consumption comprising:
 a step of determining which of a plurality of motion patterns the motion of the operation article belongs;   a step of calculating said energy consumption on the basis of the motion pattern as determined.   
   
   
       14 . The energy consumption calculating method as claimed in  claim 12  wherein said step of calculating said energy consumption comprising:
 a step of calculating a moving distance of the operation article on the basis of positional information as the state information; and   a step of calculating said energy consumption on the basis of the moving distance as calculated.   
   
   
       15 . The energy consumption calculating method as claimed in  claim 12  wherein said step of calculating said energy consumption comprising:
 a step of determining which of a plurality of motion patterns the motion of the operation article belongs;   a step of calculating first energy consumption on the basis of the motion pattern as determined;   a step of calculating a moving distance of the operation article on the basis of positional information as the state information;   a step of calculating second energy consumption on the basis of the moving distance as calculated; and   a step of calculating said energy consumption by adding the first energy consumption and the second energy consumption.   
   
   
       16 . The energy consumption calculating method as claimed in  claim 12  wherein the state information is one of or any combination of two or more of speed information, moving direction information, moving distance information, velocity vector information, acceleration information, movement locus information, area information, and positional information. 
   
   
       17 . An exercise system comprising:
 an infrared light emission unit operable to periodically emit infrared light to a retroreflective portion which an exerciser puts on;   an infrared light image sensor operable to detect the infrared light as reflected by the retroreflective portion to obtain a series of image data   a signal processing unit connected to said infrared light image sensor, and operable to generate a first image indicative of an exercise that the exerciser to do, receive the series of image data of the retroreflective portion from said infrared light image sensor while the exerciser does the exercise, calculate calorie consumption estimated of the exerciser, and generate a second image indicative of the calorie consumption,   wherein the calorie consumption is calculated on the basis of the motion of the retroreflective portion corresponding to the exercise that the exerciser has done with reference to the series of image data obtained by said infrared light image sensor.