Adapting Media Content to a Sensed State of a User

Abstract

A media system controls presentation of media content based on a detected state of a user. The user state may be detected based on biometric inputs that may be derived from IMU and/or microphone data. The biometric inputs may include a heart rate detected from IMU data representing motion of a head-mounted media processing device, a breathing rate detected from IMU data representing motion of a head-mounted media processing device, a breathing rate detected based on microphone data, or a combination thereof.

1 . A non-transitory computer readable medium comprising instructions, the instructions, when executed by a computer system, causing the computer system to perform operations including:
 presenting first content on a display device;   obtaining motion data from an inertial measurement device;   filtering the motion data to apply a smoothing function to the motion data to generate smoothed motion data;   detecting a breath based on identifying that the smoothed motion data includes movement constrained to one or more predefined amplitude ranges associated with breathing movement over a predefined time window;   identifying a breathing rate based on the detected breath; and   presenting second content of the display device responsive to the detected breathing rate falling within a predefined breathing rate range.   
     
     
         2 . The non-transitory computer-readable storage medium of  claim 1 , wherein detecting the breath comprises identifying that the smoothed motion data includes a change in vertical position of the inertial measurement device within the one or more predefined amplitude ranges. 
     
     
         3 . The non-transitory computer-readable storage medium of  claim 2 , wherein the one or more predefined amplitude ranges comprises a first range at a beginning of the time window and decreases to a second range at an end of the time window. 
     
     
         4 . The non-transitory computer-readable storage medium of  claim 1 , wherein detecting the breath comprises identifying that the smoothed motion data comprises a change in pitch of the inertial measurement device about an axis parallel to a width of a human body within the one or more predefined amplitude ranges. 
     
     
         5 . The non-transitory computer-readable storage medium of  claim 1 , wherein detecting the breath comprises identifying that the smoothed motion data includes a change in vertical position of the inertial measurement device within a first predefined amplitude range of the one or more predefined amplitude ranges and identifying that the smoothed motion data comprises a change in pitch of the inertial measurement device about an axis parallel to a width of a human body within a second predefined amplitude range of the one or more predefined amplitude ranges. 
     
     
         6 . The non-transitory computer-readable storage medium of  claim 1 , wherein detecting the breath comprises:
 detecting an inhale by detecting a positive change in the smoothed motion data within the one or more predefined amplitude ranges; and   detecting an exhale by detecting a negative change in the smoothed motion data within the one or more predefined amplitude ranges that occurs within a predefined time proximity to the inhale.   
     
     
         7 . The non-transitory computer-readable storage medium of  claim 1 , wherein detecting the breath further comprises:
 obtaining ambient audio from a microphone;   detecting a predicted occurrence of the breath based on the ambient audio; and   detecting the breath in response to the predicted occurrence of the breath based on the ambient audio substantially coinciding in time with the smoothed motion data indicating the movement constrained to the one or more predefined amplitude ranges.   
     
     
         8 . The non-transitory computer-readable storage medium of  claim 1 , wherein the one or more predefined amplitude ranges are a first set of one or more predefined amplitude ranges, and wherein the operations further comprise:
 further filtering the smoothed motion data to remove movements determined to be related to the breath;   detecting a heart beat based on identifying that the further filtered smoothed motion data includes movement within a second set of one or more predefined amplitude ranges;   identifying a heart rate based on the heart beat; and   presenting third content of the display device responsive to the identified heart rate falling within a predefined heart rate range   
     
     
         9 . The non-transitory computer-readable storage medium of  claim 8 , wherein identifying that the further filtered smoothed motion data includes movement within the second set of one or more predefined amplitude ranges comprises:
 identifying that the further filtered smoothed motion data includes a change in vertical position of the inertial measurement device within the second set of one or more predefined amplitude ranges.   
     
     
         10 . The non-transitory computer-readable storage medium of  claim 8 , wherein identifying that the further filtered smoothed motion data includes movement within the second set of one or more predefined amplitude ranges comprises:
 identifying that the further filtered smoothed motion data includes a change in pitch of the inertial measurement device about an axis parallel to a width of a human body within the second set of one or more predefined amplitude ranges.   
     
     
         11 . The non-transitory computer-readable storage medium of  claim 8 , wherein identifying that the further filtered smoothed motion data includes movement within the second set of one or more predefined amplitude ranges comprises:
 identifying that the further filtered smoothed motion data includes a change in vertical position of the inertial measurement device within a first predefined amplitude range of the second set of one or more predefined amplitude ranges; and   identifying that the further filtered smoothed motion data includes a change in pitch of the inertial measurement device about an axis parallel to a width of a human body within a second predefined amplitude range of the second set of one or more predefined amplitude ranges.   
     
     
         12 . A method for adapting content based on a detected breathing rate, the method comprising:
 presenting first content on a display device;   obtaining motion data from an inertial measurement device;   filtering the motion data to apply a smoothing function to the motion data to generate smoothed motion data;   detecting a breath based on identifying that the smoothed motion data includes movement constrained to one or more predefined amplitude ranges associated with breathing movement over a predefined time window;   identifying a breathing rate based on the detected breath; and   presenting second content of the display device responsive to the detected breathing rate falling within a predefined breathing rate range.   
     
     
         13 . The method of  claim 12 , wherein detecting the breath comprises identifying that the smoothed motion data includes a change in vertical position of the inertial measurement device within the one or more predefined amplitude ranges. 
     
     
         14 . The method of  claim 13 , wherein the one or more predefined amplitude ranges comprises a first range at a beginning of the time window and decreases to a second range at an end of the time window. 
     
     
         15 . The method of  claim 12 , wherein detecting the breath comprises identifying that the smoothed motion data comprises a change in pitch of the inertial measurement device about an axis parallel to a width of a human body within the one or more predefined amplitude ranges. 
     
     
         16 . The method of  claim 12 , wherein detecting the breath comprises identifying that the smoothed motion data includes a change in vertical position of the inertial measurement device within a first predefined amplitude range of the one or more predefined amplitude ranges and identifying that the smoothed motion data comprises a change in pitch of the inertial measurement device about an axis parallel to a width of a human body within a second predefined amplitude range of the one or more predefined amplitude ranges. 
     
     
         17 . The method of  claim 12 , wherein detecting the breath comprises:
 detecting an inhale by detecting a positive change in the smoothed motion data within the one or more predefined amplitude ranges; and   detecting an exhale by detecting a negative change in the smoothed motion data within the one or more predefined amplitude ranges that occurs within a predefined time proximity to the inhale.   
     
     
         18 . The method of  claim 12 , wherein detecting the breath further comprises:
 obtaining ambient audio from a microphone;   detecting a predicted occurrence of the breath based on the ambient audio; and   detecting the breath in response to the predicted occurrence of the breath based on the ambient audio substantially coinciding in time with the smoothed motion data including the movement constrained to the one or more predefined amplitude ranges.   
     
     
         19 . The method of  claim 12 , wherein the one or more predefined amplitude ranges are a first set of one or more predefined amplitude ranges, further comprising:
 further filtering the smoothed motion data to remove movements determined to be related to the breath;   detecting a heart beat based on identifying that the further filtered smoothed motion data includes movement within a second set of one or more predefined amplitude ranges;   identifying a heart rate based on the heart beat; and   presenting third content of the display device responsive to the identified heart rate falling within a predefined heart rate range   
     
     
         20 . A computer system comprising:
 one or more processors; and   a non-transitory computer-readable storage medium storing instructions for adapting content based on a detected breathing rate, the instructions, when executed by the one or more processors, causing the one or more processors to perform operations including:
 presenting first content on a display device; 
 obtaining motion data from an inertial measurement device; 
 filtering the motion data to apply a smoothing function to the motion data to generate smoothed motion data; 
 detecting a breath based on identifying that the smoothed motion data includes movement constrained to one or more predefined amplitude ranges associated with breathing movement over a predefined time window; 
 identifying a breathing rate based on the detected breath; and 
 presenting second content of the display device responsive to the detected breathing rate falling within a predefined breathing rate range.