US10621733B2ActiveUtilityA1

Enhanced visualization of breathing or heartbeat of an infant or other monitored subject

74
Assignee: GOOGLE LLCPriority: Dec 31, 2017Filed: Dec 31, 2017Granted: Apr 14, 2020
Est. expiryDec 31, 2037(~11.5 yrs left)· nominal 20-yr term from priority
G16H 40/67G16H 30/40A61B 5/743A61B 5/1128G06T 3/4069A61B 2576/00G08B 21/0415A61B 5/1135A61B 2503/04A61B 5/0077A61B 5/0205A61B 5/744A61B 5/0046A61B 5/7264A61B 5/747G06T 2207/30076A61B 5/02427A61B 5/6898A61B 5/725A61B 5/0022G06T 7/246A61B 5/4806G08B 21/0476G06T 2207/30196A61B 5/113A61B 2576/02H04N 7/183G06T 2207/10016A61B 5/0816G06K 9/00711G06K 9/00342G06V 40/23G06V 20/40
74
PatentIndex Score
1
Cited by
57
References
16
Claims

Abstract

A method of monitoring physical characteristics of subjects in sleep environments may include receiving, through a video camera, a video feed of a subject in a sleep environment; analyzing the video feed of the subject to identify motion of the subject in the video feed; and causing a mobile device to present a representation of the motion of the subject, wherein the motion of the subject is exaggerated.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A method of monitoring physical characteristics of subjects in sleep environments, the method comprising: receiving, through a video camera, a video feed of a subject in a sleep environment; analyzing the video feed of the subject to identify motion of the subject in the video feed that is below a threshold amount of motion; generating a displacement map for pixels moving below the threshold amount of motion, wherein the displacement map comprises values indicating a distance by which the pixels in a previous frame have moved in relation to a current frame; and causing a mobile device to present a representation of the motion of the subject, wherein the motion of the subject that is below the threshold amount of motion is exaggerated by: scaling the values in the displacement map; altering pixel locations in the video feed based on the displacement map after scaling the values in the displacement map; and displaying the pixels with altered locations in an overlaid fashion in the video feed. 
     
     
       2. The method of  claim 1 , wherein analyzing the video feed of the subject to identify motion of the subject in the video feed comprises identifying motions of the subject that are repeated. 
     
     
       3. The method of  claim 1 , wherein analyzing the video feed of the subject to identify the motion of the subject in the video feed comprises analyzing the video feed of the subject to identify motion of the subject in the video feed comprises identifying motions of the subject that are repeated and less than a threshold amount of motion. 
     
     
       4. The method of  claim 1 , wherein analyzing the video feed further comprises identifying an area in a field-of-view of the camera that includes the motion of the subject. 
     
     
       5. The method of  claim 4 , wherein analyzing the video feed further comprises reducing a resolution of the video feed outside of the area. 
     
     
       6. The method of  claim 1 , wherein the motion of the subject in the video feed comprises a rhythmic breathing motion. 
     
     
       7. The method of  claim 1 , wherein the motion of the subject in the video feed comprises a chest rising and falling with a heartbeat of the subject. 
     
     
       8. A system for monitoring physical characteristics of subjects in sleep environments, the system comprising: a video camera; one or more processors; and one or more memory devices comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: receiving, through a video camera, a video feed of a subject in a sleep environment; analyzing the video feed of the subject to identify motion of the subject in the video feed that is below a threshold amount of motion; generating a displacement map for pixels moving below the threshold amount of motion, wherein the displacement map comprises values indicating a distance by which the pixels in a previous frame have moved in relation to a current frame; and causing a mobile device to present a representation of the motion of the subject, wherein the motion of the subject that is below the threshold amount of motion is exaggerated by: scaling the values in the displacement map; altering pixel locations in the video feed based on the displacement map after scaling the values in the displacement map; and displaying the pixels with altered locations in an overlaid fashion in the video feed. 
     
     
       9. The system of  claim 8 , wherein the mobile device comprises a smart phone. 
     
     
       10. The system of  claim 8 , further comprising a monitor server, wherein the one or more processors are at least partially located at the monitor server. 
     
     
       11. The system of  claim 8 , wherein the representation of the motion of the subject comprises a pulsating graphic to be displayed on the mobile device where the pulsating is based on a timing of the motion of the subject. 
     
     
       12. The system of  claim 8 , wherein the representation of the motion of the subject comprises a rhythmic audio output that is based on a timing of the motion of the subject. 
     
     
       13. The system of  claim 8 , wherein analyzing the video feed of the subject to identify motion of the subject in the video feed comprises identifying motions of the subject that are repeated. 
     
     
       14. The system of  claim 8 , wherein analyzing the video feed of the subject to identify the motion of the subject in the video feed comprises filtering motions that are larger than a threshold amount of motion or which are not repeated. 
     
     
       15. The system of  claim 8 , wherein analyzing the video feed further comprises identifying an area in a field-of-view of the camera that includes the motion of the subject. 
     
     
       16. The system of  claim 15 , wherein analyzing the video feed further comprises reducing a resolution of the video feed outside of the area.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.