Touchless photo capture in response to detected hand gestures

Abstract

Example systems, devices, media, and methods are described for capturing still images in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. A localization system determines the eyewear location relative to the physical environment. An image processing system detects a hand shape in the video data and determines whether the detected hand shape matches a border gesture or a shutter gesture. In response to a border gesture, the system establishes a border that defines the still image to be captured. In response to a shutter gesture, the system captures a still image from the frames of video data. The system determines a shutter gesture location relative to the physical environment. The captured still image is presented on the display at or near the shutter gesture location, such that the still image appears anchored relative to the physical environment. The captured still image is viewable by other devices that are using the image capture system.

What is claimed is: 
     
         1 . A method of capturing a still image using an eyewear device, the eyewear device comprising a camera system, an image processing system, and a display, the method comprising:
 capturing frames of video data of a physical environment with the camera system;   detecting a shutter gesture and a shutter gesture location in a first frame of the captured frames of video data with the image processing system; and   presenting on the display a captured still image selected from a subset of captured frames excluding the first frame, wherein the captured still image is associated with the shutter gesture location.   
     
     
         2 . The method of  claim 1 , wherein presenting the captured image further comprises:
 selecting the subset of captured frames, wherein the subset comprises one or more frames preceding or following the first frame.   
     
     
         3 . The method of  claim 1 , wherein detecting the shutter gesture further comprises:
 presenting an indicator using the eyewear device, the indicator comprising a brief alert selected from the group consisting of a simulated shutter effect presented on the display, a flash presented on the display, a rectangular shape presented on the display, a sound emitted from a loudspeaker, and a vibration generated by an actuator.   
     
     
         4 . The method of  claim 1 , wherein detecting the shutter gesture further comprises:
 detecting a hand shape in the first frame;   determining whether the detected hand shape matches one or more hand gestures stored in a hand gesture library, wherein the one or more stored hand gestures comprises a gesture selected from the group consisting of an extended finger appearing to tap an imaginary plane and a finger of a single hand in momentary contact with a thumb of the single hand.   
     
     
         5 . The method of  claim 1 , further comprising:
 determining an eyewear location relative to the physical environment with a localization system;   estimating the shutter gesture location relative to the eyewear location; and   presenting the captured still image on the display in accordance with the shutter gesture location and the eyewear location, such that the captured still image appears persistently anchored relative to the physical environment.   
     
     
         6 . The method of  claim 1 , wherein detecting the shutter gesture further comprises:
 detecting a border gesture in the first frame, wherein the border gesture defines a field of view; and   presenting the captured still image in accordance with the defined field of view.   
     
     
         7 . The method of  claim 6 , wherein detecting the shutter gesture further comprises:
 presenting a border indicator on the display, the indicator comprising a rectangular border sized according to the defined field of view.   
     
     
         8 . The method of  claim 6 , wherein detecting the shutter gesture further comprises:
 detecting a border hand shape in the first frame;   determining whether the detected border hand shape matches one or more border hand gestures stored in a hand gesture library, wherein the one or more stored border hand gestures comprises a gesture selected from the group consisting of (a) an L shape comprising an index finger of a first hand spaced apart from a thumb of the first hand, wherein the L shape defines an approximate corner of the field of view, (b) the L shape together with a similar L shape made by a second hand, wherein the two L shapes define two or more approximate corners of the field of view, and (c) an extended finger appearing to tap an imaginary plane, wherein the field of view comprises a default size and shape relative to the extended finger tap.   
     
     
         9 . The method of  claim 1 , wherein presenting the captured image further comprises:
 broadcasting to other eyewear devices one or more of the captured still image and the shutter gesture location.   
     
     
         10 . An image capture system, comprising:
 an eyewear device comprising a processor, a memory, a camera system, an image processing system, and a display;   programming in the memory, wherein execution of said programming by the processor configures the eyewear device to perform functions, including functions to:   capture frames of video data of a physical environment with the camera system;   detect a shutter gesture and a shutter gesture location in a first frame of the captured frames of video data with the image processing system; and   present on the display a captured still image selected from a subset of captured frames excluding the first frame, wherein the captured still image is associated with the shutter gesture location.   
     
     
         11 . The image capture system of  claim 10 , wherein the function to present the captured image further comprises functions to:
 select the subset of captured frames, wherein the subset comprises one or more frames preceding or following the first frame;   present an indicator using the eyewear device, the indicator comprising a brief alert selected from the group consisting of a simulated shutter effect presented on the display, a flash presented on the display, a rectangular shape presented on the display, a sound emitted from a loudspeaker, and a vibration generated by an actuator; and   broadcast to other eyewear devices one or more of the captured still image and the shutter gesture location.   
     
     
         12 . The image capture system of  claim 10 , wherein the function to detect the shutter gesture further comprises functions to:
 detect a hand shape in the first frame; and   determine whether the detected hand shape matches one or more hand gestures stored in a hand gesture library, wherein the one or more stored hand gestures comprises a gesture selected from the group consisting of an extended finger appearing to tap an imaginary plane and a finger of a single hand in momentary contact with a thumb of the single hand.   
     
     
         13 . The image capture system of  claim 10 , wherein the execution of the programming further configures the eyewear device to:
 determine an eyewear location relative to the physical environment with a localization system;   estimate the shutter gesture location relative to the eyewear location; and   present the captured still image on the display in accordance with the shutter gesture location and the eyewear location, such that the captured still image appears persistently anchored relative to the physical environment.   
     
     
         14 . The image capture system of  claim 10 , wherein the function to detect the shutter gesture further comprises functions to:
 detect a border hand shape in the first frame, wherein the border hand shape defines a field of view;   determine whether the detected border hand shape matches one or more border hand gestures stored in a hand gesture library, wherein the one or more stored border hand gestures comprises a gesture selected from the group consisting of (a) an L shape comprising an index finger of a first hand spaced apart from a thumb of the first hand, wherein the L shape defines an approximate corner of the field of view, (b) the L shape together with a similar L shape made by a second hand, wherein the two L shapes define two or more approximate corners of the field of view, and (c) an extended finger appearing to tap an imaginary plane, wherein the field of view comprises a default size and shape relative to the extended finger tap;   present a border indicator on the display, the indicator comprising a rectangular border sized according to the defined field of view;   present the captured still image in accordance with the defined field of view; and   broadcast to other eyewear devices one or more of the captured still image, the shutter gesture location, the border indicator, and the defined field of view.   
     
     
         15 . A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor to perform the steps of:
 capturing frames of video data of a physical environment with a camera system coupled to an eyewear device comprising a processor, a memory, an image processing system, and a display;   detecting a shutter gesture and a shutter gesture location in a first frame of the captured frames of video data with the image processing system; and   presenting on the display a captured still image selected from a subset of captured frames excluding the first frame, wherein the captured still image is associated with the shutter gesture location.   
     
     
         16 . The non-transitory computer-readable medium storing program code of  claim 15 , wherein the program code, when executed, is operative to cause the electronic processor to perform the further steps of:
 selecting the subset of captured frames, wherein the subset comprises one or more frames preceding or following the first frame;   presenting an indicator using the eyewear device, the indicator comprising a brief alert selected from the group consisting of a simulated shutter effect presented on the display, a flash presented on the display, a rectangular shape presented on the display, a sound emitted from a loudspeaker, and a vibration generated by an actuator; and   broadcasting to other eyewear devices one or more of the captured still image and the shutter gesture location.   
     
     
         17 . The non-transitory computer-readable medium storing program code of  claim 15 , wherein the program code, when executed, is operative to cause the electronic processor to perform the further steps of:
 detecting a hand shape in the first frame; and   determining whether the detected hand shape matches one or more hand gestures stored in a hand gesture library, wherein the one or more stored hand gestures comprises a gesture selected from the group consisting of an extended finger appearing to tap an imaginary plane and a finger of a single hand in momentary contact with a thumb of the single hand.   
     
     
         18 . The non-transitory computer-readable medium storing program code of  claim 15 , wherein the program code, when executed, is operative to cause the electronic processor to perform the further steps of:
 determining an eyewear location relative to the physical environment with a localization system;   estimating the shutter gesture location relative to the eyewear location; and   presenting the captured still image on the display in accordance with the shutter gesture location and the eyewear location, such that the captured still image appears persistently anchored relative to the physical environment.   
     
     
         19 . The non-transitory computer-readable medium storing program code of  claim 15 , wherein the program code, when executed, is operative to cause the electronic processor to perform the further steps of:
 detecting a border hand shape in the first frame, wherein the border hand shape defines a field of view;   determining whether the detected border hand shape matches one or more border hand gestures stored in a hand gesture library, wherein the one or more stored border hand gestures comprises a gesture selected from the group consisting of (a) an L shape comprising an index finger of a first hand spaced apart from a thumb of the first hand, wherein the L shape defines an approximate corner of the field of view, (b) the L shape together with a similar L shape made by a second hand, wherein the two L shapes define two or more approximate corners of the field of view, and (c) an extended finger appearing to tap an imaginary plane, wherein the field of view comprises a default size and shape relative to the extended finger tap; and   presenting the captured still image in accordance with the defined field of view.   
     
     
         20 . The non-transitory computer-readable medium storing program code of  claim 19 , wherein the program code, when executed, is operative to cause the electronic processor to perform the further steps of:
 presenting a border indicator on the display, the indicator comprising a rectangular border sized according to the defined field of view; and   broadcasting to other eyewear devices one or more of the captured still image, the shutter gesture location, the border indicator, and the defined field of view.