Systems and methods for triggering a frame capture in a wearable device

Abstract

Frame capture techniques may include obtaining, from at least one sensor, sensor data indicating a motion rate of the system in the environment, receiving a request for the image data of the environment, and selecting, by the controller, a frame rate based on one or more requesting client applications and the sensor data. In addition, the frame tracking techniques may include detecting, based on a motion parameter in the sensor data and by the controller, that a motion of the system falls below a predetermined threshold; and triggering frame capture by the camera in accordance with the sensor data and the selected frame rate, the frame capture being triggered in accordance with the request and the detection.

The invention claimed is: 
     
       1. A system comprising:
 a camera affixed in a wearable device and configured for collecting image data of an environment; 
 at least one sensor of the wearable device operably connected to the camera and configured to capture motion data; and 
 a controller communicably coupled to the camera and the at least one sensor and configured to:
 collect, by the at least one sensor, sensor data indicating a motion rate of the wearable device in the environment, and 
 in response to detecting a trigger for collection of image frames from one or more client applications:
 determine an image capture criterion based on the one or more requesting client applications, 
 determine, based on the motion rate, a supported frame rate, and 
 initiate frame capture by the camera in response to a determination that the supported frame rate satisfies the image capture criterion. 
 
 
 
     
     
       2. The system of  claim 1 , the controller further configured to:
 obtain, from the one or more requesting client applications, the request for image data, 
 trigger the frame capture in accordance with the request for image data obtained from the one or more requesting client applications. 
 
     
     
       3. The system of  claim 1 ,
 wherein the one or more requesting client applications comprises a plurality of requesting client applications, and 
 wherein the frame capture is triggered in accordance with a combination of the plurality of requesting client applications. 
 
     
     
       4. The system of  claim 3 , wherein the controller is further configured to:
 receive image frames from the camera; and 
 store the image frames in a frame buffer, wherein the frame buffer is available to the plurality of requesting client applications. 
 
     
     
       5. The system of  claim 4 ,
 wherein the controller is further configured to, when one requesting client application request out of the plurality of requesting client applications requests an asynchronous request for image data, trigger an asynchronous frame capture in addition to the frame capture, and 
 wherein the asynchronous frame capture is a frame capture type that is not delayed to be stored in the frame buffer. 
 
     
     
       6. The system of  claim 1 ,
 wherein the controller is further configured to trigger the frame capture by detecting, based on a motion parameter in the sensor data, that a motion of the system falls below a predetermined threshold, and 
 wherein the frame capture is triggered in accordance with the detection. 
 
     
     
       7. The system of  claim 1 ,
 wherein the frame capture comprises capturing frames from the camera over a period of time, and 
 wherein the controller is further configured to, in accordance with a determination that the frame capture has ceased, trigger the camera to enter a low power state. 
 
     
     
       8. A system comprising:
 a camera affixed in a wearable device and configured for collecting image data of an environment; 
 at least one sensor of the wearable device operably connected to the camera; and 
 a controller communicably coupled to the camera and the at least one sensor and configured to:
 cause at least one sensor to collect sensor data indicating a motion rate of the wearable device in the environment, and 
 in response to detecting a trigger for collection of image frames from one or more requesting client applications:
 select a frame rate based on one or more requesting client applications and the sensor data, 
 trigger a high power mode of the wearable device to initiate frame capture by the camera in response to the sensor data indicating the motion rate of the wearable device falls below a predetermined threshold, wherein the predetermined threshold is associated with the frame rate, and 
 capture image data at the selected frame rate. 
 
 
 
     
     
       9. The system of  claim 8 , the controller further configured to:
 obtain, from the one or more requesting client applications, the request for image data, 
 trigger the frame capture in accordance with the request for image data obtained from the one or more requesting client applications. 
 
     
     
       10. The system of  claim 8 ,
 wherein the one or more requesting client applications comprises a plurality of requesting client applications, and 
 wherein the frame capture is triggered in accordance with a combination of the plurality of requesting client applications. 
 
     
     
       11. The system of  claim 10 , wherein the controller is further configured to:
 receive image frames from the camera; and 
 store the image frames in a frame buffer, wherein the frame buffer is available to the plurality of requesting client applications. 
 
     
     
       12. The system of  claim 11 ,
 wherein the controller is further configured to, when one requesting client application out of the plurality of requesting client applications requests an asynchronous request for image data, trigger an asynchronous frame capture in addition to the frame capture, and 
 wherein the asynchronous frame capture is a frame capture type that is not delayed to be stored in the frame buffer. 
 
     
     
       13. The system of  claim 8 ,
 wherein the frame capture comprises capturing frames from the camera over a period of time, and 
 wherein the controller is further configured to, in accordance with a determination that the frame capture has ceased, trigger the camera to enter a low power state. 
 
     
     
       14. The system of  claim 8 , wherein the predetermined threshold corresponds to a motion measurement at which the selected frame rate produces an image satisfying a predetermined sharpness metric. 
     
     
       15. A non-transitory computer readable medium comprising instructions that, when executed by at least one computer processor, cause the at least one computer processor to:
 cause at least one sensor to collect sensor data indicating a motion rate of a wearable device in an environment, and 
 in response to detecting a trigger for collection of image frames from one or more requesting client applications:
 select a frame rate based on one or more requesting client applications and the sensor data, 
 trigger a high power mode of the wearable device to initiate frame capture by a camera in response to the sensor data indicating the motion rate of the wearable device falls below a predetermined threshold, wherein the predetermined threshold is associated with the frame rate, and 
 capture image data at the selected frame rate. 
 
 
     
     
       16. The non-transitory computer readable medium of  claim 15 , wherein the at least one computer processor is further caused to:
 obtain, from the one or more requesting client applications, a request for image data, 
 trigger the frame capture in accordance with the request for image data obtained from the one or more requesting client applications. 
 
     
     
       17. The non-transitory computer readable medium of  claim 15 ,
 wherein the one or more requesting client applications comprises a plurality of requesting client applications, and 
 wherein the frame capture is triggered in accordance with a combination of the plurality of requesting client applications. 
 
     
     
       18. The non-transitory computer readable medium of  claim 17 , wherein the at least one computer processor is further caused to:
 receive image frames from the camera; and 
 store the image frames in a frame buffer, wherein the frame buffer is available to the plurality of requesting client applications. 
 
     
     
       19. The non-transitory computer readable medium of  claim 18 ,
 wherein the processor is further configured to, when one requesting client application request out of the plurality of requesting client applications requests an asynchronous request for image data, trigger an asynchronous frame capture in addition to the frame capture, and 
 wherein the asynchronous frame capture is a frame capture type that is not delayed to be stored in the frame buffer. 
 
     
     
       20. The non-transitory computer readable medium of  claim 15 ,
 wherein the frame capture comprises capturing frames from the camera over a period of time, and 
 wherein the processor is further configured to, in accordance with a determination that the frame capture has ceased, trigger the camera to enter a low power state.