Smart aiming device with built-in training system for marksmanship and firearm operation

Abstract

A smart aiming device for a firearm includes a processor, a memory, and sensors. The sensors include an inertial measurement unit (IMU) for measuring movement of the firearm; a trigger sensor for monitoring a depression of a trigger of the firearm; and an image sensor configured to capture images of a target region. During operation of the firearm, the sensors collect data and provide said data to the processor and memory for analysis and storage. The device further includes an optical window for viewing a target via at least one of an optical lens and a micro-display. The memory includes a non-transitory computer-readable medium storing therein instructions, that, when executed by the processor, causes the processor to provide feedback to a user regarding one or more techniques of firearm operation, based on analysis of the data collected by the plurality of sensors during operation of the firearm.

1 . A smart aiming device for a firearm, comprising:
 a processor and a memory;   a plurality of sensors including a trigger sensor for monitoring a depression of a trigger of the firearm; and an image sensor configured to capture images of a target region; wherein, during operation of the firearm, the plurality of sensors collect data and provide said data to the processor and memory for analysis and storage; and   a sight including an optical window for viewing a target therethrough via at least one of an arrangement of optical lenses and a micro-display configured to present a video comprising an entire view captured by the image sensor, or an overlay onto the view of the target visible through the optical lenses, through injection of the video into the optical window;   wherein the memory comprises a non-transitory computer-readable medium storing therein instructions, that, when executed by the processor, causes the processor to; receive a user selection regarding a mode of feedback, the user selection being one of feedback in an operational mode in response to a user request following firing of the firearm, wherein, in the absence of a user request, no feedback is provided and the firearm is ready for additional firing, or feedback in a dedicated training mode following a series of actuations of the firearm; and to provide the feedback to the user in the selected mode regarding one or more techniques of firearm operation, based on analysis of the data collected by the plurality of sensors during operation of the firearm.   
     
     
         2 . The device of  claim 1 , wherein the feedback comprises at least one of the following: a) feedback on how far an actual point of aim of the firearm was from the desired point of aim during actuation of the trigger, b) feedback on technique of trigger actuation or on technique of trigger actuation; and c) instruction on how to compensate aiming of the firearm based on at least one of type of ballistics, movement of the target, range to the target and wind. 
     
     
         3 . The device of  claim 1 , wherein the firearm is adjustable between an unlocked mode, in which the firearm fires whenever the trigger is actuated, and a locked fire mode, in which the processor is configured to time a firing of the firearm following actuation of the trigger based on data collected by the plurality of sensors, so that the firearm fires when the processor determines that a locked-on target will be hit in a desired hit area, wherein the feedback comprises feedback on how to operate the firearm in the locked fire mode, on a process of locking onto a target, or on trigger technique in the locked fire mode. 
     
     
         4 . The device of  claim 1 , wherein the processor is configured to provide the feedback in a non-intrusive manner within the operational mode, by presenting at least one of an icon or text on a perimeter of a field of display and one or more small graphical markings near the target region. 
     
     
         5 . The device of  claim 1 , wherein, the feedback in the dedicated training mode includes feedback regarding consistency of at least one of the user's accuracy or timing during the series of actuations. 
     
     
         6 . The device of  claim 1 , wherein the device is operable in both a live fire mode and a dry fire mode, and the device is configured to provide nearly identical feedback following operation during the dry fire mode as during the live fire mode. 
     
     
         7 . The device of  claim 1 , wherein the device is operable in a virtual reality mode in which the processor presents a virtual reality including one or more virtual reality targets to a user via the micro-display, and the user is capable of simulating firing on the one or more virtual reality targets, and the processor provides feedback to the user in the dedicated training mode regarding the one or more techniques performed within the virtual reality mode. 
     
     
         8 . The device of  claim 1 , wherein the device is operable in an augmented reality mode in which the processor presents one or more augmented reality targets super-imposed over a view of a target obtained from the optical lens, and the user is capable of simulating firing on the one or more augmented reality targets, and the processor provides feedback to the user in the dedicated training mode regarding the one or more techniques performed within the augmented reality mode. 
     
     
         9 . The device of  claim 1 , wherein the device is configured to perform preconfigured training sets that include shooting at least one of from predetermined positions, on predetermined targets and in a limited amount of time. 
     
     
         10 . The device of  claim 1 , wherein each of plurality of sensors is used in operation of the firearm, such that no additional hardware components are required for providing the feedback. 
     
     
         11 . A system including the device of  claim 1  and at least one of the following: a) reactive target, wherein the device is configured to detect the hit of said reactive target by detecting its fall or any other visual signal that said reactive target provides when the reactive target is hit, or b) communicative target, wherein the device is configured to provide feedback based on information communicated to the processor by the at least one communicative target communicative target, wherein the device is configured to provide feedback based on information communicated to the processor by the at least one communicative target. 
     
     
         12 . A method of providing training for a firearm with a smart aiming device, the method comprising:
 during operation of the firearm, collecting data from a plurality of sensors including a trigger sensor for monitoring a depression of a trigger of the firearm; and an image sensor configured to capture images of a target region, and providing said data to a processor and memory for analysis and storage; and   providing feedback to a user regarding one or more techniques of firearm operation, based on analysis of the data collected by the plurality of sensors;   wherein the providing step is performed by projecting the feedback from a micro-display into an optical window of a sight of the firearm;   wherein the step of providing feedback comprises, following a user selection of a mode of feedback, providing the feedback within one of: an operational mode in response to a user request following firing of the firearm, wherein, in the absence of a user request, no feedback is provided and the firearm is ready for additional firing, or in a dedicated training mode following a series of actuations of the firearm.   
     
     
         13 . The method of  claim 12 , wherein the step of providing feedback comprises providing the feedback in a non-intrusive manner within the operational mode, by presenting at least one of an icon or text on a perimeter of a field of display and one or more small graphical markings near the target region. 
     
     
         14 . The method of  claim 12 , wherein the feedback includes at least one of the following: a) feedback regarding consistency of at least one of the user's accuracy or timing during the series of actuations; b) the step of providing the feedback comprises providing feedback on preconfigured training sets that include shooting at least one of from predetermined positions, on predetermined targets and in a limited amount of time; c) feedback on how far an actual point of aim of the firearm was from the desired point of aim during actuation of the trigger; d) feedback on technique of trigger actuation; e) feedback on barrel roll; and f) instruction on how to compensate aiming of the firearm based on at least one of type of ballistics, movement of the target, range to the target and wind. 
     
     
         15 . The method of  claim 12 , wherein the firearm is adjustable between an unlocked mode, in which the firearm fires whenever the trigger is actuated, and a locked fire mode, in which the processor is configured to time a firing of the firearm following actuation of the trigger based on data collected by the plurality of sensors, so that the firearm fires when the processor determines that a locked-on target will be hit in a desired hit area, and the feedback comprises feedback on at least one of: how to operate the firearm in the locked fire mode; a process of locking onto a target; and trigger technique in the locked fire mode. 
     
     
         16 . (canceled) 
     
     
         17 . (canceled) 
     
     
         18 . (canceled) 
     
     
         19 . (canceled) 
     
     
         20 . (canceled) 
     
     
         21 . (canceled) 
     
     
         22 . (canceled) 
     
     
         23 . (canceled) 
     
     
         24 . (canceled) 
     
     
         25 . (canceled) 
     
     
         26 . (canceled) 
     
     
         27 . (canceled) 
     
     
         28 . (canceled) 
     
     
         29 . (canceled) 
     
     
         30 . (canceled) 
     
     
         31 . (canceled)