Real-time shot detection and scoring based on target image processing

Abstract

An electronic target measurement system is disclosed such that the system includes image capture device(s), an access point device, and a user device. Each image capture device acquires a series of successive real-time images of at least one target with a plurality of regions of interest (ROIs). The access point device receives the images and transmits the images to a user device. The user device performs image preprocessing on the images, determines via an image differentiation process that a difference exists between the images, extracts the ROIs and locations of impact (LOIs) from the received image, and determines ROI center points, LOIs within the ROIs, and LOI center points. The user device also determines regional scores based on the distances between the ROI center points the LOI center points, and then a total score by adding the regional scores for the plurality of extracted ROIs.

What is claimed is: 
     
         1 . An electronic target measurement system comprising:
 at least one image capture device each configured to acquire a series of successive real-time images of at least one target with a plurality of regions of interest (ROIs), wherein the series of successive real-time images includes a primary image and a secondary image taken at a predetermined amount of time after the primary image;   an access point device electrically coupled with the at least one image capture device and configured, in each measurement cycle, to:
 receive the primary and secondary images from the at least one image capture device, and 
 transmit the primary and secondary images to the user device; and 
   a user device electrically coupled with the access point device and configured to:
 perform image preprocessing on the primary and secondary images, 
 determine, via an image differentiation process, that the secondary image is different from the primary image, 
 extract the plurality of ROIs and one or more locations of impact (LOIs) from the secondary image, 
 determine, for each of the plurality of extracted ROIs, a ROI center point, any one of the one or more LOIs within the ROI, and a LOI center point for the corresponding LOI, 
 determine, for the each of the plurality of extracted ROIs, a regional score based on a distance between the ROI center point the LOI center point, and 
 determine a total score by adding the regional scores for the plurality of extracted ROIs. 
   
     
     
         2 . The electronic target measurement system of  claim 1 , wherein the user device is further configured to use the secondary image from a current measurement cycle as a primary image in an image differentiation process of a successive measurement cycle. 
     
     
         3 . The electronic target measurement system of  claim 1 , wherein user device extracts the plurality of ROIs from the secondary image by:
 applying an image correction to the secondary image, wherein the image correction includes (1) determining at least one edge of the at least one target, (2) calculating a plurality of corner locations of the at least one target, (3) transforming the secondary image based on the calculated corner locations, and (4) cropping the transformed secondary image to isolate the at least one target from a background; and   determining the plurality of ROIs in the cropped secondary image by applying a circle Hough transformation to the cropped secondary image.   
     
     
         4 . The electronic target measurement system of  claim 3 , wherein parameters of the image correction are automatically determined based on environmental conditions of the at least one target. 
     
     
         5 . The electronic target measurement system of  claim 3 , wherein the user device extracts the one or more LOIs from the secondary image by:
 cropping the determined plurality of ROIs to isolate the determined plurality of ROIs into a plurality of cropped ROI images; and   determining the one or more LOIs in the cropped ROI images by applying an image threshold adjustment and the circle Hough transformation to the plurality of cropped ROI images.   
     
     
         6 . The electronic target measurement system of  claim 5 , wherein the user device is configured to determine the ROI center point and the LOI center point for the each of the plurality of extracted ROIs by:
 determining a plurality of ROI edges by applying the circle Hough transformation to the cropped ROI images;   determining a corresponding ROI center point based on each of the plurality of ROI edges;   determining one or more LOI edges by applying the circle Hough transformation to the one or more determined LOIs in the cropped ROI images; and   determining a corresponding LOI center point based on each of the one or more LOI edges.   
     
     
         7 . The electronic target measurement system of  claim 6 , wherein the user device is further configured to determine, for each of the one or more determined LOIs, a confidence index of the LOI center point by performing a blob conformity analysis on a shape of the corresponding LOI. 
     
     
         8 . The electronic target measurement system of  claim 6 , wherein the user device comprises a user interface and is further configured to:
 display, on the user interface, the plurality of ROI edges, the plurality of ROI center points, and the one or more LOI edges; and   update the user interface to reflect the regional scores associated with the plurality of ROIs.   
     
     
         9 . The electronic target measurement system of  claim 1 , wherein the user device is further configured to:
 determine, based on a number of ROI center points and a number of LOI center points, that at least one of the ROIs of the target lacks a corresponding LOI associated with the at least one of the ROIs; and   assign the regional score of zero (0) for the at least one of the ROIs without the corresponding LOI.   
     
     
         10 . The electronic target measurement system of  claim 1 , wherein the user device is further configured to estimate, based on the secondary image, a pixel conversion rate to convert pixel values in the primary and secondary images into a physical distance measurement, and the distance between the ROI center point and the LOI center point is converted from pixel values to a corresponding physical distance measurement based the estimated pixel conversion rate. 
     
     
         11 . The electronic target measurement system of  claim 1 , wherein the series of successive real-time images of the at least one target includes a series of photographs taken in intervals defined by the predetermined amount of time. 
     
     
         12 . The electronic target measurement system of  claim 1 , wherein the series of successive real-time images of the at least one target includes a series of video frame images from a video data recorded by the at least one image capture device, wherein the series of video frame images are extracted from the video data in intervals defined by the predetermined amount of time. 
     
     
         13 . The electronic target measurement system of  claim 1 , wherein the at least one image capture device is implemented in the user device. 
     
     
         14 . The electronic target measurement system of  claim 13 , wherein the user device is configured to:
 display the total score; and   provide a user interface to allow a user to manually correct the total score.   
     
     
         15 . The electronic target measurement system of  claim 14 , further comprising a remote cloud platform wirelessly coupled with the user device to receive the total score from the user device. 
     
     
         16 . The electronic target measurement system of  claim 1 , further comprising a remote server electrically coupled with the access point device and the user device, the remote server configured to:
 receive, from a plurality of access point devices or a plurality of user devices, a plurality of total scores associated with a plurality of targets, wherein each target is remotely located with respect to each other; and   transmit, to the user device, a total score associated with one of the other plurality of user devices.   
     
     
         17 . A method comprising:
 receiving, by a user device from an access point device, a real-time image from a series of successive real-time images of at least one target with a plurality of regions of interest (ROIs) acquired by at least one image capture device, wherein the series of successive real-time images are taken by the at least one image capture device in intervals of a predetermined amount of time;   determining, by the user device, that the received image is different from another image from the series of successive real-time images which immediately precedes the received image;   extracting, by the user device, the plurality of ROIs and one or more locations of impact (LOIs) from the received image;   determining, by the user device for each of the plurality of extracted ROIs, a ROI center point, any one of the one or more LOIs within the ROI, and a LOI center point for the corresponding LOI;   determining, by the user device for each of the plurality of extracted ROIs, a regional score based on a distance between the ROI center point the LOI center point; and   determining, by the user device, a total score by adding the regional scores for the plurality of extracted ROIs.   
     
     
         18 . The method of  claim 17 , wherein the plurality of ROIs are extracted from the received secondary image by:
 applying, by the user device, an image correction to the received secondary image, wherein the image correction includes (1) determining at least one edge of the at least one target, (2) calculating a plurality of corner locations of the at least one target, (3) transforming the received secondary image based on the calculated corner locations, and (4) cropping the transformed secondary image to isolate the at least one target from a background; and   determining, by the user device, the plurality of ROIs in the cropped secondary image by applying a circle Hough transformation to the cropped secondary image.   
     
     
         19 . The method of  claim 18 , further comprising:
 determining, by the user device, parameters of the image correction based on environmental conditions of the at least one target.   
     
     
         20 . The method of  claim 17 , wherein the one or more LOIs are extracted from the received secondary image by:
 cropping, by the user device, the determined plurality of ROIs to isolate the determined plurality of ROIs into a plurality of cropped ROI images; and   determining, by the user device, the one or more LOIs in the cropped ROI images by applying an image threshold adjustment and the circle Hough transformation to the plurality of cropped ROI images.   
     
     
         21 . The method of  claim 20 , wherein the ROI center point and the LOI center point are determined by:
 determining a plurality of ROI edges by applying the circle Hough transformation to the cropped ROI images;   determining a corresponding ROI center point based on each of the plurality of ROI edges;   determining one or more LOI edges by applying the circle Hough transformation to the one or more determined LOIs in the cropped ROI images; and   determining a corresponding LOI center point based on each of the one or more LOI edges.   
     
     
         22 . The method of  claim 21 , further comprising:
 displaying, on a user interface of the user device, the plurality of ROI edges, the plurality of ROI center points, and the one or more LOI edges; and   updating, by the user device, the user interface to reflect the regional scores associated with the plurality of ROIs.   
     
     
         23 . The method of  claim 17 , further comprising:
 determining, by the user device based on a number of ROI center points and a number of LOI center points, that at least one of the ROIs of the target lacks a corresponding LOI associated with the at least one of the ROIs; and   assigning, by the user device, the regional score of zero (0) for the at least one of the ROIs without the corresponding LOI.   
     
     
         24 . A mobile device comprising:
 a processor; and   a memory storing instructions thereon which, when executed on the processor, causes the processor to:
 receive from an access point device, a series of successive real-time images of at least one target with a plurality of regions of interest (ROIs) acquired by at least one image capture device; 
 determine that a first image in the successive real-time images is different from a second image in the successive real-time images which immediately precedes the first image; 
 extract the plurality of ROIs and one or more locations of impact (LOIs) from the second image; 
 determine for each of the plurality of extracted ROIs, a ROI center point, any one of the one or more LOIs within the ROI, and a LOI center point for the corresponding LOI; 
 determine for each of the plurality of extracted ROIs, a regional score based on a distance between the ROI center point the LOI center point; and 
 determine a total score by adding the regional scores for the plurality of extracted ROIs.