Apparatus and Method for Recognition of Medication Administration Indicator

Abstract

A method, system and computer program for confirming proper medication amount for a medication injection apparatus. The computer program causes a computer to perform the steps of providing one or more instructions on a display of a computing device instructing placement of an injectable medication apparatus including an indication of an amount of medication to be injected by the injectable medication apparatus, imaging by an image capture one or more images of the injectable medication apparatus including the indication of the amount of medication, and comparing by a processor of the computing device through recognition of the indication of the amount of medication, the indicated amount to a predetermined amount. One or more additional instructions may be provided on the display of the computing device to change the indication of the amount of medication if it is determined that the recognized indicated amount does not match the predetermined amount.

1 .- 20 . (canceled) 
     
     
         21 . A computer-implemented method comprising:
 providing a first set of instructions on a display of a computing device, the first set of instructions instructing a user to place a medication administration apparatus for administration of a medication within a field of view of an image capture device;   capturing a video of the medication administration apparatus using the image capture device;   tracking movement of the medication administration apparatus over a plurality of frames of the video; and   based on the movement of the medication administration apparatus over the plurality of frames of the video, identifying an effect of the medication.   
     
     
         22 . The computer-implemented method of  claim 21 , wherein identifying the effect of the medication comprises:
 determining a level of shaking of the medication administration apparatus; and   identifying the effect based on the level of shaking.   
     
     
         23 . The computer-implemented method of  claim 22 , wherein determining the level of shaking comprises:
 determining a level of blur of the medication administration apparatus in the plurality of frames; and   determining the level of shaking based on the level of blur.   
     
     
         24 . The computer-implemented method of  claim 23 , wherein determining the level of blur of the medication administration apparatus comprises determining the level of blur of a numerical indicator displayed by the medication administration apparatus. 
     
     
         25 . The computer-implemented method of  claim 24 , comprising:
 computationally de-blurring the numerical indicator;   comparing a value of the de-blurred numerical indicator to a predetermined value;   determining that the value of the de-blurred numerical indicator does not match the predetermined value; and   in response to determining that the value of the de-blurred numerical indicator does not match the predetermined value, providing one or more additional instructions on the display of the computing device.   
     
     
         26 . The computer-implemented method of  claim 25 , wherein the value of the de-blurred numerical indicates a titration level. 
     
     
         27 . The computer-implemented method of  claim 22 , wherein determining the level of shaking comprises:
 determining a level of movement of the medication administration apparatus between frames of the plurality of frames.   
     
     
         28 . The computer-implemented method of  claim 21 , wherein the video captures the user using the medication administration apparatus to administer medication. 
     
     
         29 . The computer-implemented method of  claim 21 , wherein the medication administration apparatus comprises an injection device or an inhaler. 
     
     
         30 . The computer-implemented method of  claim 21 , wherein tracking the movement of the medication administration apparatus comprises:
 tracking the movement of the medication administration apparatus with respect to a predefined movement sequence;   determining that the movement of the medication administration apparatus does not conform to the predefined movement sequence; and   in response to determining that the movement of the medication administration apparatus does not conform to the predefined movement sequence, providing one or more additional instructions on the display of the computing device.   
     
     
         31 . The computer-implemented method of  claim 21 , wherein the first set of instructions comprise an image representative of the medication administration apparatus displayed alongside one or more geometric elements. 
     
     
         32 . A non-transitory, computer-readable storage medium storing non-transitory instructions that, when executed by a computing device, cause the computing device to perform operations comprising:
 providing a first set of instructions on a display, the first set of instructions instructing a user to place a medication administration apparatus for administration of a medication within a field of view of an image capture device;   capturing a video of the medication administration apparatus using the image capture device;   tracking movement of the medication administration apparatus over a plurality of frames of the video; and   based on the movement of the medication administration apparatus over the plurality of frames of the video, identifying an effect of the medication.   
     
     
         33 . The non-transitory, computer-readable storage medium of  claim 32 , wherein identifying the effect of the medication comprises:
 determining a level of shaking of the medication administration apparatus; and   identifying the effect based on the level of shaking.   
     
     
         34 . The non-transitory, computer-readable storage medium of  claim 33 , wherein determining the level of shaking comprises:
 determining a level of blur of the medication administration apparatus in the plurality of frames; and   determining the level of shaking based on the level of blur.   
     
     
         35 . The non-transitory, computer-readable storage medium of  claim 34 , wherein determining the level of blur of the medication administration apparatus comprises determining the level of blur of a numerical indicator displayed by the medication administration apparatus. 
     
     
         36 . The non-transitory, computer-readable storage medium of  claim 35 , comprising:
 computationally de-blurring the numerical indicator;   comparing a value of the de-blurred numerical indicator to a predetermined value;   determining that the value of the de-blurred numerical indicator does not match the predetermined value; and   in response to determining that the value of the de-blurred numerical indicator does not match the predetermined value, providing one or more additional instructions on the display of the computing device.   
     
     
         37 . The non-transitory, computer-readable storage medium of  claim 36 , wherein the value of the de-blurred numerical indicates a titration level. 
     
     
         38 . The non-transitory, computer-readable storage medium of  claim 33 , wherein determining the level of shaking comprises:
 determining a level of movement of the medication administration apparatus between frames of the plurality of frames.   
     
     
         39 . The non-transitory, computer-readable storage medium of  claim 32 , wherein the medication administration apparatus comprises an injection device or an inhaler. 
     
     
         40 . The non-transitory, computer-readable storage medium of  claim 32 , wherein tracking the movement of the medication administration apparatus comprises:
 tracking the movement of the medication administration apparatus with respect to a predefined movement sequence;   determining that the movement of the medication administration apparatus does not conform to the predefined movement sequence; and   in response to determining that the movement of the medication administration apparatus does not conform to the predefined movement sequence, providing one or more additional instructions on the display.