Smart Display Data Capturing Platform For Record Systems

Abstract

A platform is provided to capture data displayed on a screen of a graphical user interface. The platform can find relevant foreground windows and determine whether the windows belong to a monitored process. The platform can also identify the context of the screen and record any changes. Related system, method, apparatus, and non-transitory computer readable medium are also provided.

What is claimed is: 
     
         1 . A method comprising:
 executing, using at least one data processor, an electronic medical record (EMR) system;   executing, using the at least one data processor, a computer program that is separate from the EMR system to extract data from the EMR system, the execution of the computer program resulting in operations comprising
 receiving by the computer program data for a screen of a graphical user interface (GUI) of the EMR system comprising a plurality of windows rendering data generated by the EMR system; 
 processing the data for the screen to determine, for each of the windows, whether the window is configured to receive data input from a user; 
 for each window configured to receive data input, (i) processing the data for the screen to determine properties of GUI elements of the window, (ii) selecting a configuration having a set of configuration elements with properties that correspond to those of the GUI elements, and (iii) binding each GUI element of the window to its corresponding configuration element in the selected configuration, wherein the binding includes creating an object in memory to monitor the GUI element in real time; 
 monitoring the GUI elements that are bound with the corresponding configuration elements in real time using the objects in memory; and 
 storing data of the GUI elements using the objects in memory. 
   
     
     
         2 . The method of  claim 1 , wherein when one of the objects in memory detects a change in data in a GUI element of a window configured to receive data input in the EMR system, the computer program stores the detected change in real time using the at least one data processor, the stored change being associated with a configuration element of the configuration that corresponds to the window configured to receive data input. 
     
     
         3 . The method of  claim 1 , wherein the data is stored temporarily at a local computer terminal where the screen is displayed to the user. 
     
     
         4 . The method of  claim 3 , wherein the execution of the computer program results in the operations further comprising detecting a trigger event, and when the trigger event is detected, storing the data in long-term data storage. 
     
     
         5 . The method of  claim 4 , wherein the data is stored in long-term data storage only when the trigger event is detected. 
     
     
         6 . The method of  claim 1 , further comprising detecting a new screen and determining whether the new screen concerns a same patient as the screen. 
     
     
         7 . The method of  claim 1 , wherein the screen is implemented in HTML and changes in the screen are monitored by creating objects in memory that correspond to elements in a document object module tree. 
     
     
         8 . A non-transitory computer readable medium storing instructions, which when executed by at least one data processor of at least one computing system, result in operations comprising:
 executing an electronic medical record (EMR) system;   executing a computer program that is separate from the EMR system to extract data from the EMR system, the execution of the computer program resulting in operations comprising
 receiving by the computer program data for a screen of a graphical user interface (GUI) of the EMR system comprising a plurality of windows rendering data generated by the EMR system; 
 processing the data for the screen to determine, for each of the windows, whether the window is configured to receive data input from a user; 
 for each window configured to receive data input, (i) processing the data for the screen to determine properties of GUI elements of the window, (ii) selecting a configuration having a set of configuration elements with properties that correspond to those of the GUI elements, and (iii) binding each GUI element of the window to its corresponding configuration element in the selected configuration, wherein the binding includes creating an object in memory to monitor the GUI element in real time; 
 monitoring the GUI elements that are bound with the corresponding configuration elements in real time using the objects in memory; and 
 storing data of the GUI elements using the objects in memory. 
   
     
     
         9 . The non-transitory computer readable medium of  claim 8 , wherein when one of the objects in memory detects a change in data in a GUI element of a window configured to receive data input in the EMR system, the computer program stores the detected change in real time, the stored change being associated with a configuration element of the configuration that corresponds to the window configured to receive data input. 
     
     
         10 . The non-transitory computer readable medium of  claim 8 , wherein the data is stored temporarily at a local computer terminal where the screen is displayed to the user. 
     
     
         11 . The non-transitory computer readable medium of  claim 10 , wherein the execution of the computer program results in the operations further comprising detecting a trigger event, and when the trigger event is detected, storing the data in long-term data storage. 
     
     
         12 . The non-transitory computer readable medium of  claim 11 , wherein the data is stored in long-term data storage only when the trigger event is detected. 
     
     
         13 . The non-transitory computer readable medium of  claim 8 , wherein the execution of the computer program results in the operations further comprising detecting a new screen and determining whether the new screen concerns a same patient as the screen. 
     
     
         14 . The non-transitory computer readable medium of  claim 8 , wherein the screen is implemented in HTML and changes in the screen are monitored by creating objects in memory that correspond to elements in a document object module tree. 
     
     
         15 . A system comprising:
 at least one data processor; and   memory storing instructions which, when executed by the at least one data processor, result in operations comprising:   executing an electronic medical record (EMR) system;   executing a computer program that is separate from the EMR system to extract data from the EMR system, the execution of the computer program resulting in operations comprising
 receiving by the computer program data for a screen of a graphical user interface (GUI) of the EMR system comprising a plurality of windows rendering data generated by the EMR system; 
 processing the data for the screen to determine, for each of the windows, whether the window is configured to receive data input from a user; 
 for each window configured to receive data input, (i) processing the data for the screen to determine properties of GUI elements of the window, (ii) selecting a configuration having a set of configuration elements with properties that correspond to those of the GUI elements, and (iii) binding each GUI element of the window to its corresponding configuration element in the selected configuration, wherein the binding includes creating an object in memory to monitor the GUI element in real time; 
 monitoring the GUI elements that are bound with the corresponding configuration elements in real time using the objects in memory; and 
 storing data of the GUI elements using the objects in memory. 
   
     
     
         16 . The system of  claim 15 , wherein when one of the objects in memory detects a change in data in a GUI element of a window configured to receive data input in the EMR system, the computer program stores the detected change in real time, the stored change being associated with a configuration element of the configuration that corresponds to the window configured to receive data input. 
     
     
         17 . The system of  claim 15 , wherein the execution of the computer program results in the operations further comprising detecting a new screen and determining whether the new screen concerns a same patient as the screen. 
     
     
         18 . The system of  claim 15 , wherein the screen is implemented in HTML and changes in the screen are monitored by creating objects in memory that correspond to elements in a document object module tree. 
     
     
         19 . The system of  claim 15 , wherein the data for the screen is received by taking a screenshot that is parsed and analyzed using optical character recognition (OCR). 
     
     
         20 . The system of  claim 15 , wherein additional data comprising an element position is used in conjunction with the set of configuration elements to perform the selecting.