Gathering information on user interactions with natural language processor (nlp) items to determine an order in which to present nlp items

Abstract

Provided are a computer program product, system, and method for providing information on detected user interactions with natural language processor (NLP) items to a server to use to determine an order in which to render NLP items in a user interface. Interactions with natural language processing (NLP) items in documents are detected. For each interaction with an NLP item of the NLP items in the documents, determination is made of a context attribute value for a context attribute related to the interaction with the NLP item. Then interaction information is generated indicating the NLP item and the determined context attribute value. The interaction information is sent to the server to include in user interaction information in a database.

1 - 22 . (canceled) 
     
     
         23 . A computer program product for determining an order in which to present items in a document for review in a computer user interface, wherein the computer program product comprises a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to communicate with a server and cause operations, the operations comprising:
 detecting users interactions with items included in reviewed documents, wherein the users operate Input/Output (I/O) devices to interact with the items in the reviewed documents presented in computer user interfaces;   determining context attribute values for context attributes related to the users interactions with the items;   generating interaction information for the items with which the users interacted, wherein an instance of interaction information indicates the item and a determined context attribute value related to a user interaction with the item;   determining a context attribute value for a context attribute for a selected document having items;   determining interaction information for items in the selected document having a context attribute value matching the determined context attribute value of the selected document;   using the determined interaction information for the items in the selected document to determine an order in which to present the items in the selected document; and   presenting in a computer user interface the items in the selected document in the order for a reviewing user to consider.   
     
     
         24 . The computer program product of  claim 23 , wherein the operations further comprise:
 indicating, in the interaction information for the items, frequencies with which the users have interacted with the items in the reviewed documents, wherein the using the determined interaction information for the items to determine the order comprises ordering the items based on the frequencies in the determined interaction information for the items.   
     
     
         25 . The computer program product of  claim 24 , wherein the operations further comprise:
 determining cumulative interaction frequencies for the items in the selected document based on the frequencies in the determined interaction information for the items, wherein the cumulative interaction frequency for a given item comprises a sum of the frequencies in the determined interaction information for the given item, and wherein the order is based on the cumulative interaction frequencies of the items.   
     
     
         26 . The computer program product of  claim 23 , wherein the context attribute values comprise one of a plurality of context attribute values that are members of a set of context attribute values comprising: a user attribute value for an attribute of a user when interacting with an item; a question subject attribute value indicating a subject of an interrogative sentence including an item interacted with by a user; an item specific attribute value specific to a context of the item; a location attribute value of where the user was located when interacting with the item; a time attribute value comprising a time period when the user was interacting with the item; and a user cohort value comprising one of a plurality of user cohort values of groups of users. 
     
     
         27 . The computer program product of  claim 26 , wherein users comprise medical professionals, the subject of the interrogative sentence including the items comprises a patient, the items are related to medical treatment of patients, documents comprise patient medical records, wherein the location attribute value includes a type of medical facility where the user is located, wherein the question subject attribute value comprises at least one medical condition of the subject, and wherein the interrogative sentence including the items concerns gathering medical information related to the patients that are subjects of the interrogative sentence. 
     
     
         28 . The computer program product of  claim 23 , wherein the presenting in the computer user interface the items in the selected document in the order comprises:
 directing the reviewing user in the computer user interface to an item in the document not yet considered having a highest order of the items not yet considered to receive user modifications to content for the item;   saving user modifications to the content for the item in the selected document;   receiving user selection to move to a next item in the document; and   performing additional iterations of the directing the reviewing user to an item having a highest order of the items not yet considered and saving user modifications to the content for the item in response to receiving user selections to move to next items in the document.   
     
     
         29 . The computer program product of  claim 23 , wherein the operations further comprise:
 determining a profile value for the reviewing user from user profile information for the reviewing user, wherein the determining the interaction information for the items in the selected document further comprises determining interaction information also having a profile attribute value matching the determined profile value for the reviewing user.   
     
     
         30 . A system for determining an order in which to present items in a document for review in communication with a server, comprising:
 a processor; and   a computer readable storage medium having program instructions that when executed by the processor to cause operations, the operations comprising:
 detecting users interactions of users with items included in reviewed documents, wherein the users operate Input/Output (I/O) devices to interact with the items in the reviewed documents presented in computer user interfaces; 
 determining context attribute values for context attributes related to the users interactions with the items; 
 generating interaction information for the items with which the users interacted, wherein an instance of interaction information indicates the item and a determined context attribute value related to a user interaction with the item; 
 determining a context attribute value for a context attribute for a selected document having items; 
 determining interaction information for items in the selected document having a context attribute value matching the determined context attribute value of the selected document; 
 using the determined interaction information for the items in the selected document to determine an order in which to present the items in the selected document; and 
 presenting in a computer user interface the items in the selected document in the order for a reviewing user to consider. 
   
     
     
         31 . The system of  claim 30 , wherein the operations further comprise:
 indicating, in the interaction information for the items, frequencies with which the users have interacted with the items in the reviewed documents, wherein the using the determined interaction information for the items to determine the order comprises ordering the items based on the frequencies in the determined interaction information for the items.   
     
     
         32 . The system of  claim 31 , wherein the operations further comprise:
 determining cumulative interaction frequencies for the items in the selected document based on the frequencies in the determined interaction information for the items, wherein the cumulative interaction frequency for a given item comprises a sum of the frequencies in the determined interaction information for the given item, and wherein the order is based on the cumulative interaction frequencies of the items.   
     
     
         33 . The system of  claim 30 , wherein the context attribute values comprise one of a plurality of context attribute values that are members of a set of context attribute values comprising: a user attribute value for an attribute of a user when interacting with an item; a question subject attribute value indicating a subject of an interrogative sentence including an item interacted with by a user; an item specific attribute value specific to a context of the item; a location attribute value of where the user was located when interacting with the item; a time attribute value comprising a time period when the user was interacting with the item; and a user cohort value comprising one of a plurality of user cohort values of groups of users. 
     
     
         34 . The system of  claim 33 , wherein users comprise medical professionals, the subject of the interrogative sentence including the items comprises a patient, the items are related to medical treatment of patients, documents comprise patient medical records, wherein the location attribute value includes a type of medical facility where the user is located, wherein the question subject attribute value comprises at least one medical condition of the subject, and wherein the interrogative sentence including the items concerns gathering medical information related to the patients that are subjects of the interrogative sentence. 
     
     
         35 . The system of  claim 30 , wherein the presenting in the computer user interface the items in the selected document in the order comprises:
 directing the reviewing user in the computer user interface to an item in the document not yet considered having a highest order of the items not yet considered to receive user modifications to content for the item;   saving user modifications to the content for the item in the selected document;   receiving user selection to move to a next item in the document; and   performing additional iterations of the directing the reviewing user to an item having a highest order of the items not yet considered and saving user modifications to the content for the item in response to receiving user selections to move to next items in the document.   
     
     
         36 . The system of  claim 30 , wherein the operations further comprise:
 determining a profile value for the reviewing user from user profile information for the reviewing user, wherein the determining the interaction information for the items in the selected document further comprises determining interaction information also having a profile attribute value matching the determined profile value for the reviewing user.   
     
     
         37 . A method for determining an order in which to present items in a document for review in a computer user interface, comprising:
 detecting users interactions   with items included in reviewed documents, wherein the users operate Input/Output (I/O) devices to interact with the items in the reviewed documents presented in computer user interfaces;   determining context attribute values for context attributes related to the users interactions with the items;   generating interaction information for the items with which the users interacted, wherein an instance of interaction information indicates the item and a determined context attribute value related to a user interaction with the item;   determining a context attribute value for a context attribute for a selected document having items;   determining interaction information for items in the selected document having a context attribute value matching the determined context attribute value of the selected document;   using the determined interaction information for the items in the selected document to determine an order in which to present the items in the selected document; and   presenting in a computer user interface the items in the selected document in the order for a reviewing user to consider.   
     
     
         38 . The method of  claim 37 , further comprising:
 indicating, in the interaction information for the items, frequencies with which the users have interacted with the items in the reviewed documents, wherein the using the determined interaction information for the items to determine the order comprises ordering the items based on the frequencies in the determined interaction information for the items.   
     
     
         39 . The method of  claim 38 , further comprising:
 determining cumulative interaction frequencies for the items in the selected document based on the frequencies in the determined interaction information for the items, wherein the cumulative interaction frequency for a given item comprises a sum of the frequencies in the determined interaction information for the given item, and wherein the order is based on the cumulative interaction frequencies of the items.   
     
     
         40 . The method of  claim 37 , wherein the context attribute values comprise one of a plurality of context attribute values that are members of a set of context attribute values comprising: a user attribute value for an attribute of a user when interacting with an item; a question subject attribute value indicating a subject of an interrogative sentence including an item interacted with by a user; an item specific attribute value specific to a context of the item; a location attribute value of where the user was located when interacting with the item; a time attribute value comprising a time period when the user was interacting with the item; and a user cohort value comprising one of a plurality of user cohort values of groups of users. 
     
     
         41 . The method of  claim 40 , wherein users comprise medical professionals, the subject of the interrogative sentence including the items comprises a patient, the items are related to medical treatment of patients, documents comprise patient medical records, wherein the location attribute value includes a type of medical facility where the user is located, wherein the question subject attribute value comprises at least one medical condition of the subject, and wherein the interrogative sentence including the items concerns gathering medical information related to the patients that are subjects of the interrogative sentence. 
     
     
         42 . The method of  claim 37 , wherein the presenting in the computer user interface the items in the selected document in the order comprises:
 directing the reviewing user in the computer user interface to an item in the document not yet considered having a highest order of the items not yet considered to receive user modifications to content for the item;   saving user modifications to the content for the item in the selected document;   receiving user selection to move to a next item in the document; and   performing additional iterations of the directing the reviewing user to an item having a highest order of the items not yet considered and saving user modifications to the content for the item in response to receiving user selections to move to next items in the document.