Document conversion, annotation, and data capturing system

Abstract

A document annotation system receives a document in an original format including content. The system converts the document to an intermediate format including page data elements representing pagination within the document. The system converts the intermediate format to a display format including data marker elements linking a portion of the content to a pin cite based on the page data elements. The system detects annotations to the display format and generates citations based on the annotations.

What is claimed is: 
     
         1 . A system comprising:
 one or more processors;   one or more computer readable media storing computer executable instructions that, when executed by one or more processors perform operations comprising:
 receiving, from one or more client applications, a first plurality of documents in an original format; 
 determining, based at least in part on the first plurality of documents, a second plurality of documents in a display format; 
 determining a plurality of facts based on annotation information associated with one of the second plurality of documents, the annotation information received from the one or more client applications; 
 generating, based at least in part on determining the second plurality of documents, user interface (UI) instructions for rendering a plurality of filter UI elements; 
 transmitting, to at least one of the one or more client applications, the UI instructions; 
 receiving, from at least one of the one or more client applications, filter data associated with at least one filter UI element of the plurality of filter UI elements; 
 determining, based at least in part on the filter data and the plurality of facts, a plurality of filtered facts; and 
 generating, based at least in part on the plurality of filtered facts, timeline view UI instructions that, when executed by the at least one of the one or more client applications, render a timeline view UI comprising an indication of a number of the plurality of filtered facts. 
   
     
     
         2 . The system of  claim 1 , the operations further comprising:
 generating, based at least in part on the plurality of filtered facts, table view UI instructions that, when executed by the at least one of the one or more client applications, render a table view UI comprising at least one fact row associated with an individual filtered fact of the plurality of filtered facts.   
     
     
         3 . The system of  claim 2 , the operations further comprising:
 receiving, via the table view UI, user input data;   determining, based at least in part on the user input data, a plurality of entities associated with the second plurality of documents; and   transmitting, to the at least one of the one or more client applications, the plurality of entities.   
     
     
         4 . The system of  claim 2 , the operations further comprising:
 determining a user action associated with the table view UI; and   updating, based at least in part on the user action, the plurality of filtered facts.   
     
     
         5 . The system of  claim 2 , wherein the table view UI further comprises an evidence column including a citation relating a portion of at least one document of the second plurality of documents to the individual filtered fact of the plurality of filtered facts. 
     
     
         6 . The system of  claim 5 , the operations further comprising:
 generating document view UI instructions that, when executed by the at least one of the one or more client applications, render a document view UI that comprises at least:
 the portion of the at least one document; 
 the individual filtered fact of the plurality of filtered facts; and 
 the citation. 
   
     
     
         7 . The system of  claim 1 , wherein the timeline view UI further comprises an event listener associated with a portion of the timeline view UI, and where the operations further comprise:
 determining, based at least in part the event listener, an event associated with the portion of the timeline view UI;   determining summary data associated with at least one filtered fact of the plurality of filtered facts that is related to the portion of the timeline view UI; and   transmitting, to the at least one of the one or more client applications, the summary data.   
     
     
         8 . A method comprising:
 receiving one or more documents;   determining one or more facts from the one or more documents;   generating user interface (UI) instructions for rendering one or more filter UI elements related to the one or more documents;   receiving filter data associated with at least one filter UI element of the one or more filter UI elements;   determining, based at least in part on the filter data and the one or more facts, one or more filtered facts; and   generating, based at least in part on the one or more filtered facts, timeline view UI instructions for rendering a timeline view UI comprising an indication of a number of the one or more filtered facts.   
     
     
         9 . The method of  claim 8 , further comprising:
 generating, based at least in part on the one or more filtered facts, table view UI instructions for rendering a table view UI comprising at least one fact row associated with an individual filtered fact of the one or more filtered facts.   
     
     
         10 . The method of  claim 9 , further comprising:
 receiving, via the table view UI, user input data; and,   determining, based at least in part on the user input data, one or more entities associated with the one or more documents.   
     
     
         11 . The method of  claim 9 , further comprising:
 determining a user action comprising one of a deletion or addition and updating the one or more filtered facts based at least in part on the user action.   
     
     
         12 . The method of  claim 9 , wherein the table view UI further comprises an evidence column including a citation that relates a portion of at least one document of the one or more documents to the individual filtered fact of the one or more filtered facts. 
     
     
         13 . The method of  claim 12 , further comprising:
 generating document view UI instructions that, when executed render a document view UI that comprises at least:
 the portion of the at least one document; 
 the individual filtered fact of the one or more filtered facts; and 
 the citation. 
   
     
     
         14 . The method of  claim 8 , wherein the timeline view UI further comprises an event listener associated with a portion of the timeline view UI, the method further comprising:
 determining, based at least in part the event listener, an event associated with the portion of the timeline view UI;   determining summary data associated with at least one filtered fact of the one or more filtered facts that is related to the portion of the timeline view UI; and   generating summary UI instructions for rendering the summary data proximate to the timeline view UI.   
     
     
         15 . A non transitory computer readable medium storing instructions executable by a processor, wherein the instructions, when executed perform operations comprising:
 rendering a UI that includes one or more filter UI elements corresponding to fact data associated with one or more documents;   determining filter data based at least in part on user selections of the one or more filter UI elements;   accessing one or more filtered facts, the one or more filtered facts based at least in part on the filter data;   rendering a timeline view UI comprising an indication of a number of the one or more filtered facts; and   rendering a table view UI comprising at least one fact row associated with one filtered fact of the one or more filtered facts.   
     
     
         16 . The non transitory computer readable medium of  claim 15 , the operations further comprising:
 determining user input data based at least in part on user input associated with a portion of the table view UI; and   accessing one or more entities associated with at least one document of the one or more documents, the one or more entities based at least in part on the user input data,   wherein the table view UI further comprises the one or more entities.   
     
     
         17 . The non transitory computer readable medium of  claim 15 , the operations further comprising:
 determining a user action comprising one of:
 a deletion action associated with the one filtered fact of the one or more filtered facts; or 
 an addition action associated with the one filtered fact; and 
   updating, based at least in part on the user action, the table view UI.   
     
     
         18 . The non transitory computer readable medium of  claim 15 , wherein the table view UI further comprises an evidence column including a citation that relates a portion of at least one document of the one or more documents to the one filtered fact of the one or more filtered facts. 
     
     
         19 . The non transitory computer readable medium of  claim 18 , the operations further comprising:
 rendering a document view UI comprising:
 the portion of the at least one document of the one or more documents; 
 the one filtered fact of the one or more filtered facts; and 
 the citation. 
   
     
     
         20 . The non transitory computer readable medium of  claim 15 , wherein the timeline view UI further comprises an event listener associated with a portion of the timeline view UI, the operations further comprising:
 determining, based at least in part the event listener, an event associated with the portion of the timeline view UI;   accessing summary data associated with at least one filtered fact of the one or more filtered facts that is related to the portion of the timeline view UI; and   rendering the summary data.