Systems and methods for generating event stream data

Abstract

A method includes receiving, at a processor, first source data structured according to a first schema. The method further includes receiving, at the processor, second source data structured according to a second schema different from the first schema. The method further includes outputting, by the processor, event stream data for storage at a storage device, the event stream data representing a first event extracted from the first source data and a second event extracted from the second source. The event stream data includes a plurality of events corresponding to changes associated with a subject instance. The method also includes generating a profile of the subject instance based on the event stream data. The profile indicates a chronology of the changes associated with the subject instance.

What is claimed is: 
     
         1 . A method comprising:
 receiving, at a processor, first source data structured according to a first schema;   receiving, at the processor, second source data structured according to a second schema different from the first schema;   outputting, by the processor, event stream data for storage at a storage device, the event stream data representing a first event extracted from the first source data and a second event extracted from the second source data, wherein the event stream data includes a plurality of events corresponding to changes associated with a subject instance; and   generating a profile of the subject instance based on the event stream data, the profile indicating a chronology of the changes associated with the subject instance.   
     
     
         2 . The method of  claim 1 , further comprising:
 determining that a first event of the event stream data indicates that an attribute of the subject instance had a first value on a first date;   determining that a second event of the event stream data indicates that the attribute had a second value on a second date following the first date; and   convert the first event and the second event into an entry of the profile, the entry including an identifier of the subject instance, the first value of the attribute, a validity start time of the first date, and a validity end time of the second date.   
     
     
         3 . The method of  claim 1 , wherein the first schema indicates field names, field ordering, and field data types of the first source data. 
     
     
         4 . The method of  claim 1 , wherein the event stream data represents a set of events, wherein each event of the set of events has an associated timestamp and an identifier, and further comprising generating first normalized data based on the first source data and generating second normalized data based on the second source data, wherein:
 generating the first normalized data includes mapping elements of the first source data to an intermediate format; and   generating the second normalized data includes mapping elements of the second source data to the intermediate format.   
     
     
         5 . The method of  claim 4 , further comprising extracting the first event from the first normalized data and extracting the second event from the second normalized data. 
     
     
         6 . The method of  claim 5 , wherein the first normalized data is arranged in a first table, and wherein the second normalized data is arranged in a second table. 
     
     
         7 . The method of  claim 6 , wherein the first source data includes a first data load associated with a first time and a second data load associated with a second time, the second time occurring after the first time. 
     
     
         8 . The method of  claim 7 , wherein the first normalized data includes the second data load and does not include the first data load. 
     
     
         9 . The method of  claim 7 , wherein the first data load includes a first entry associated with a first timestamp and a subject identifier, wherein the second data load includes a second entry associated with a second timestamp that conflicts with the first timestamp and associated with the subject identifier, wherein the first normalized data includes entries from the first data load and the second data load, and wherein the first normalized data includes the second entry but not the first entry. 
     
     
         10 . The method of  claim 1 , wherein the first source data and the second source data represent information related to a category. 
     
     
         11 . The method of  claim 10 , wherein the category includes an employee category and wherein the first source data represents information related to a particular employee of the employee category. 
     
     
         12 . The method of  claim 1 , further comprising:
 receiving, at the processor, input indicating correction data; and   generating modified event stream data based on the correction data by:
 modifying an event of the event stream data; 
 adding an event to the event stream data; 
 deleting an event from the event stream data; or 
 a combination thereof. 
   
     
     
         13 . The method of  claim 12 , wherein the correction data includes second event stream data. 
     
     
         14 . The method of  claim 12 , further comprising initiating, by the processor, storage of the correction data by the storage device. 
     
     
         15 . An apparatus comprising:
 a storage device; and   a processor configured to:
 receive first source data structured according to a first schema; 
 receive second source data structured according to a second schema different from the first schema; 
 output event stream data for storage at the storage device, the event stream data representing a first event extracted from the first source data and a second event extracted from the second source data, wherein the event stream data includes a plurality of events corresponding to changes associated with a subject instance; and 
 generate a profile of the subject instance based on the event stream data, the profile indicating a chronology of the changes associated with the subject instance. 
   
     
     
         16 . The apparatus of  claim 15 , wherein the processor is further configured to:
 determine that a first event of the event stream data indicates that an attribute of the subject instance had a first value on a first date;   determine that a second event of the event stream data indicates that the attribute had a second value on a second date following the first date; and   convert the first event and the second event into an entry of the profile, the entry including an identifier of the subject instance, the first value of the attribute, a validity start time of the first date, and a validity end time of the second date.   
     
     
         17 . The apparatus of  claim 15 , wherein the first source data is received via a network interface or from a data file. 
     
     
         18 . The apparatus of  claim 15 , further comprising a memory configured to store executable instructions that, when executed by the processor, enable the processor to execute a database connector, the second source data received from the database connector. 
     
     
         19 . A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations including:
 receiving, at a network interface of a computing device, data from a data source;   extracting, by a processor of the computing device, events from the data to generate an event stream, each event of the event stream corresponding to a change associated with a subject instance;   applying, by the processor, a correction overlay to the event stream to generate a corrected stream;   adjusting, by the processor, one or more events of the corrected stream based on application of a set of rules to generate an adjusted event stream; and   generating, by the processor, a profile of the subject instance based on the adjusted event stream, the profile indicating a chronology of changes associated with the subject instance.   
     
     
         20 . The computer-readable storage device of  claim 19 , wherein the operations further include:
 generating an output based on the profile; and   sending the output to a display device.