System and method for dynamic document matching and merging

Abstract

A system and method for matching and merging documents from disparate data sources into a single data store for a particular entity are provided. The system and method may be particularly useful for a healthcare system to match and merge data from disparate data sources about a healthcare provider.

1 . A system for matching and merging data for an entity from disparate data sources, comprising:
 one or more data sources for disparate sources, each data source having a raw file about an entity, each raw file having a plurality of data fields and each field has a value associated with the entity;   a computer system having a processor, the computer system coupled to each of the one or more data sources;   the computer system having an import component that receives the one or more raw files from the one or more data sources;   the computer system having a matcher component that performs a plurality of matching processes against the one or more raw files about the entity to generate a match set for each raw file wherein the match set for each raw file has at least one data field in the raw file that matches a data field for the entity;   the computer system having a merge component that merges the one or more raw files represented into a merged document that has the at least one matched data field in each of the one or more raw files; and   the computer system having a resolver component that identifies conflicting values in each data field of the merged document.   
     
     
         2 . The system of  claim 1 , wherein the import component transforms, before performing the plurality of matching processes, the one or more raw files to initial data cleanse the one or more raw files and generate one or more transformed files about the entity. 
     
     
         3 . The system of  claim 1 , wherein the resolver component ranks each conflicting value for a data field based on a confidence of a correctness of each conflicting value. 
     
     
         4 . The system of  claim 1 , wherein the matcher component performs a sequence of queries on the one or more raw files, wherein each query generates the match set. 
     
     
         5 . The system of  claim 4 , wherein the match set for a particular raw file has a reference to a storage location of the particular raw file and a unique identifier. 
     
     
         6 . The system of  claim 1 , wherein the matcher component uses a strict matcher process and uses a loose matcher process. 
     
     
         7 . The system of  claim 1 , wherein the matcher component uses a Bayesian identity resolution process and uses an ElasticSearch process. 
     
     
         8 . The system of  claim 1 , wherein the entity is one of a healthcare provider, subject, an idea, a professional, a person, a corporation and a business entity. 
     
     
         9 . The system of  claim 1 , wherein the entity is a healthcare provider and the one or more raw files are a Centers for Medicare and Medicaid Services' (CMS) National Plan and Provider Enumeration System (NPPES) data file and an American Medical Association (AMA) file. 
     
     
         10 . A method for matching and merging data for an entity from disparate data sources, comprising:
 receiving, by a computer system, one or more raw files from disparate sources about an entity, each raw file having a plurality of data fields and each field has a value associated with the entity;   performing, by the computer system, a plurality of matching processes against the one or more raw files about the entity to generate a match set for each raw file wherein the match set for each raw file has at least one data field in the raw file that matches a data field for the entity;   merging, by the computer system, the one or more raw files represented into a merged document that has the at least one matched data field in each of the one or more raw files; and   identifying, by the computer system, conflicting values in each data field of the merged document.   
     
     
         11 . The method of  claim 10  further comprising transforming, by the computer system before performing the plurality of matching processes, the one or more raw files to initial data cleanse the one or more raw files and generate one or more transformed files about the entity. 
     
     
         12 . The method of  claim 10 , wherein identifying the conflicting values further comprises ranking each conflicting value for a data field based on a confidence of a correctness of each conflicting value. 
     
     
         13 . The method of  claim 10 , wherein performing the plurality of matching processes further comprises performing a sequence of queries on the one or more raw files, wherein each query generates the match set. 
     
     
         14 . The method of  claim 13 , wherein the match set for a particular raw file has a reference to a storage location of the particular raw file and a unique identifier. 
     
     
         15 . The method of  claim 10 , wherein performing the plurality of matching processes further comprises using a strict matcher process and using a loose matcher process. 
     
     
         16 . The method of  claim 10 , wherein performing the plurality of matching processes further comprises using a Bayesian identity resolution process and using an ElasticSearch process. 
     
     
         17 . The method of  claim 10 , wherein the entity is one of a healthcare provider, subject, an idea, a professional, a person, a corporation and a business entity. 
     
     
         18 . The method of  claim 10 , wherein the entity is a healthcare provider and the one or more raw files are a Centers for Medicare and Medicaid Services' (CMS) National Plan and Provider Enumeration System (NPPES) data file and an American Medical Association (AMA) file.