Method and system for capturing change of data

Abstract

Disclosed are systems and methods for synchronizing data present in a target data set with data present in a source data set. The data present in the target data set is partitioned to determine a partition definition of the target data set. A target message digest is calculated for the data present in each partition of the target data set. Based upon the partition definition of the target data set, the data present in the source data set is partitioned. A source message digest is calculated for the data present in each partition of the source data set. The source message digest of a partition is compared with the target message digest of a corresponding partition to capture a change in data present in the source data set. Based upon the captured data, the data in the target data set is synchronized with the data in the source data set.

I/We claim: 
     
         1 . A non-transitory computer readable medium comprising instructions which when executed by a computer, cause the computer to:
 determine one or more row identifiers for one or more rows associated with the target data set, to identify one or more boundaries for partitioning the target data set;   partition the target data set into one or more target data partitions, beginning from a row with a lowest value of a row identifier;   based on the partitioning, determine a partition definition of the target data set including partitioning information and metadata associated with the boundaries of each target data partition of the target data set;   calculate a target message digest for each partition of the target data set, the target message digest representing the data in the corresponding target data partition;   based upon the partition definition of the target data set and the metadata associated with the boundaries of each target data partition, partition the source data set into one or more source data partitions;   calculate a source message digest for the each source data partition;   based upon a change of data and a degree of change of the data in the source data set, capture the change of data in the source data set; and   synchronize the corresponding target data set with the source data set.   
     
     
         2 . The non-transitory computer readable medium of  claim 1 , wherein a first source data partition includes an open boundary for a first row of the source data partition, the open boundary indicating a first row operable to accommodate data prepended to the source data partition. 
     
     
         3 . The non-transitory computer readable medium of  claim 1 , wherein a last source data partition includes an open boundary for a last row of the source data partition, the open boundary indicating a last row operable to accommodate data appended to the source data partition. 
     
     
         4 . The non-transitory computer readable medium of  claim 1 , wherein a first target data partition begins from a first row of the target data set. 
     
     
         5 . The non-transitory computer readable medium of  claim 1 , wherein a following target data partition begins from a row succeeding a last row of a previous target data partition. 
     
     
         6 . The non-transitory computer readable medium of  claim 1 , wherein calculating the target message digest for the target data set comprises calculating a value of the target message digest for each target data partition. 
     
     
         7 . The non-transitory computer readable medium of  claim 7  further comprises updating the target message digest based upon a change in the source data set. 
     
     
         8 . The non-transitory computer readable medium of  claim 1 , wherein the change of data is determined based upon a difference in a value of the source message digest of a source data partition and a value of the target message digest of a corresponding target data partition. 
     
     
         9 . The non-transitory computer readable medium of  claim 1 , wherein the partition definition corresponds to the metadata associated with the boundaries of the target data partition. 
     
     
         10 . The non-transitory computer readable medium of  claim 11 , wherein a last row of a target data partition is determined from a first row of a subsequent target data partition. 
     
     
         11 . The non-transitory computer readable medium of  claim 1 , wherein a first row and a last row of each partition represents a boundary of the corresponding target data partition. 
     
     
         12 . A computing device to synchronize a target data set with a source data set comprising:
 a computer memory to store instructions; and   a processor to read and execute instructions to:
 determine one or more row identifiers for one or more rows associated with the target data set, to identify one or more boundaries for partitioning the target data set; 
 partition the target data set into one or more target data partitions, beginning from a row with a lowest value of a row identifier; 
 based on the partitioning, determine a partition definition of the target data set including partitioning information and metadata associated with the boundaries of each target data partition of the target data set; 
 calculate a target message digest for each partition of the target data set, the target message digest representing the data in the corresponding target data partition; 
 based upon the partition definition of the target data set and the metadata associated with the boundaries of each target data partition, partition the source data set into one or more source data partitions; 
 calculate a source message digest for the each source data partition; 
 based upon a change of data and a degree of change of the data in the source data set, capture the change of data in the source data set; and 
 synchronize the corresponding target data set with the source data set. 
   
     
     
         13 . A computer implemented method to synchronize a target data set with a source data set, the method comprising:
 determining one or more row identifiers for one or more rows associated with the target data set, to identify one or more boundaries for partitioning the target data set;   partitioning the target data set into one or more target data partitions, beginning from a row with a lowest value of a row identifier;   based on the partitioning, determining a partition definition of the target data set including partitioning information and metadata associated with the boundaries of each target data partition of the target data set;   calculating a target message digest for each partition of the target data set, the target message digest representing the data in the corresponding target data partition;   based upon the partition definition of the target data set and the metadata associated with the boundaries of each target data partition, partitioning the source data set into one or more source data partitions;   calculating a source message digest for the each source data partition;   based upon a change of data and a degree of change of the data in the source data set, capturing the change of data in the source data set; and   synchronizing the corresponding target data set with the source data set.   
     
     
         14 . The computer implemented method of  claim 12 , wherein a first source data partition includes an open boundary for a first row of the source data partition, the open boundary indicating a first row operable to accommodate data prepended to the source data partition. 
     
     
         15 . The computer implemented method of  claim 12 , wherein a last source data partition includes an open boundary for a last row of the source data partition, the open boundary indicating a last row operable to accommodate data appended to the source data partition. 
     
     
         16 . The computer implemented method of  claim 12 , wherein a first target data partition begins from a first row of the target data set. 
     
     
         17 . The computer implemented method of  claim 12 , wherein a following target data partition begins from a row succeeding a last row of a previous target data partition. 
     
     
         18 . The computer implemented method of  claim 12 , wherein the change of data is determined based upon a difference in a value of the source message digest of a source data partition and a value of the target message digest of a corresponding target data partition. 
     
     
         19 . The computer implemented method of  claim 12 , wherein the partition definition corresponds to the metadata associated with the boundaries of the target data partition. 
     
     
         20 . The computer implemented method of  claim 19 , wherein a last row of a target data partition is determined from a first row of a subsequent target data partition.