Parallel migration of data between systems

Abstract

A system and method for migrating data, in parallel, from a source database system into a target database system includes storing data in groups (e.g., clusters) in the source database system. The groups of data are transferred, in parallel, to respective temporary staging tables in the target database system. The data in the temporary staging tables are then inserted, in parallel, into a target table in the target database system to complete the migration.

1. A method of migrating data, comprising:
 archiving data from a source table in a source database system; 
 transferring groups of the archived data, in parallel, to corresponding temporary tables in a target database system; 
 inserting data from the temporary tables into a target table in the target database system; and 
 making data in the target table available for execution of database queries against that data. 
 
     
     
       2. The method of  claim 1 , wherein archiving the data comprises archiving the data using a plurality of concurrently active archive modules. 
     
     
       3. The method of  claim 2 , wherein transferring the groups of data comprises restoring the groups of data, in parallel, using a plurality of restore modules. 
     
     
       4. The method of  claim 3 , further comprising communicating the groups of data between respective pairs of archive modules and restore modules across a transfer medium. 
     
     
       5. The method of  claim 4 , wherein communicating across the transfer medium comprises communicating across a pipe defined by an operating system in one of the source database system and target database system. 
     
     
       6. The method of  claim 4 , wherein communicating across the transfer medium comprises communicating through an intermediate storage system. 
     
     
       7. The method of  claim 1 , further comprising storing the source table across plural access managers, each access manager managing access to respective portions of the source table. 
     
     
       8. The method of  claim 7 , wherein transferring groups of the data comprises transferring clusters of the data, each cluster of data comprising data associated with a respective set of plural access managers. 
     
     
       9. The method of  claim 1 , further comprising copying database definitions from the source database system to the target database system. 
     
     
       10. The method of  claim 1 , further comprising creating the temporary tables in the target database system using the copied database definitions. 
     
     
       11. The method of  claim 1 , wherein archiving the data comprises archiving the data from a first source table, and transferring the groups of the archived data comprises transferring the groups of the archived data to a first set of temporary tables, the method further comprising:
 archiving data from a second source table; and 
 transferring groups of the archived data from the second source table, in parallel, to corresponding second set of temporary tables in the target database system. 
 
     
     
       12. The method of  claim 11 , further comprising inserting data from the second set of temporary tables into a second target table in the target database system. 
     
     
       13. A method of migrating data from a first source table in a first database system to a second database system, comprising:
 receiving groups of data from the source table from an intermediate medium into corresponding temporary tables in the second database system, 
 defining the temporary tables according to definitions of the source table; 
 inserting rows of the temporary tables into a target table in the second database system; and 
 making data in the target table available for execution of database queries against that data. 
 
     
     
       14. The method of  claim 13 , wherein receiving the data comprises receiving data from the groups in parallel into the corresponding temporary tables. 
     
     
       15. The method of  claim 13 , wherein receiving the data from the intermediate medium comprises receiving the data over a data network. 
     
     
       16. The method of  claim 13 , wherein receiving the data from the intermediate medium comprises receiving the data from an intermediate storage system. 
     
     
       17. An article comprising at least one storage medium containing instructions that when executed cause a target database system to:
 receive one or more queries to set up temporary tables in the target database system; 
 receive, in parallel, groups of data from a source table in a source database system into the temporary tables; 
 insert data from the temporary tables into a target table in the target database system; and 
 make the data in the target table available for execution of database queries against that data. 
 
     
     
       18. The article of  claim 17 , wherein the instructions when executed cause the target database system to create the temporary tables using definitions for the source table. 
     
     
       19. The article of  claim 17 , wherein the instructions when executed cause the target database system to create the temporary tables to have at least one or more of the following characteristics of the source table: columns, data types of columns, primary key, and one or more indexes. 
     
     
       20. The article of  claim 17 , wherein the instructions when executed cause the target database system to receive the groups of data comprising clusters of data. 
     
     
       21. The article of  claim 20 , wherein each cluster comprises data of plural access module processors in the source database system.