System and Method for Code and Data Versioning in Computerized Data Modeling and Analysis

Abstract

Code and data versioning allow developers to work on code and data without affecting production code and data and without affecting the development activities of other developers. Code and data being worked on by a developer are associated with a task. The system automatically determines the dataset to use for a given development task from among a production dataset, a latest dataset, or a temporary dataset associated with the development task so that development code does not have to be modified to read from a specific dataset.

What is claimed is: 
     
         1 . A computer-implemented method for code and data versioning for managing shared datasets in a collaborative data processing system including data files and code files, the data files including production data files, the code files including production code files that operate on data files, the method comprising:
 maintaining a first view having a production version of a dataset;   creating a task for a developer, the task being associated with a second view;   associating a first code file with the task for the first view, the first code file including code that modifies the dataset;   creating a temporary version of the dataset in the first view;   associating the temporary version of the dataset with the task;   associating a second code file with the task for the second view, the second code file including an instruction to read the dataset from the first view without identifying a specific version of the dataset from the first view; and   upon execution of the second code file in the second view, automatically reading from the temporary dataset associated with the task based on the association of the temporary dataset with the task such that the second code file in the second view modifies the temporary dataset.   
     
     
         2 . The method of  claim 1 , further comprising:
 placing locks on the first code file in the first view and the second code file in the second view.   
     
     
         3 . The method of  claim 2 , wherein placing the locks on the first and second code files comprises checking out the first and second code files from a source control system. 
     
     
         4 . The method of  claim 1 , further comprising:
 receiving, from the developer, a request to commit changes made to the first and second code files;   checking the first and second code files into a source control system;   changing the temporary dataset to be a latest dataset; and   terminating the task.   
     
     
         5 . A system for code and data versioning for managing shared datasets in a collaborative data processing system including data files and code files, the data files including production data files, the code files including production code files that operate on data files, the system comprising:
 a computer system having stored thereon and executing computer processes comprising:   maintaining a first view having a production version of a dataset;   creating a task for a developer, the task being associated with a second view;   associating a first code file with the task for the first view, the first code file including code that modifies the dataset;   creating a temporary version of the dataset in the first view;   associating the temporary version of the dataset with the task;   associating a second code file with the task for the second view, the second code file including an instruction to read the dataset from the first view without identifying a specific version of the dataset from the first view; and   upon execution of the second code file in the second view, automatically reading from the temporary dataset associated with the task based on the association of the temporary dataset with the task such that the second code file in the second view modifies the temporary dataset.   
     
     
         6 . The system of  claim 5 , wherein the computer processes further comprise:
 placing locks on the first code file in the first view and the second code file in the second view.   
     
     
         7 . The system of  claim 6 , wherein placing the locks on the first and second code files comprises checking out the first and second code files from a source control system. 
     
     
         8 . The system of  claim 5 , wherein the computer processes further comprise:
 receiving, from the developer, a request to commit changes made to the first and second code files;   checking the first and second code files into a source control system;   changing the temporary dataset to be a latest dataset; and   terminating the task.   
     
     
         9 . A computer program product comprising a tangible, non-transitory computer readable medium having stored thereon a computer program for code and data versioning for managing shared datasets in a collaborative data processing system including data files and code files, the data files including production data files, the code files including production code files that operate on data files, which, when run on a computer system, causes the computer system to execute computer processes comprising:
 maintaining a first view having a production version of a dataset;   creating a task for a developer, the task being associated with a second view;   associating a first code file with the task for the first view, the first code file including code that modifies the dataset;   creating a temporary version of the dataset in the first view;   associating the temporary version of the dataset with the task;   associating a second code file with the task for the second view, the second code file including an instruction to read the dataset from the first view without identifying a specific version of the dataset from the first view; and   upon execution of the second code file in the second view, automatically reading from the temporary dataset associated with the task based on the association of the temporary dataset with the task such that the second code file in the second view modifies the temporary dataset.   
     
     
         10 . The computer program product of  claim 9 , wherein the computer processes further comprise:
 placing locks on the first code file in the first view and the second code file in the second view.   
     
     
         11 . The computer program product of  claim 10 , wherein placing the locks on the first and second code files comprises checking out the first and second code files from a source control system. 
     
     
         12 . The computer program product of  claim 9 , wherein the computer processes further comprise:
 receiving, from the developer, a request to commit changes made to the first and second code files;   checking the first and second code files into a source control system;   changing the temporary dataset to be a latest dataset; and   terminating the task.