Data processing system and data processing method

Abstract

Provided is a data processing system for creating a model for optimizing input data including a plurality of columns, the system including a processor and a storage unit. The processor is configured to receive index data including information on a combination of the columns to serve as an index in optimization of the input data, and changeability information indicating if data in each column is allowed to be changed in the optimization, and create the model on the basis of the index data.

1 . A data processing system for creating a model for optimizing input data including a plurality of columns, comprising a processor and a storage unit, wherein:
 the processor is configured to
 receive index data including information on a combination of the columns to serve as an index in optimization of the input data, and changeability information indicating if data in each column is allowed to be changed in the optimization, and 
 create the model on the basis of the index data. 
   
     
     
         2 . The data processing system according to  claim 1 , wherein the processor is configured to generate the model using, as the index, only the combination of columns that includes at least one data-changeable column and at least one data-unchangeable column. 
     
     
         3 . The data processing system according to  claim 2 ,
 wherein:   the index data further includes, regarding the at least one data-changeable column, information on fluidity, the fluidity being a degree representing the number of combinations of columns that are possible, and   the processor is configured to generate the model using only the index with the fluidity that satisfies a predetermined condition.   
     
     
         4 . The data processing system according to  claim 1 ,
 wherein:   the index data further includes a value of the index computed on the basis of past data using a given function, and   the processor is configured to generate the model using the value of the index.   
     
     
         5 . The data processing system according to  claim 1 , wherein the processor is configured to receive constraint information for optimizing the input data, optimize the input data on the basis of the constraint information and the model, and output resulting optimized data. 
     
     
         6 . The data processing system according to  claim 5 , further comprising an execution unit configured to execute a process using the optimized data and output execution result data. 
     
     
         7 . The data processing system according to  claim 6 ,
 wherein:   the storage unit is configured to store index validity information representing validity of indices, and   the processor is configured to
 split the input data into a plurality of pieces of data for each index, verify validity of each index from the execution result data, and store the validity of each index as the index validity information in the storage unit. 
   
     
     
         8 . The data processing system according to  claim 7 , wherein the processor is configured to create the index data using the index validity information. 
     
     
         9 . The data processing system according to  claim 7 ,
 wherein:   the plurality of pieces of data includes data for verification that is to be not optimized and data to be partially optimized, and   the processor is configured to generate, for the data to be partially optimized,
 a second model that uses only a target index to be verified, and 
 performs optimization using the second model. 
   
     
     
         10 . The data processing system according to  claim 9 , wherein the processor is configured to verify the validity of the index by comparing data corresponding to the data for verification in the execution result data with data corresponding to the data to be partially optimized in the execution result data. 
     
     
         11 . The data processing system according to  claim 9 ,
 wherein the processor is configured to
 generate a third model obtained by excluding the target index to be verified from the model, and 
 separate the plurality of pieces of data into the data for verification and the data to be partially optimized so that evaluation values computed using the third model become substantially equal. 
   
     
     
         12 . A data processing method for creating a model for optimizing input data including a plurality of columns, comprising:
 receiving, with a processor, index data including information on a combination of the columns to serve as an index in optimization of the input data, and changeability information indicating if data in each column is allowed to be changed in the optimization, and   creating, with the processor, the model on the basis of the index data.