System and method for optimizing data in value-based storage system

Abstract

A method (and system) of storing data in a value-based storage system, includes optimizing a value of data stored in the value-based storage system.

1 . A method of storing data in a value-based storage system, comprising: 
 optimizing a value of data stored in the value-based storage system.    
   
   
       2 . The method according to  claim 1 , wherein said optimizing a value comprises: 
 estimating a rate and a value function of data object production during an interval of time;    computing an optimal decision for allocating new data to at least one data vat of said storage system, deleting existing data from said at least one data vat and for moving existing data from a first data vat to another data vat; and    implementing said optimal decision during said interval of time.    
   
   
       3 . The method according to  claim 2 , wherein said interval of time comprises a fixed, projected interval of time.  
   
   
       4 . The method according to  claim 2 , further comprising: 
 repeating said estimating a rate, said computing an optimal decision and said implementing said optimal decision.    
   
   
       5 . The method according to  claim 1 , wherein said optimizing a value comprises: 
 computing an optimal decision for allocating new data to at least one data vat of said storage system and for moving existing data from a first data vat to another data vat.    
   
   
       6 . The method according to  claim 5 , wherein said computing an optimal decision comprises: 
 limiting an amount of said existing data that is moved from said first vat to said another vat.    
   
   
       7 . The method according to  claim 5 , wherein said computing an optimal decision comprises: 
 eliminating said moving existing data from said first vat to said another vat.    
   
   
       8 . The method according to  claim 1 , wherein said storage system comprises a distributed computer system.  
   
   
       9 . The method according to  claim 1 , wherein data input into said storage system comprises streaming data.  
   
   
       10 . The method according to  claim 2 , wherein said implementing comprises automatically allocating new data, deleting existing data and moving existing data.  
   
   
       11 . The method according to  claim 2 , wherein said optimal decision comprises allocating an amount of said new data to said at least one data vat that is substantially equal to an amount of said existing data deleted from said at least one data vat.  
   
   
       12 . The method according to  claim 1 , wherein said storage system comprises a plurality of loosely coupled data vats.  
   
   
       13 . The method according to  claim 1 , wherein said optimizing comprises maximizing a value of retained data in the storage system.  
   
   
       14 . The method according to  claim 2 , further comprising: 
 periodically gathering information about data being written and about a state of the storage system; and    revising said optimal decision based on gathered information.    
   
   
       15 . The method according to  claim 2 , wherein said optimal decision comprises maintaining an equal value function in each of said at least one data vat.  
   
   
       16 . A signal-bearing medium tangibly embodying a program of machine readable instructions executable by a digital processing apparatus to perform a method of storing data in a storage system, said method comprising: 
 optimizing a value of data stored in the storage system.    
   
   
       17 . A method for deploying computing infrastructure, comprising integrating computer-readable code into a computing system, wherein the computer readable code in combination with the computing system is capable of performing a method of storing data in a storage system, said method of storing data in a storage system comprising: 
 optimizing a value of data stored in the storage system.    
   
   
       18 . A system for storing data in a storage system, comprising: 
 an optimizing unit that optimizes a value of data stored in the storage system.    
   
   
       19 . The system according to  claim 18 , wherein said optimizing unit comprises: 
 an estimating unit that estimates a rate and a value function of data object production during an interval of time;    a computing unit that computes an optimal decision for allocating new data to at least one data vat of said storage system, deleting existing data from said at least one data vat and for moving existing data from a first data vat to another data vat; and    an implementing unit that implements said optimal solution during said interval of time.    
   
   
       20 . The system according to  claim 18 , wherein said optimizing unit comprises: 
 a computing unit that computes an optimal decision for allocating new data to at least one data vat of said storage system and for moving existing data from a first data vat to another data vat.