System and methods for accelerated data storage and retrieval

Abstract

Systems and methods for providing accelerated data storage and retrieval utilizing lossless and/or lossy data compression and decompression. A data storage accelerator includes one or a plurality of high speed data compression encoders that are configured to simultaneously or sequentially losslessly or lossy compress data at a rate equivalent to or faster than the transmission rate of an input data stream. The compressed data is subsequently stored in a target memory or other storage device whose input data storage bandwidth is lower than the original input data stream bandwidth. Similarly, a data retrieval accelerator includes one or a plurality of high speed data decompression decoders that are configured to simultaneously or sequentially losslessly or lossy decompress data at a rate equivalent to or faster than the input data stream from the target memory or storage device. The decompressed data is then output at rate data that is greater than the output rate from the target memory or data storage device. The data storage and retrieval accelerator method and system may employed: in a disk storage adapter to reduce the time required to store and retrieve data from computer to disk; in conjunction with random access memory to reduce the time required to store and retrieve data from random access memory; in a display controller to reduce the time required to send display data to the display controller or processor; and/or in an input/output controller to reduce the time required to store, retrieve, or transmit data.

1 . A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for providing accelerated data storage, said method steps comprising: 
 receiving a digital data stream at an input data transmission rate which is greater than a data storage rate of a target storage device;    compressing the digital data stream at a compression rate that increases the effective data storage rate of the target storage device; and    storing the compressed digital data stream in the target storage device.    
     
     
         2 . The program storage device of  claim 1 , wherein the compression rate is at least equal to the ratio of the input data transmission rate to the data storage rate so as to provide continuous storage of the input digital data stream at the input data transmission rate.  
     
     
         3 . The program storage device of  claim 1 , wherein the instructions for performing the step of compressing comprise instructions for performing lossy data compression.  
     
     
         4 . The program storage device of  claim 1 , wherein the instructions for performing the step of compressing step comprise instructions for performing lossless and lossy data compression.  
     
     
         5 . The program storage device of  claim 1 , wherein the instructions for performing the step of compressing comprise instructions for performing the steps of: 
 reading a first parameter that is indicative of a compression type to be applied to the input digital data stream; and    selecting at least one allowable encoder based on the first parameter.    
     
     
         6 . The program storage device of  claim 5 , wherein the compression type is one of lossless data compression, lossy data compression, and a combination thereof.  
     
     
         7 . The program storage device of  claim 5 , wherein the input digital data stream comprises a plurality of data blocks and wherein each data block has a first parameter associated therewith indicative of a compression type to be applied to the data block.  
     
     
         8 . The program storage device of  claim 5 , further comprising instructions for performing the step of reading a second data parameter that is indicative of an amount of information loss that is permissible, if lossy data compression is selected.  
     
     
         9 . The program storage device of  claim 8 , wherein the first and second data parameters are located within a header of the data block.  
     
     
         10 . A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for providing accelerated retrieval of stored data, said method steps comprising: 
 retrieving a compressed digital data stream from a target storage device at a rate equal to a data access rate of the target storage device; and    decompressing the compressed data at a decompression rate that increases the effective data access rate of the target storage device.    
     
     
         11 . The program storage device of  claim 10 , wherein the instructions for performing the step of decompressing step comprise instructions for performing lossy data decompression.  
     
     
         12 . The program storage device of  claim 10 , wherein the instructions for performing the step of decompressing comprise instructions for performing a combination of lossless and lossy data decompression.  
     
     
         13 . The program storage device of  claim 10 , wherein the instructions for performing the step of decompressing comprise instructions for performing the steps of: 
 reading a first parameter that is indicative of a decompression type to be applied to the compressed digital data stream; and    selecting at least one allowable decoder based on the first parameter.    
     
     
         14 . The program storage device of  claim 13 , wherein the decompression type is one of lossless and lossy data decompression.  
     
     
         15 . The program storage device of  claim 10 , further comprising instructions for performing the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data decompression is selected.  
     
     
         16 . A method for providing accelerated data storage, comprising the steps of: 
 receiving a digital data stream at an input data transmission rate which is greater than a data storage rate of a target storage device;    compressing the digital data stream at a compression rate that increases the effective data storage rate of the target storage device; and    storing the compressed digital data stream in the target storage device.    
     
     
         17 . The method of  claim 16 , wherein the compression rate is at least equal to the ratio of the input data transmission rate to the data storage rate so as to provide continuous storage of the input digital data stream at the input data transmission rate.  
     
     
         18 . The method of  claim 16 , wherein the step of compressing is performed using lossy data compression.  
     
     
         19 . The method of  claim 16 , wherein the step of compressing is performed using lossless and lossy data compression.  
     
     
         20 . The method of  claim 16 , wherein the step of compressing comprises the steps of: 
 reading a first parameter that is indicative of a compression type to be applied to the input digital data stream; and selecting at least one allowable encoder based on the first parameter.    
     
     
         21 - 30 . (canceled)