Virtually infinite reliable storage across multiple storage devices and storage services

Abstract

A logical file system is described that distributes copies of files across various different physical storage resources yet provides a consistent view to the user of his or her data, regardless of which machine the user is accessing the files from, and even when the user's computer is offline. The distributed file system uses smart data redundancy to enable a virtually infinite amount of storage as long as additional storage resources are made available to the distributed file system. The result is a reliable storage system that does not necessarily tie the user's data to the user's particular computer. Instead, the user's data is associated with the user—for life—or for however long the user would like the data to be maintained, regardless of whether the user's computer or data storage components are replaced or destroyed.

1 . A method comprising:
 determining that a new volume is to be included in a distributed storage system;   marking, in response to the determining, the new volume as part of the distributed storage system;   replicating file metadata of a file system from a volume to the new volume;   replicating, by a computer, files from the volume to the new volume, wherein a first portion of the replicated files are full copies of the corresponding files stored on the volume, and wherein a second portion of the replicated files are ghosted files that each refer to a corresponding actual file stored on the volume; and   removing the corresponding files stored on the volume.   
     
     
         2 . The method of  claim 1  wherein the marking further comprises creating, by a storage policy module, a volume identifier for the new volume. 
     
     
         3 . The method of  claim 2  wherein the marking further comprises marking the new volume as part of the distributed storage system using the volume identifier. 
     
     
         4 . The method of  claim 1  wherein the replicating the files further comprises initially replicating the full copies of the corresponding files as ghosted files to the new volume. 
     
     
         5 . The method of  claim 4  wherein the replicating the files further comprises moving, after initially replicating the full copies of the corresponding files as ghosted files, the full copies of the corresponding files to the new volume. 
     
     
         6 . The method of  claim 1  further comprising replicating all directories of the file system to the new volume. 
     
     
         7 . The method of  claim 1  wherein the determining is based on user input. 
     
     
         8 . At least one computer storage media storing computer-executable instructions that, when executed by a computer cause the computer to perform a method comprising:
 determining that a new volume is to be included in a distributed storage system;   marking, in response to the determining, the new volume as part of the distributed storage system;   replicating file metadata of a file system from a volume to the new volume;   replicating files from the volume to the new volume, wherein a first portion of the replicated files are full copies of the corresponding files stored on the volume, and wherein a second portion of the replicated files are ghosted files that each refer to a corresponding actual file stored on the volume; and   removing the corresponding files stored on the volume.   
     
     
         9 . The at least one computer storage media of  claim 8  wherein the marking further comprises creating, by a storage policy module, a volume identifier for the new volume. 
     
     
         10 . The at least one computer storage media of  claim 9  wherein the marking further comprises marking the new volume as part of the distributed storage system using the volume identifier. 
     
     
         11 . The at least one computer storage media of  claim 8  wherein the replicating the files further comprises initially replicating the full copies of the corresponding files as ghosted files to the new volume. 
     
     
         12 . The at least one computer storage media of  claim 11  wherein the replicating the files further comprises moving, after initially replicating the full copies of the corresponding files as ghosted files, the full copies of the corresponding files to the new volume. 
     
     
         13 . The at least one computer storage media of  claim 8 , the method further comprising replicating all directories of the file system to the new volume. 
     
     
         14 . The at least one computer storage media of  claim 8  wherein the determining is based on user input. 
     
     
         15 . A system comprising:
 a computer configured for determining that a new volume is to be included in a distributed storage system;   the computer further configured for marking, in response to the determining, the new volume as part of the distributed storage system;   the computer further configured for replicating file metadata of a file system from a volume to the new volume;   the computer further configured for replicating files from the volume to the new volume, wherein a first portion of the replicated files are full copies of the corresponding files stored on the volume, and wherein a second portion of the replicated files are ghosted files that each refer to a corresponding actual file stored on the volume; and   the computer further configured for removing the corresponding files stored on the volume.   
     
     
         16 . The system of  claim 15  wherein the marking further comprises creating, by a storage policy module, a volume identifier for the new volume. 
     
     
         17 . The system of  claim 16  wherein the marking further comprises marking the new volume as part of the distributed storage system using the volume identifier. 
     
     
         18 . The system of  claim 15  wherein the replicating the files further comprises initially replicating the full copies of the corresponding files as ghosted files to the new volume. 
     
     
         19 . The system of  claim 18  wherein the replicating the files further comprises moving, after initially replicating the full copies of the corresponding files as ghosted files, the full copies of the corresponding files to the new volume. 
     
     
         20 . The system of  claim 15 , the computer further configured for replicating all directories of the file system to the new volume.