Systems and methods for on-line backup and disaster recovery

Abstract

A data recovery system includes a plurality of customer computers to be backed-up, each customer computer running a client software to communicate back-up data files; a system management platform coupled to the client software over the Internet, the system management platform receiving inputs from a web user portal to control operations of the client software and the system management platform to back up the customer computer; and two or more data storage silos, each including: a plurality of storage directors communicating with the client software; and a clustered data storage array.

1 . A method for real-time reporting for a data storage volume, comprising:
 providing a plurality of data storage volumes distributed over widely separated geo-physical locations for redundancy and disaster recovery, each including a pair of head nodes and a plurality of storage nodes, wherein each storage node comprises a computer with disks and an on-disk encryptor to generate clear text and sent over an Internet Small Computer System Interface (iSCSI), wherein iSCSI traffic is load balanced and fails over network links and connected to a plurality of switches and wherein iSCSI data comprise whole disk mappings and wherein the head nodes create RAID stripes across the storage nodes;   sampling one or more storage metrics on the volume on a periodic basis for one or more predetermined data storage devices, wherein the data storage devices comprise a data center and coupled to an application server and in communication with mirror client computers, wherein the application server communicates with a metrics processor;   packaging the metrics into one or more messages;   queuing the messages at one or more message queuing servers; and   delivering to predetermined receiving agents that store the messages in a database holding aggregate metrics for the volume and correlated by customer.   
     
     
         2 . The method of  claim 1 , comprising periodically rolling up data to reduce data granularity. 
     
     
         3 . The method of  claim 2 , wherein the rolling-up comprises querying the database for a specified roll up interval, receiving the data, calculating an average and generating a rollup entry in the database. 
     
     
         4 . The method of  claim 3 , comprising removing old data points from the database. 
     
     
         5 . The method of  claim 2 , comprising using rolled-up metrics to replace an interval of sampled data and determining averages of larger time periods. 
     
     
         6 . The method of  claim 2 , comprising using rolled-up metrics for a graphical display of time series metrics. 
     
     
         7 . The method of  claim 1 , comprising packaging each sample in a format including a volume identifier, a timestamp and one or more collected metrics. 
     
     
         8 . The method of  claim 1 , comprising displaying an arbitrary set of metrics for user review. 
     
     
         9 . The method of  claim 1 , comprising providing a zoom view to show more data to the user. 
     
     
         10 . The method of  claim 1 , comprising executing billing agents that aggregate monthly metrics into a monthly bill based on average or maximum storage for a month, and average, actual, or maximum bandwidth for the month. 
     
     
         11 . A system, comprising:
 a plurality of customer computers to be backed-up, each customer computer running a client software to transfer back-up data files and to provide real-time billing and metrics reporting by sampling one or more storage metrics on the volume on a periodic basis; packaging the metrics into one or more messages; queuing the messages at one or more message queuing servers; and delivering to predetermined receiving agents that store the messages in a database holding aggregate metrics for the volume and correlated by customer;   a system management platform coupled to the client software over the Internet, the system management platform receiving inputs from a web user portal to control operations of the client software and the system management platform to back up the customer computer; and   two or more data storage silos, each distributed over widely separated geo-physical locations for redundancy and disaster recovery and including
 a plurality of storage directors communicating with the client software; and 
 a clustered data storage array; ad 
 a pair of head nodes and a plurality of storage nodes, wherein each storage node comprises a computer with disks and an on-disk encryptor to generate clear text and sent over an Internet Small Computer System Interface (iSCSI), wherein iSCSI traffic is load balanced and fails over network links and connected to a plurality of switches and wherein iSCSI data comprise whole disk mappings and wherein the head nodes create RAID stripes across the storage nodes. 
   
     
     
         12 . The system of  claim 11 , wherein the client software communicates using Web-based Distributed Authoring and Versioning to collaborative updating and management of files on remote web servers and wherein the client software selects the number of threads, and wherein the client software comprises a configurable parallelism selection for multi-processor efficiency and high latency connections, or for backing up NAS/SAN or RAID arrays with multiple disks. 
     
     
         13 . (canceled) 
     
     
         14 . The system of  claim 11 , comprising means for periodically rolling up data to reduce data granularity. 
     
     
         15 . The system of  claim 14 , wherein the rolling-up comprises means for querying the database for a specified roll up interval, receiving the data, calculating an average and generating a rollup entry in the database. 
     
     
         16 . The system of  claim 15 , comprising means for removing old data points from the database. 
     
     
         17 . The system of  claim 14 , comprising means for using rolled-up metrics to replace an interval of sampled data and determining averages of larger time periods. 
     
     
         18 . The system of  claim 11 , comprising means for using rolled-up metrics for a graphical display of time series metrics. 
     
     
         19 . The system of  claim 11 , comprising means for packaging each sample in a format including a volume identifier, a timestamp and one or more collected metrics. 
     
     
         20 . The system of  claim 11 , comprising one or more billing agents that aggregate monthly metrics into a monthly bill based on average or maximum storage for a month, and average, actual, or maximum bandwidth for the month.