System for Distributing Requests Across Multiple Servers Using Dynamic Metrics

Abstract

A system for distributing incoming client requests across multiple servers in a networked client-server computer environment processes all requests as a set that occur within a given time interval and collects information on the attributes of the requests and the resource capability of the servers to dynamically allocate requests in a set to the appropriate servers upon completion of the time interval. Preferably, a request table collects at least two requests incoming within a predetermined time interval, a request examiner routine analyzes each collected request with respect to at least one attribute, a system status monitor collects resource capability information of each server in a resource table and an optimization and allocation process distributes collected requests in the request table across the multiple servers upon completion of said time interval based on an optimization of potential pairings of the requests in the request table with servers in the resource table.

1 . A method for allocating hosting-service resources to clients in at least one shared server, said method comprising:
 discovering utilization patterns of said clients;   monitoring said clients to discover said utilization patterns;   providing bounds specifying minimum and maximum hosting-service resources for each of said clients;   modeling dimensions for client user measures and said utilization patterns; and   allocating said resources to said clients dependent on said utilization patterns.   
     
     
         2 . The method according to  claim 1 , further including packing said clients using stochastic vectors. 
     
     
         3 . The method according to  claim 2 , wherein said packing utilizes at least one of a Roof Avoidance process, a Minimized Variance process, a Maximized Minima process, and a Largest Combination process. 
     
     
         4 . The method according to  claim 1 , wherein said hosting-service resources relate to at least one hosting service comprising one of collaborative hosting services, commerce hosting services, and e-business hosting services. 
     
     
         5 . The method according to  claim 1 , wherein said allocating affects a Quality of Service (QoS) guarantee. 
     
     
         6 . The method according to  claim 1 , wherein said utilization patterns are dependent upon access rates of one or more websites, said access rates have periodicity on multiple time scales. 
     
     
         7 . The method according to  claim 6 , wherein two or more clients are selected from a plurality of clients on the basis of complementarity, wherein said hosting-service resources are allocated to said selected two or more clients as a combination. 
     
     
         8 . The method according to  claim 7 , wherein said allocating comprises selecting said two or more clients to be allocated to a server, said two or more selected clients each having a peak load that is substantially disjoint in time in relation to a peak load of the remaining other selected clients. 
     
     
         9 . The method according to  claim 7 , wherein said allocated hosting-service resources include resources allocated exclusively to each of said selected two or more clients and shared resources allocated to said combination for use by said selected two or more clients. 
     
     
         10 . The method according to  claim 8 , wherein N clients are selected and allocated to a server, N being an integer greater than or equal to two, said server being partitioned into N virtual servers, each client being exclusively allocated a corresponding one of said N virtual servers, excess capacity of said server beyond the capacity required to provide said N virtual servers is shared by said N clients. 
     
     
         11 . An apparatus for allocating hosting-service resources to clients in at least one shared server, said apparatus including:
 means for discovering utilization patterns of said clients;   means for monitoring said clients to discover said utilization patterns;   means for providing bounds specifying minimum and maximum hosting-service resources for each of said clients;   means for modeling dimensions for client user measures and said utilization patterns; and   means for allocating said resources to said clients dependent on said utilization patterns.   
     
     
         12 . The apparatus according to  claim 11 , wherein said hosting-service resources relate to at least one hosting service comprising one of collaborative hosting services, commerce hosting services, and e-business hosting services. 
     
     
         13 . The apparatus according to  claim 11 , wherein said allocating means affects a Quality of Service (QoS) guarantee. 
     
     
         14 . The apparatus according to  claim 11 , wherein said utilization patterns are dependent upon access rates of one or more websites, said access rates have periodicity on multiple time scales. 
     
     
         15 . The apparatus according to  claim 14 , wherein two or more clients are selected from a plurality of clients on the basis of complementarity, wherein said hosting-service resources are allocated to said selected two or more clients as a combination. 
     
     
         16 . The apparatus according to  claim 15 , wherein said allocating means includes means for selecting said two or more clients to be allocated to a server, said two or more selected clients each having a peak load that is substantially disjoint in time in relation to a peak load of the remaining other selected clients. 
     
     
         17 . The apparatus according to  claim 16 , wherein N clients are selected and allocated to a server, N being an integer greater than or equal to two, said server being partitioned into N virtual servers, each client being exclusively allocated a corresponding one of said N virtual servers, excess capacity of said server beyond the capacity required to provide said N virtual servers is shared by said N clients. 
     
     
         18 . The apparatus according to  claim 15 , wherein said allocated hosting-service resources include resources allocated exclusively to each of said selected two or more clients and shared resources allocated to said combination for use by said selected two or more clients. 
     
     
         19 - 41 . (canceled)