Distributed scalable workload testing

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are described for sending a first set of instructions to a first pool of workers for performing a first task configured to interact with a separate computer system, wherein the first pool of workers is allocated on a plurality of nodes. The method may also include updating at least a portion of the first set of instructions for a subset of the first pool of workers while the workers are performing the first task. The method may also include monitoring one or more performance metrics associated with the separate computer system while the workers from the subset of the first pool are performing the first task.

What is claimed is: 
     
         1 . A method, comprising:
 sending a first set of instructions to a first pool of workers for performing a first task configured to interact with a separate computer system,
 wherein the first pool of workers is allocated on a plurality of nodes; 
   updating at least a portion of the first set of instructions for a subset of the first pool of workers while the workers are performing the first task; and   monitoring one or more performance metrics associated with the separate computer system while the workers from the subset of the first pool are performing the first task.   
     
     
         2 . The method of  claim 1 , wherein each node in the plurality of nodes comprises one or more of the workers from the first pool. 
     
     
         3 . The method of  claim 1 , wherein each worker from the first pool resides on a separate node. 
     
     
         4 . The method of  claim 1 , wherein the plurality of nodes comprises at least one director node and at least one worker node. 
     
     
         5 . The method of  claim 1 , wherein the one or more performance metrics comprise at least one of speed or latency. 
     
     
         6 . The method of  claim 1 , comprising:
 sending the one or more performance metrics to a client device of a user.   
     
     
         7 . The method of  claim 1 , comprising:
 changing a quantity of the workers in the subset of the first pool while the workers are performing the first task.   
     
     
         8 . The method of  claim 1 , comprising:
 allocating a second pool of workers on the plurality of nodes;   sending a second set of instructions to the second pool of workers for performing a second task configured to interact with the separate computer system; and   activating the second pool of workers to perform the second task.   
     
     
         9 . The method of  claim 8 , wherein the first task and the second task are performed in parallel. 
     
     
         10 . The method of  claim 1 , wherein each node in the plurality of nodes comprises a virtual machine or a physical machine. 
     
     
         11 . A system, comprising:
 one or more computer processors programmed to perform operations to:
 send a first set of instructions to a first pool of workers for performing a first task configured to interact with a separate computer system,
 wherein the first pool of workers is allocated on a plurality of nodes; 
 
 update at least a portion of the first set of instructions for a subset of the first pool of workers while the workers are performing the first task; and 
 monitor one or more performance metrics associated with the separate computer system while the workers from the subset of the first pool are performing the first task. 
   
     
     
         12 . The system of  claim 11 , wherein each node in the plurality of nodes comprises one or more of the workers from the first pool. 
     
     
         13 . The system of  claim 11 , wherein each worker from the first pool resides on a separate node. 
     
     
         14 . The system of  claim 11 , wherein the plurality of nodes comprises at least one director node and at least one worker node. 
     
     
         15 . The system of  claim 11 , wherein the one or more performance metrics comprise at least one of speed or latency. 
     
     
         16 . The system of  claim 11 , wherein the operations are further to:
 send the one or more performance metrics to a client device of a user.   
     
     
         17 . The system of  claim 11 , wherein the operations are further to:
 change a quantity of the workers in the subset of the first pool while the workers are performing the first task.   
     
     
         18 . The system of  claim 11 , wherein the operations are further to:
 allocate a second pool of workers on the plurality of nodes;   send a second set of instructions to the second pool of workers for performing a second task configured to interact with the separate computer system; and   activate the second pool of workers to perform the second task.   
     
     
         19 . The system of  claim 18 , wherein the first task and the second task are performed in parallel. 
     
     
         20 . A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more computer processors, cause the one or more computer processors to:
 send a first set of instructions to a first pool of workers for performing a first task configured to interact with a separate computer system,
 wherein the first pool of workers is allocated on a plurality of nodes; 
   update at least a portion of the first set of instructions for a subset of the first pool of workers while the workers are performing the first task; and   monitor one or more performance metrics associated with the separate computer system while the workers from the subset of the first pool are performing the first task.