Systems and methods for an intelligent sourcing engine for study participants

Abstract

Systems and methods for sourcing participants for a usability study are provided. In some embodiments the systems and methods receive study parameters including the type of study, time-to-field of the study, required number of participants, and required participant attributes. Additionally, a set of business rules for the study are received. These business rules may be received from a client, extrapolated from a service contract with a client for which the study is being performed, or generated based on the monitored outcomes of sourcing of previous studies. Next, panel sources for potential participants and pricing data are queried, and a set of the sources are selected based upon the pricing data. Participants are then received from these sources, which are then fielded in the study and monitored for outcomes.

What is claimed is: 
     
         1 . A method for sourcing participants for a usability study comprising:
 receiving study parameters including the type of study, time-to-field of the study, required number of participants, and required participant attributes;   receiving a set of business rules for the study;   querying a plurality of panel sources for potential participants and pricing data;   selecting a subset of the panel sources responsive to the pricing data;   receiving participants from the subset of the panel sources;   fielding the participants in the study; and   monitoring participant outcomes.   
     
     
         2 . The method of  claim 1 , wherein the business rules are received from a client for which the study is being performed. 
     
     
         3 . The method of  claim 1 , wherein the business rules are extrapolated from a service contract with a client for which the study is being performed. 
     
     
         4 . The method of  claim 1 , wherein the business rules are generated based on the monitored outcomes of sourcing of previous studies. 
     
     
         5 . The method of  claim 1 , further comprising filtering the plurality of panel sources based upon a minimum quality threshold. 
     
     
         6 . The method of  claim 5 , wherein a quality metric fir each panel source is generated by prior participation in studies responsive to timing of study tasks, red herring questions, answer consistency and answer patterns. 
     
     
         7 . The method of  claim 1 , wherein the selecting the subset of panel sources comprises:
 determining an available number of participants in each panel source;   calculating a pool size in each panel source of participants from the available number of participants which historically have engaged in the type of study and within the time-to-field of the study;   ranking the plurality of panel sources by the pricing data; and   comparing the pool size of each panel source to the required number of participants in order of the ranking until the aggregation of the pool sizes exceeds the required number of participants.   
     
     
         8 . The method of  claim 7 , wherein the determining the available number of participants in each panel source includes determining the potential participants that have the required participant attributes. 
     
     
         9 . The method of  claim 8 , wherein the determining the potential participants that have the required participant attributes includes filtering the potential participants for targetable attributes that are known, estimating not known targetable attributes by demographic frequency and known attribute correlation, and predicting non-targetable attributes using statistical sampling. 
     
     
         10 . The method of  claim 1 , further comprising throttling a rate of invitations to the subset of panel sources for the participants based upon a rate of participation compared against an estimate of participation rate. 
     
     
         11 . The method of  claim 1 , wherein the fielding includes providing a file of participant information to a usability testing system to alter the usability testing of the participants based upon known data. 
     
     
         12 . An intelligent sourcing engine for sourcing participants for a usability study comprising:
 a study database containing study parameters including the type of study, time-to-field of the study, required number of participants, and required participant attributes;   a rules database containing a set of business rules for the study;   a study estimation server for querying a plurality of panel sources for potential participants and pricing data;   a selection server for selecting a subset of the panel sources responsive to the pricing data; and   an administration server for receiving participants from the subset of the panel sources, fielding the participants in the study, and monitoring participant outcomes.   
     
     
         13 . The system of  claim 12 , wherein the business rules are received from a client for which the study is being performed. 
     
     
         14 . The system of  claim 12 , wherein the business rules are extrapolated from a service contract with a client for which the study is being performed. 
     
     
         15 . The system of  claim 12 , wherein the business rules are generated based on the monitored outcomes of sourcing of previous studies. 
     
     
         16 . The system of  claim 12 , wherein the selection server further filters the plurality of panel sources based upon a minimum quality threshold. 
     
     
         17 . The system of  claim 16 , wherein a quality metric for each panel source is generated by prior participation in studies responsive to timing of study tasks, red herring questions, answer consistency and answer patterns. 
     
     
         18 . The system of  claim 12 , wherein the selection server selecting the subset of panel sources performs the tasks of:
 determining an available number of participants in each panel source;   calculating a pool size in each panel source of participants from the available number of participants which historically have engaged in the type of study and within the time-to-field of the study;   ranking the plurality of panel sources by the pricing data; and   comparing the pool size of each panel source to the required number of participants in order of the ranking until the aggregation of the pool sizes exceeds the required number of participants.   
     
     
         19 . The system of  claim 18 , wherein the determining the available number of participants in each panel source includes determining the potential participants that have the required participant attributes. 
     
     
         20 . The system of  claim 19 , wherein the determining the potential participants that have the required participant attributes includes filtering the potential participants for targetable attributes that are known, estimating not known targetable attributes by demographic frequency and known attribute correlation, and predicting non-targetable attributes using statistical sampling. 
     
     
         21 . The system of  claim 12 , wherein the selection server throttles a rate of invitations to the subset of panel sources for the participants based upon a rate of participation compared against an estimate of participation rate. 
     
     
         22 . The system of  claim 12 , wherein the fielding includes providing a file of participant information to a usability testing system to alter the usability testing of the participants based upon known data.