Providing a result with a requested accuracy using individuals previously acting with a consensus

Abstract

A result for a task may be provided in response to receiving a request from, for example, a user for the result. The request specifies a desired accuracy level for the result. The accuracy of the result is determined using the individual accuracies of one or more persons that have selected the result. Each person's individual accuracy is determined based on results for prior tasks previously performed by that person. The person's individual accuracy is proportional to the number of that person's prior results that are with a consensus of other persons that have performed the same prior task. The result is provided if the accuracy of the result is equal to or greater than the desired accuracy level.

1 - 16 . (canceled) 
     
     
         17 . A method of distributing data over a network to a remote computing system, the method comprising:
 providing a first computing device comprising at least one processor and a storage device coupled to the at least one processor for storage of data, the storage device comprising at least one memory;   storing, by the first computing device, in at least one database of the storage device, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device;   receiving, by the first computing device, over the network from the remote computing system, a request for a result for a task, the request comprising a desired accuracy level;   determining, by the first computing device, an accuracy for the result using the respective individual accuracy for each of a first plurality of feedback computing devices selecting the result, each respective individual accuracy retrieved from the storage device; and   providing, by the first computing device, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing of the result causing display, by software executing on the remote computing system, of first data in a user interface of the remote computing system, the first data automatically selected based on the result.   
     
     
         18 . The method of  claim 17 , wherein the first data is at least one of a video or an image. 
     
     
         19 . The method of  claim 17 , further comprising sending a link to the first data, the link used to cause the display of the first data on the remote computing system. 
     
     
         20 . The method of  claim 17 , wherein the consensus is based on a frequency of a content material being selected. 
     
     
         21 . The method of  claim 17 , wherein each respective individual accuracy is determined based on a comparison of prior results for the respective feedback computing device with prior results for a second plurality of feedback computing devices. 
     
     
         22 . The method of  claim 21 , wherein at least a portion of the first plurality of feedback computing devices is present in the second plurality of feedback computing devices. 
     
     
         23 . The method of  claim 17 , wherein the task is selection of one of a plurality of choices presented in a web page on a display of a feedback computing device, and the result is one of the choices. 
     
     
         24 . The method of  claim 17 , wherein the task comprises reviewing a plurality of phrases and the result is a first phrase selected from the plurality of phrases. 
     
     
         25 . The method of  claim 24 , wherein each of the plurality of phrases corresponds to a respective content item, and the first data corresponds to the first phrase. 
     
     
         26 . The method of  claim 17 , further comprising increasing a number of the first plurality of feedback computing devices until accuracy of the result is equal to or greater than the desired accuracy level. 
     
     
         27 . A non-transitory computer-storage medium storing instructions configured to instruct, for distributing data over a network to a remote computing system, a first computing device to:
 store, by the first computing device, in at least one database, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks;   receive, by the first computing device, over the network from the remote computing system, a request for a result, the request comprising a desired accuracy level;   determine, by the first computing device, an accuracy for the result using the respective individual accuracy for each of a plurality of feedback computing devices selecting the result, each respective individual accuracy retrieved from the storage device; and   provide, by the first computing device, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing of the result causing display, by software executing on the remote computing system, of first data in a user interface of the remote computing system, the first data selected based on the result.   
     
     
         28 . The non-transitory computer-storage medium of  claim 27 , wherein each respective individual accuracy is determined based on a comparison of prior results for the respective feedback computing device with prior results for other computing devices. 
     
     
         29 . The non-transitory computer-storage medium of  claim 27 , wherein each of the prior tasks is selection of one of a plurality of choices presented on a display of a feedback computing device. 
     
     
         30 . The non-transitory computer-storage medium of  claim 27 , wherein the result is a first phrase selected from a plurality of phrases. 
     
     
         31 . The non-transitory computer-storage medium of  claim 30 , wherein each of the plurality of phrases corresponds to a respective content item, and the first data corresponds to the first phrase. 
     
     
         32 . A system for distributing data over a network to a remote computing system, the system comprising:
 at least one processor;   a storage device, coupled to the at least one processor, for storage of data, the storage device comprising at least one memory; and   memory storing instructions configured to instruct the at least one processor to:
 store, in the storage device, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks; 
 receive, over the network from the remote computing system, a request for a result, the request comprising a desired accuracy level; 
 determine an accuracy for the result using the respective individual accuracy for each of a plurality of feedback computing devices selecting the result, each respective individual accuracy retrieved from the storage device; and 
 provide the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing of the result causing display, by software executing on the remote computing system, of first data in a user interface of the remote computing system, the first data selected based on the result. 
   
     
     
         33 . The system of  claim 32 , wherein the instructions are further configured to instruct the at least one processor to send a link to the first data, the link used to cause the display of the first data on the remote computing system. 
     
     
         34 . The system of  claim 32 , wherein the consensus is based on a frequency of a content item being selected. 
     
     
         35 . The system of  claim 32 , wherein each of the prior tasks is selection of one of a plurality of choices presented on a display of a feedback computing device. 
     
     
         36 . The system of  claim 32 , wherein each of the prior tasks comprises reviewing a plurality of phrases, the result is a first phrase selected from the plurality of phrases, each of the plurality of phrases corresponds to a respective content item, and the first data corresponds to the first phrase.