Proctored Performance Analysis

Abstract

Systems and methods described herein provide for administering and proctoring of a secure online exam that allows for complex testing utilizing practical examination tasks. The practical examination tasks provide for evaluation of the knowledge of the exam taker, as well as the exam taker's ability to apply that knowledge in a real-world environment. By performing the practical examination tasks in the context of a secure online exam, the competence of the test taker can be readily determined without worrying about the exam taker illicitly accessing information on their computer or via a remote source of data. The exam taker may perform the practical examination tasks through manipulation of an evaluation application executing on the exam taker's secured computer. The practical examination tasks may also be carried out through manipulation by the exam taker of an evaluation apparatus coupled to the exam taker's secured computer.

1 - 26 . (canceled) 
     
     
         27 . A system for administration of a secure examination via a network, the system comprising:
 a first computing device coupled to the network, the first computing device to:
 receive testing data to execute a testing routine during the examination; 
 execute a secure testing application that implements security limitations for the first computing device during the testing routine by limiting functionality of at least one evaluation component for enabling a user to perform one or more practical examination tasks during the testing routine; and 
 provide interaction data indicating manipulation of the first computing device by the user when performing the one or more practical examination tasks; and 
   a second computing device coupled to the network to determine competence of the user in the performance of the one or more practical examination tasks, based on the interaction data.   
     
     
         28 . The system of  claim 27 , wherein the at least one evaluation component is an evaluation application and wherein the interaction data includes input provided by the user to manipulate the evaluation application. 
     
     
         29 . The system of  claim 28 , wherein the security limitations implemented by the secure testing application include limitations that prohibit execution of the evaluation application during a particular portion of the testing routine. 
     
     
         30 . The system of  claim 28 , wherein the security limitations implemented by the secure testing application include limiting functionality of the evaluation application when executed by the first computing device. 
     
     
         31 . The system of  claim 27 , wherein the at least one evaluation component is an evaluation apparatus coupled to the first computing device and wherein the interaction data identifies manipulation of the evaluation apparatus. 
     
     
         32 . The system of  claim 31 , wherein the interaction data indicates a response of the evaluation apparatus to the manipulation by the user, so that the second computing device can determine competence of the user in the performance of the one or more practical examination tasks based on the response. 
     
     
         33 . The system of  claim 31 , wherein the security limitations for the evaluation apparatus include limitations that prohibit manipulation of the evaluation apparatus during a particular portion of the testing routine. 
     
     
         34 . The system of  claim 31 , wherein the evaluation apparatus is coupled to the first computing device via the network and security limitations for the evaluation apparatus include allowing only certain types of data to be exchanged with the evaluation apparatus via the network. 
     
     
         35 . The system of  claim 31 , wherein the evaluation apparatus is manipulated by the user via user input to an evaluation application executing on the first computing device, the evaluation application providing configuration data to control the evaluation apparatus based on the user input. 
     
     
         36 . The system of  claim 27 , further comprising a testing server coupled to the network to provide the testing data to the first computing device during the examination. 
     
     
         37 . A method for administration of a secure examination via a network, the method comprising:
 providing testing data for the examination during execution of a testing routine on a computing device, the testing data provided over the network and including security limitations for the computing device during the testing routine by limiting functionality of at least one evaluation component for enabling a user to perform one or more practical examination tasks during the testing routine;   receiving interaction data over the network indicating manipulation of the computing device by the user when performing the one or more practical examination tasks during the testing routine; and   analyzing the received interaction data to determine competence of the user in the one or more practical examination tasks.   
     
     
         38 . The method of  claim 37 , wherein the at least one evaluation component is an evaluation application and wherein the interaction data includes user input provided by the user to manipulate the evaluation application executing on the computing device. 
     
     
         39 . The method of  claim 37 , wherein the at least one evaluation component is an evaluation application and wherein the security limitations include limitations that prohibit execution of the evaluation application during a particular portion of the testing routine. 
     
     
         40 . The method of  claim 37 , wherein the at least one evaluation component is an evaluation application and wherein the security limitations include limiting functionality of the evaluation application when executed by the computing device. 
     
     
         41 . The method of  claim 37 , wherein the evaluation component is an evaluation apparatus coupled to the first computing device and wherein the interaction data identifies manipulation of the evaluation apparatus. 
     
     
         42 . The method of  claim 41 , wherein the interaction data indicates a response of the evaluation apparatus to the manipulation by the user and wherein analyzing the received interaction data includes analyzing the interaction data indicating the response of the evaluation apparatus to determine competence of the user in the performance of the one or more practical examination tasks. 
     
     
         43 . The method of  claim 41 , wherein the security limitations for the evaluation apparatus include limitations that prohibit manipulation of the evaluation apparatus during a particular portion of the testing routine. 
     
     
         44 . The method of  claim 41 , wherein the evaluation apparatus is coupled to the first computing device via the network, and security limitations for the evaluation apparatus include allowing only certain types of data to be exchanged with the evaluation apparatus via the network. 
     
     
         45 . The method of  claim 41 , wherein the evaluation apparatus is manipulated by the user via user input to an evaluation application executing on the computing device, the evaluation application providing configuration data to control the evaluation apparatus based on the user input. 
     
     
         46 . The method of  claim 41 , wherein the evaluation apparatus is manipulated by the user via physical input by the user to the evaluation apparatus, and the interaction data includes interaction data indicating the physical input.