Scenario workflow based assessment system and method

Abstract

A system and a method for automating performance assessments of an exercise or a training activity provide event assessment information in real-time to one or more evaluators in conjunction with unfolding events. The evaluators can wirelessly communicate assessment information to a database for after action review (AAR).

1 . A method comprising: 
 defining a scenario workflow relative to a selected situation;    storing the workflow;    establishing a set of assessment criteria relative to a plurality of workflow related events;    retrieving assessment criteria for at least one active event as the scenario proceeds; and    providing the retrieved assessment criteria to an evaluator.    
   
   
       2 . A method as in  claim 1  where the assessment criteria are provided to the evaluator at or about the time the active event occurs.  
   
   
       3 . A method as in  claim 2  where the criteria are communicated, at least in part, wirelessly.  
   
   
       4 . A method as in  claim 2  which includes storing real-time evaluation information relative to the active event.  
   
   
       5 . A method as in  claim 4  which includes providing supplemental information relative to evaluating the event, in response to previously stored observations.  
   
   
       6 . A method as in  claim 5  where the criteria are communicated, at least in part, wirelessly.  
   
   
       7 . A method as in  claim 5  where the supplemental information is provided in real-time as the event is taking place.  
   
   
       8 . A method as in  claim 7  which includes storing evaluation information during the event grouped at least by predetermined objectives.  
   
   
       9 . A method as in  claim 8  which includes replaying stored information relative to the event, in combination with temporally related, pre-stored, evaluation information.  
   
   
       10 . A method as in  claim 9  which includes preparing reports pertaining to scenario implementation.  
   
   
       11 . A method as in  claim 7  where the supplemental information is provided, in part, wirelessly to at least one evaluator.  
   
   
       12 . A method as in  claim 7  which includes carrying out a plurality of events related to the scenario workflow.  
   
   
       13 . A method as in  claim 12  which includes wirelessly receiving assessment criteria related to a plurality of workflow related events.  
   
   
       14 . A method as in  claim 13  which includes providing wireless receivers to the evaluators.  
   
   
       15 . A system comprising: 
 a stored workflow event list;    a stored event assessment criteria list;    circuitry to provide information to an evaluator for assessing a plurality of events; and    circuitry for providing supplemental information to the evaluator.    
   
   
       16 . A system as in  claim 15  which includes circuitry to provide assessment criteria to a plurality of evaluators.  
   
   
       17 . A system as in  claim 16  which includes storage for a plurality of event assessments.  
   
   
       18 . A system as in  claim 17  which includes a plurality of evaluator units which provide context-sensitive assessment criteria.  
   
   
       19 . A system as in  claim 18  where at least some of the units communicate wirelessly.  
   
   
       20 . A system as in  claim 19  where the units include software enabling an evaluator to enter exercise related observations.  
   
   
       21 . A system as in  claim 20  where the units include software to receive and present feedback information to the evaluator relative to the exercise.  
   
   
       22 . A system for evaluating performance during a scenario comprising: 
 first software for creating a plurality of scenario workflow events;    second software for creating assessment criteria for each of the workflow events;    software for determining at least one active event of an on-going scenario;    software for retrieving assessment criteria for the active event;    software for receiving event related assessment information from the evaluator; and    software providing for supplemental assessment information to an evaluator.    
   
   
       23 . A system as in  claim 22  where the first software creates and stores at least one workflow event list.  
   
   
       24 . A system as in  claim 23  where the second software creates and stores a workflow event assessment criteria list.  
   
   
       25 . A system as in  claim 22  which includes software for displaying assessment criteria for the active event.  
   
   
       26 . A system as in  claim 22  which includes software for displaying supplemental information concerning an on-going event to the evaluator.  
   
   
       27 . A system as in  claim 22  which includes wireless I/O devices for entering assessment information.  
   
   
       28 . A system as in  claim 19  which includes software for storing assessment information.  
   
   
       29 . A system as in  claim 28  for retrieving stored assessment information.