Method for scoring and delivering to a reader test answer images for open-ended questions

Abstract

A method for scoring an answer page containing an answer to an open-ended question includes viewing a first visual image of a first portion of an answer page. The first portion contains an answer space in which an answer to an open-ended question is expected to reside. If the first portion of the answer page contains a complete answer, the answer is electronically scored. If the first portion of the answer page does not encompass a complete answer, a second visual image of a second portion of the answer page is accessed and viewed. The second portion contains a sector of the answer page outside the answer space. A method is also provided for delivering an answer page to a reader for scoring.

What is claimed is:  
     
         1 . A method for scoring an answer page containing an answer to an open-ended question, the method comprising the steps of: 
 viewing a first visual image of a first portion of an answer page, the first portion comprising an answer space in which an answer to an open-ended question is expected to reside;    if the first portion of the answer page contains a complete answer, electronically scoring the answer;    if the first portion of the answer page does not encompass a complete answer, accessing and viewing a second visual image of a second portion of the answer page, the second portion comprising a sector of the answer page outside the answer space, and electronically scoring the answer.    
     
     
         2 . The method recited in  claim 1 , wherein the viewing step comprises receiving the first and the second visual image through a processor onto a display device.  
     
     
         3 . The method recited in  claim 1 , further comprising the steps of: 
 entering an electronic scoring system;    requesting to view an answer to score; and    receiving the first visual image from a queue comprising a plurality of answer page images.    
     
     
         4 . The method recited in  claim 1 , wherein the electronically scoring step comprises selecting a numerical score for the answer from a score sector on a display.  
     
     
         5 . The method recited in  claim 4 , wherein the score sector comprises a score button bar displayed on a common display with the first visual image.  
     
     
         6 . The method recited in  claim 1 , further comprising the steps, if the first and the second visual image do not encompass a complete answer, of repeating the accessing and viewing steps until substantially the entire answer page is viewed.  
     
     
         7 . The method recited in  claim 6 , wherein, if the entire answer page does not encompass a complete answer, viewing a first visual image of a second answer page to search for a complete answer.  
     
     
         8 . The method recited in  claim 1 , wherein the viewing steps comprise receiving the first and the second visual image through a processor onto a display device, and the accessing step comprises electronically manipulating a scroll bar on the display device.  
     
     
         9 . The method recited in  claim 1 , further comprising the step of, if a question occurs during the scoring step, electronically transmitting a query to a supervisor.  
     
     
         10 . The method recited in  claim 1 , wherein the answer comprises an answer in verbal form.  
     
     
         11 . The method recited in  claim 1 , wherein the answer comprises a geometric diagram.  
     
     
         12 . The method recited in  claim 11 , further comprising the step of accessing an electronically manipulable display of a geometric tool for assessing the geometric diagram.  
     
     
         13 . The method recited in  claim 1 , wherein the answer comprises a calibration answer, and further comprising the steps of receiving a score and comparing the received score with a target score.  
     
     
         14 . The method recited in  claim 13 , further comprising the step of calculating a reader effectiveness from the comparing step.  
     
     
         15 . The method recited in  claim 13 , further comprising the steps of calculating a time span between the first visual image viewing step and the scoring step, and comparing the time span with a target scoring time.  
     
     
         16 . The method recited in  claim 15 , further comprising the step of calculating a reader efficiency from the time-span comparing step.  
     
     
         17 . A method for delivering an answer page containing an answer to an open-ended question to a reader for scoring, the method comprising the steps of: 
 retrieving from a storage device a visual image of an answer page containing an answer to an open-ended question;    formatting a first display screen comprising a first visual image of a first portion of an answer page, the first portion comprising an answer space in which an answer to an open-ended question is expected to reside;    transmitting to a reader display device the first display screen; and    permitting reader visual access on the display device to a second portion of the answer page at least partially outside the first portion.    
     
     
         18 . The method recited in  claim 17 , wherein the retrieving step comprises the steps of: 
 determining a batch comprising a plurality of answers to be scored, the plurality of answers comprising answers to a unitary test question;    fetching answer page images corresponding to the determined batch from a storage device; and    holding the fetched answer page images in a cache.    
     
     
         19 . The method recited in  claim 18 , further comprising the steps, prior to the formatting and transmitting steps, of retrieving a scoring and a display protocol for answers to the test question.  
     
     
         20 . The method recited in  claim 19 , wherein the scoring protocol comprises a numerical score range for answers to the test question.  
     
     
         21 . The method recited in  claim 20 , wherein the first visual image comprises a score selection element, and the formatting step comprises including the score selection element as dictated by the display protocol.  
     
     
         22 . The method recited in  claim 21 , wherein the score selection element comprises a score button bar.  
     
     
         23 . The method recited in  claim 17 , wherein the first display screen further comprises a score selection element.  
     
     
         24 . The method recited in  claim 17 , wherein, if the answer page does not encompass a complete answer, repeating the retrieving, formatting, transmitting, and permitting steps on a second answer page.  
     
     
         25 . The method recited in  claim 17 , wherein the first display screen further comprises an electronically manipulable scroll bar, and wherein the permitting step comprises receiving a signal indicative of a manipulation of the scroll bar and transmitting to the reader display device a second display screen comprising the second portion of the answer page corresponding to the signal.