Item banking system for standards-based assessment

Abstract

An computer item banking system for standards-based assessments has test items used in standards-based assessments wherein a plurality of item specifications are developed using a specification building feature to create new, edit, move, and delete specifications and to assign specifications to one or more standards; a plurality of test items are constructed and edited using a test building feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned; bank types include agency-wide assessments including benchmark tests and end-of-course examinations, and formative assessments such as classroom quizzes. The system includes means for certification of test items and preventing use of uncertified test items to be used in agency-wide assessments under construction.

1 . A computer-implemented item banking system for test items used in standards-based student assessments comprising:
 a plurality of item specifications, wherein each item specification is associated to exactly one performance objective of a predetermined educational standard, wherein   each item specification is arranged to inform an author in creating a corresponding class of assessment items suitable for assessing student ability relative to the corresponding performance objective, wherein the item specification includes a title, a description of an item class defined by the item specification, and a set of requirements for an assessment item to be included in the corresponding class;   each item specification stored in a digital library of the item banking system with a link, identifier or other association to the corresponding performance objective; and   a plurality of test items each constructed so as to comply with a selected one of the item specifications, whereby a user of the banking system can construct a test aligned to one performance objective by selecting at least one of the test items that are compliant with the corresponding item specification.   
     
     
         2 . The computer-implemented item banking system of  claim 1  further comprising:
 an interactive test building feature further enabling a user to specify a type of test item being constructed, points available for the test item, and a selected type of item bank to which the test item is assigned; and 
 wherein the item bank type is selectable from available item bank types including an agency-wide benchmark assessments item bank type, and a formative assessments item bank type. 
 
     
     
         3 . The computer-implemented item banking system according to  claim 1  wherein a test item and an item specification are each mapped to only one item class, and an item class is mapped to only one standard within a single set of standards. 
     
     
         4 . The computer-implemented item banking system according to  claim 1  wherein a set of test items, via mapping to an item specification, are mapped to more than one standard only when each of the standards is in a different set of standards. 
     
     
         5 . A non-transitory computer-readable medium encoded with a computer executable instructions for implementing the recited features of  claim 1 . 
     
     
         6 . The computer-implemented item banking system according to  claim 1  including a test item review feature, to confirm compliance of a test item with an associated item specification, wherein the system is configured to generate a display of a selected item specification in a popup window within a review screen of the test item review feature. 
     
     
         7 . A computer-implemented item banking system for test items used in standards-based assessments comprising:
 a plurality of item specifications developed using a specification building feature to create new, edit, move, and delete specifications and to assign each item specification to exactly one corresponding performance objective of each of multiple different standards;   a plurality of test items each constructed and edited using a test building feature so as to comply with a selected one of the item specifications;   a test item review and certification feature for certifications of test items, wherein said test item review and certification feature is configured to generate:   a graphical screen display that displays all of the test items linked to a selected one of the plurality of item specifications, so as to assist a user of the system in constructing tests aligned to educational standards; and   a display of available item classifications for a selected test item to enable a reviewer to classify the selected test item in terms of a selected one of a predetermined set of review categories, wherein said set of review categories include Not Reviewed, Needs Modification, and Certify review categories.   
     
     
         8 . The computer-implemented item banking system according to  claim 7  including system protection for preventing use of test items that are not classified in the Certify category for inclusion in an agency-wide assessment under construction. 
     
     
         9 . The computer-implemented item banking system according to  claim 7  wherein the system is configured to display the corresponding item specification while a user is using the test building feature to create a new test item, to help ensure compliance with the item specification. 
     
     
         10 . A computer-implemented method to construct a test aligned to educational standards in the K-12 domain, the method comprising:
 (a) storing, in a memory, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding performance objective PO;   (b) in a user interface, displaying at least one of the stored performance objectives of the first set of educational standards;   (c) for each of the displayed performance objectives, specifying the PO in the screen display by corresponding subject, scale, concept, and brief description; [for example, M07-S1C2-01. Express fractions as decimals.]   (d) receving, via the user interface, a user selection of one of the displayed performance objectives;   (e) searching an electronic databank of assessment items to idenfify are linked or related in the database to the selected performance objective;   (f) responsive to the user selection and the user search request, searching the database to find assessment items that are linked to the selected performance objective;   (g) in the user interface, displaying results of the search, including in the search results display at least one assessment item that is linked to the selected performance objective;   (h) receving via the user interface, a user selection of one item from the displayed search results; and   (i) responsive to a user input request, adding the user-selected item to the Dialog, thereby enabling the user to include in the dialog an assessment item aligned to the selected performance objective of the first set of educational standards.   
     
     
         11 . A computer-implemented method for mapping assessment items across educational performance standards, the method comprising:
 (a) storing, in a storage, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding performance objective;   (b) storing, in said storage, second data comprising a second set of educational standards promulgated by a second agency, each one of the second set of standards comprising at least one corresponding performance objective;   (c) using a computer having access to the storage, creating at least one item specification, the item specification including a title for the item specification, a description of an item class defined by the item specification, and requirements for membership of an assessment item in the item class, the requirements including at least one specified performance objective; and   (d) using the computer, assigning the item specification to exactly one performance objective in the first set of educational standards, and to exactly one performance objective in the second set of educational standards.   
     
     
         12 . The method of  claim 11  and further comprising:
 (e) using the computer, storing the item specification in association with a selected library of test items; 
 (f) using the computer, creating a new item to add to a selected library of test items, wherein creating said new item includes selecting an item bank question type, entering a point value for the new item, and the selecting a type of bank to which the new item is assigned; and 
 (g) using the computer, mapping the new item to a selected item specification, whereby the item is automatically and correctly associated to both the first set of standards and the second set of standards. 
 
     
     
         13 . The method of  claim 11  wherein the first and second agencies are different educational entities within the U.S. federal government. 
     
     
         14 . The method of  claim 11  wherein the first and second agencies are different state education agencies. 
     
     
         15 . The method of  claim 11  wherein exactly one of the first and second agencies are different local education agencies. 
     
     
         16 . The method of  claim 11  wherein one of the first and second agencies is a state, local or federal education agency within a different parent agency than the other one of the first and second agencies.