Body-of-Work Technological Integration and Enhancements
Introduction to Body-of-Work Technological Integration and Enhancements (BoWTIE)
BoWTIE was specifically designed to implement the achievement levels setting (ALS) process for National Assessment of Educational Progress (NAEP) writing grades 8 and 12 in 2011 for which three cut scores were set – one for each of the three achievement levels: Basic, Proficient, and Advanced.
The Body of Work (BoW) standard setting method was implemented in three rounds with the first two rounds using a set of 50 student work samples presented in order of performance from highest to lowest. A second set of 50 student work samples was used on the third round. Each student work consists of responses to two writing tasks. A classification tally and graphic inter-rater consistency information are among the feedback presented between rounds of student work classification. An interactive consequences data feedback interface is integrated in the application to provide impact data.
BoWTIE may be used in an implementation of the BoW method with stages that are consistent with the ALS implementation for which it was designed.
The following documentation is available for BoWTIE:
- BoWTIE Panelist User Guide: Provides general information and instructions to panelists using the BoWTIE Panelist application for setting achievement level cut scores.
- BoWTIE Administration User Guide: Provides general information and instructions to administrators using the BoWTIE WarRoom application to manage the achievement levels setting process.
- BoWTIE Technical User Guide: Provides system requirements and install information for the BoWTIE Panelist and WarRoom applications.
For additional information, refer to the ALS Writing reports on the National Assessment Governing Board website:
A comparison on the two software types with functionalities is available here.
Download the source files (15.7MB)
THE NATIONAL ASSESSMENT GOVERNING BOARD IS PROVIDING THE SOFTWARE AS IT IS, AND MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND CONCERNING THE WORK—EXPRESS, IMPLIED, STATUTORY OR OTHERWISE, INCLUDING WITHOUT LIMITATION WARRANTIES OF TITLE, MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, NON-INFRINGEMENT, OR THE PRESENCE OR ABSENCE OF LATENT OR OTHER DEFECTS, ACCURACY, OR THE PRESENCE OR ABSENCE OF ERRORS, WHETHER OR NOT DISCOVERABLE, ALL TO THE GREATEST EXTENT PERMISSIBLE UNDER FEDERAL LAW.