Research and Publications
Topic

Research & Publications

The Governing Board has authored and commissioned numerous reports on topics related to The Nation’s Report Card and the Board’s work.

 

TitleDescriptionAuthorTopicsYear
1996 Science Performance Standards In this report, the Governing Board presents results for the 1996 National Assessment in Science, reporting the outcomes primarily in terms of achievement levels. Mary Lyn Bourque, Audrey B. Champagne, and Sally Crissman Science 1997
NAEP 12th Grade Preparedness Research Our research addressed whether NAEP could serve as a reliable indicator of academic preparedness for college and job training. Various Academic Preparedness 2017
Design / Feasibility Team - Report to the National Assessment Governing Board The report of the DFT is intended to provide a bridge between the general desired characteristics and priorities for NAEP expressed in the Themes and Issues, on the one hand, and the specifics of a Request for a Proposal (RFP) and the actual detailed designs developed by respondents to the RFP, on the other. Various Assessment Design 1996
Body-of-Work Technological Integration and Enhancements BoWTIE was specifically designed to implement the achievement levels setting (ALS) process for National Assessment of Educational Progress (NAEP) writing grades 8 and 12 in 2011 for which three cut scores were set – one for each of the three achievement levels: Basic, Proficient, and Advanced. Luz Bay Science 2012
Tests and Cut Scores Used for Student Placement in Postsecondary Education: Fall 2011 The primary purpose of this survey is to provide a source of nationally representative data for use as potential validity evidence for NAEP reporting on 12th grade student’s academic preparedness for college. Ray Fields and Basmat Parsad Academic Preparedness 2012
The Origins of the Preparedness Initiative (2012) In 2002, the National Assessment Governing Board established the National Commission on NAEP 12th Grade Assessment and Reporting. This blue-ribbon panel was charged to review the National Assessment of Educational Progress (NAEP) at grade 12 and recommend improvements. The National Assessment Governing Board Academic Preparedness 2013
On NAEP and 12th Grade Preparedness: Discussion Draft of Hypothetical Statements for NAEP Reports (2009) This report contains examples of statements related to 12th grade student preparedness that plausibly could be made in NAEP reports, depending on the outcomes of the Board-adopted program of research. Ray Fields Academic Preparedness 2009
Design of Content Alignment Studies in Mathematics and Reading for 12th Grade NAEP and Other Assessments The purpose of this paper is to provide a detailed design to guide implementation of content alignment studies for the grade 12 National Assessment of Educational Progress (NAEP) in reading and mathematics. Norman L. Webb Academic Preparedness 2009
Report of the Ad Hoc Committee on Planning for NAEP 12th Grade Assessments in 2009 (2006) In November 2005, the National Assessment Governing Board created the Ad Hoc Committee on Planning for NAEP 12th Grade Assessments in 2009. The committee's task was to help give focus and direction to the Board's deliberations in three policy areas. The National Assessment Governing Board Academic Preparedness 2006
Aligning the 12th Grade NAEP with College, Workplace, and Military Expectations: Mathematics (2006) The National Assessment Governing Board (NAGB) is seeking to redesign the 12th Grade NAEP to assess students’ readiness for college, work, and the military. Achieve, Inc. Academic Preparedness 2006
Aligning the 12th Grade NAEP with College, Workplace, and Military Expectations: Reading (2005) This report endorses the idea of a redesigned NAEP to focus on reading "preparedness" for college, work, and entrance to the military and, we hope, presents NAGB with specific, actionable strategies to bring this worthy idea to fruition. Achieve, Inc. Academic Preparedness 2005
NAEP Testing for Twelfth-Graders: Motivational Issues (2005) This commissioned paper draws on theory and research on motivation in education to identify principles that might guide the National Assessment Governing Board’s decision-making concerning twelfth-grade NAEP. Jere Brophy and Carole Ames Academic Preparedness 2005
12th Grade Student Achievement in America: A New Vision for NAEP (2004) The Commission members have concluded that 12th grade NAEP should be redesigned. Twelfth grade NAEP has the potential to supply crucial information about student achievement that America needs and that is unavailable from any other source, but NAEP is not now fulfilling that potential. The National Assessment Governing Board Academic Preparedness 2004
Technical Panel on 12th Grade Preparedness Research - Final Report (2009) The purpose of the Panel was to assist the National Assessment Governing Board in planning research and validity studies that will enable the National Assessment of Educational Progress (NAEP) to report on the preparedness of 12th graders for postsecondary education and job training after they graduate from high school. The National Assessment Governing Board Academic Preparedness 2009
Developing Achievement Levels on the 2014 National Assessment of Educational Progress in Grade 8 Technology and Engineering Literacy: Process Report This report describes the process and outcomes of a study designed and implemented by Pearson to develop achievement levels recommendations for the 2014 National Assessment of Educational Progress (NAEP) in Technology and Engineering Literacy (TEL) for grade 8. Lori Nebelsick-Gullett and Steve Fitzpatrick Achievement Levels 2016
Developing Achievement Levels on the 2014 National Assessment of Educational Progress in Grade 8 Technology and Engineering Literacy: Technical Report This report provides information about the technical aspects of procedures associated with the achievement levels-setting process for the 2014 National Assessment of Educational Progress (NAEP) in Technology and Engineering Literacy (TEL) for grade 8. Steve Fitzpatrick and Morgen Hickey Achievement Levels 2016
Developing Achievement Levels on the 2011 National Assessment of Educational Progress in Grades 8 and 12 Writing: Process Report This report provides a detailed description of the achievement levels–setting (ALS) process implemented by Measured Progress for the purpose of establishing achievement levels for the 2011 National Assessment of Educational Progress (NAEP) in grades 8 and 12 writing. Luz Bay Achievement Levels 2012
Developing Achievement Levels on the 2011 National Assessment of Educational Progress in Grades 8 and 12 Writing: Technical Report This Technical Report provides information on the materials and computational procedures used for the Achievement Levels–Setting (ALS) meetings held for this project. Luz Bay Achievement Levels 2012
National Assessment of Educational Progress Writing Achievement Levels Descriptions - Final Technical Report The results of this evaluation study will be used to develop final descriptions for the 2011/2013 achievement levels setting process, and eventually the final ALDs, adopted by the Board, will be used to report the results of these assessments in the Nation’s Report Card in writing. Mary Lyn Bourque and Lynn Webb Achievement Levels 2011
Participation Standards for 12th Grade NAEP(2005) The National Assessment Governing Board’s new vision for grade 12 NAEP poses serious challenges for dramatically improving response rates at the school and student level as a means to guarantee the quality of NAEP grade 12 estimates. James R. Chromy Participation 2005
Inside NAEP Each of these documents contain a PowerPoint presentation on a specific aspect of the inner-workings of NAEP, including development of the test questions and the frameworks for each subject-area assessment. Various Achievement Levels 2007
Computer-Aided Bookmarking CAB (Computer-Aided Bookmarking) was designed to implement the Bookmarking method of standard setting to set one cut score on a test with multiple choice and constructed response items. WestEd Science 2011
Developing Achievement Levels on the National Assessment of Educational Progress for Writing Grades 8 and 12 in 2011 and Grade 4 in 2013 This Design Document outlines the procedures for setting the cut scores corresponding to the three NAEP achievement levels (Basic, Proficient, and Advanced) and selecting exemplar writing prompts and student responses. Susan Loomis Achievement Levels 2011
Developing Achievement Levels on the 2009 National Assessment of Educational Progress in Science for Grades Four, Eight, and Twelve: Process Report This report describes the process and outcomes of a meeting that was held in January 2010 to set achievement levels for the 2009 National Assessment of Educational Progress (NAEP) in science for grades 4, 8, and 12. ACT, Inc. Achievement Levels 2010
Developing Achievement Levels on the 2009 National Assessment of Educational Progress in Science for Grades Four, Eight, and Twelve: Technical Report This Technical Report provides technical information related to the materials and process used for the achievement level setting (ALS) meeting that was held in January 2010 to set achievement levels for the 2009 NAEP in science for grades 4, 8, and 12. ACT, Inc. Achievement Levels 2010
A History of NAEP Achievement Levels: Issues, Implementation, and Impact, 1989-2009 The paper will then discuss the critical initial implementation decisions made by the National Assessment Governing Board as it developed the student performance standards for NAEP. Mary Lyn Bourque Achievement Levels 2009
Developing Achievement Levels on the 2006 National Assessment of Educational Progress in Grade Twelve Economics: Process Report This report describes the process and outcomes of a meeting that was held in March 2007 to set achievement levels for the 2006 National Assessment of Educational Progress (NAEP) in grade 12 economics. ACT, Inc. Achievement Levels 2007
Developing Achievement Levels on the 2006 National Assessment of Educational Progress in Grade Twelve Economics: Technical Report In September 2006, the National Assessment Governing Board (NAGB) contracted with ACT to conduct research and other activities for setting achievement levels on the 2006 National Assessment of Educational Progress (NAEP) in Grade 12 economics. ACT, Inc. Achievement Levels 2007
Developing Achievement Levels on the 2005 National Assessment of Educational Progress in Grade Twelve Mathematics: Process Report This report describes the process and outcomes of a meeting that was held in November 2004 to set achievement levels for the 2005 National Assessment of Educational Progress (NAEP) in Grade 12 Mathematics. ACT, Inc. Achievement Levels 2005
Developing Achievement Levels on the 2005 National Assessment of Educational Progress in Grade Twelve Mathematics: Technical Report This Technical Report is primarily concerned with the materials and process of the achievement level setting (ALS) meeting that was held in November 2004. ACT, Inc. Achievement Levels 2005
NAEP Achievement Levels for Civics The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
NAEP Achievement Levels for Geography The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
NAEP Achievement Levels for Mathematics The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
NAEP Achievement Levels for Reading The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
NAEP Achievement Levels for Science The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
NAEP Achievement Levels for U.S. History The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
NAEP Achievement Levels for Writing The purpose of this report is to increase understanding of the achievement levels for the National Assessment of Educational Progress (NAEP): what they are, and what they are not. Susan Cooper Loomis and Mary Lyn Bourque Achievement Levels 2001
Developing Achievement Levels for the 1998 NAEP in Civics Interim Report: Field Trials This report documents two field trials conducted for civics. Taken together, the field trials research provided important information about various elements that constitute the ACT/NAGB standard-setting process. Susan Cooper Loomis, Patricia L. Hanick, Luz Bay, and Jill D. Crouse Achievement Levels 2000
Developing Achievement Levels for the 1998 NAEP in Civics Interim Report: Pilot Study The Civics Pilot Study was an opportunity to continue studying and refining procedures that were introduced in earlier field trials for both civics and writing. Susan Cooper Loomis, Patricia L. Hanick, & Wen-Ling Yang Achievement Levels 2000
Developing Achievement Levels for the 1998 NAEP in Civics: Final Report This report describes the process for setting the achievement levels. Susan Cooper Loomis and Patricia L. Hanick Achievement Levels 2000
Developing Achievement Levels on the 1998 NAEP in Civics: Validation Research The purpose of the study was to determine whether there was evidence of a reasonable correspondence between the Civics NAEP Achievement Levels Descriptions (ALDs) and the performances of students within achievement levels. Susan Cooper Loomis Achievement Levels 2000
Developing Achievement Levels on the 1998 NAEP in Civics and Writing: Technical Report The work for this report was conducted by ACT, Inc. under contract ZA97001001 with the National Assessment Governing Board. Susan Cooper Loomis and Teri Fisher Achievement Levels 2000
Setting Standards for the 1998 NAEP in Civics and Writing: Finalizing the Achievement Levels Descriptions This report is an account of the process used to finalize the statements of what students should know and be able to do in civics and in writing for the 1998 National Assessment of Educational Progress (NAEP). Susan Cooper Loomis and Patricia L. Hanick Achievement Levels 2000
Student Performance Standards on the National Assessment of Educational Progress: Affirmation and Improvements The articles in this report were commissioned by the Board based on the Achievement Levels Committee’s recommendations. The articles present possible avenues of exploration that could result in fruitful and productive endeavors. The National Assessment Governing Board Achievement Levels 2000
Developing Achievement Levels for the 1998 NAEP in Writing Interim Report: Pilot Study The writing pilot study was a final check on procedures to assure a successful operational Writing NAEP ALS. ACT, Inc. Achievement Levels 2000
Developing Achievement Levels for the 1998 NAEP in Writing: Final Report This report describes the process for setting the achievement levels. ACT, Inc. Achievement Levels 2000
Developing Achievement Levels for the 1998 NAEP in Writing Interim Report: Field Trials This report documents two field trials conducted for writing. Taken together, the field trials research provided important information about various elements that constitute the ACT/NAGB standard-setting process. ACT, Inc. Achievement Levels 2000
Briefing Booklet: 1998 Civics NAEP Achievement Levels-Setting Study We developed this booklet to give panelists information regarding the what, why, when, and how of the different parts of the Achievement Levels-Setting (ALS) Process. The National Assessment Governing Board Achievement Levels 1998
Proceedings of Achievement Levels Workshop The purpose of these proceedings is to explore each component of the assessment, from drawing board to Boardroom, in order to understand more fully the relationships between the performance standards and these assessment components, and the mutual impacts they have on each other. Mary Lyn Bourque Achievement Levels 1997
Setting Achievement Levels on the 1996 National Assessment of Educational Progress in Science: Final Report - Volume III This pilot study was the first step in implementing the process of setting achievement levels for the 1996 Science NAEP. The National Assessment Governing Board Achievement Levels 1997
Setting Achievement Levels on the 1996 National Assessment of Educational Progress in Science: Final Report - Volume II This pilot study was the first step in implementing the process of setting achievement levels for the 1996 Science NAEP. The National Assessment Governing Board Achievement Levels 1997
Setting Achievement Levels on the 1996 National Assessment of Educational Progress in Science: Final Report - Volume I This pilot study was the first step in implementing the process of setting achievement levels for the 1996 Science NAEP. The National Assessment Governing Board Achievement Levels 1997
Papers From the Governing Board. SD/LEP Conference These papers represent a set of research-oriented papers commissioned by NAGB to serve as background information for the conference attendees. Various Special Populations 2004
Technical Panel on 12th Grade Preparedness Research - Final Report The Panel’s deliberative process engaged each Panel member’s expertise to refine ideas; gather supplementary materials; convene representatives of testing companies and partner organizations; and review the advantages and disadvantages of various sources of data. National Assessment Governing Board Academic Preparedness 2009
On NAEP and 12th Grade Preparedness: Discussion Draft of Hypothetical Statements for NAEP Reports At the May 2009 Board meeting, members of the Committee on Standards, Design and Methodology requested that staff prepare examples of statements about 12th grade student preparedness that might be made, based on possible outcomes of the program of research. Ray Fields Assessment Design 2003
Participation Standards for 12th Grade NAEP The National Assessment Governing Board’s new vision for grade 12 NAEP poses serious challenges for dramatically improving response rates at the school and student level as a means to guarantee the quality of NAEP grade 12 estimates. James R. Chromy Academic Preparedness 2005
The Origins of the Preparedness Initiative In 2002, the National Assessment Governing Board established the National Commission on NAEP 12th Grade Assessment and Reporting. This blue-ribbon panel was charged to review the National Assessment of Educational Progress (NAEP) at grade 12 and recommend improvements. National Assessment Governing Board Academic Preparedness 2010
NAEP Testing for Twelfth-Graders: Motivational Issues This commissioned paper draws on theory and research on motivation in education to identify principles that might guide the National Assessment Governing Board’s decision-making concerning twelfth-grade NAEP. Jere Brophy and Carole Ames Academic Preparedness 2005
12th Grade NAEP as a Measure of College and Employment Preparedness Presentation on Determining the technical feasibility of utilizing 12th grade NAEP results as measures of college and career readiness. David T. Conley Academic Preparedness 2009
Design of Content Alignment Studies in Mathematics and Reading for 12th Grade NAEP and Other Assessments The purpose of this paper is to provide a detailed design to guide implementation of content alignment studies for the grade 12 National Assessment of Educational Progress (NAEP) in reading and mathematics with respect to other assessments that the National Assessment Governing Board plans to use to provide indicators for reporting preparedness of 12th graders on NAEP in these subjects. Norman L. Webb Academic Preparedness 2009
Content Alignment Summaries of Preparedness Research Multiple commissioned papers on 12th Grade NAEP. Various Academic Preparedness 2012
12th Grade Student Achievement in America: A New Vision for NAEP The Commission members have concluded that 12th grade NAEP should be redesigned. Twelfth grade NAEP has the potential to supply crucial information about student achievement that America needs and that is unavailable from any other source, but NAEP is not now fulfilling that potential. The National Assessment Governing Board Academic Preparedness 2004
Strategy Planning to Enhance National Assessment Governing Board Outreach Efforts to Parent Leaders The purpose of this White Paper is to assist the National Assessment Governing Board in developing specific strategies to enhance outreach efforts to parent leaders and parent organizations. Peter Davies Outreach 2013
A History of NAEP Assessment Frameworks National Assessment for Educational Progress (NAEP) frameworks describe the content and skills measured on NAEP assessments as well as the design of the assessment. They provide both the “what” and the “how” for national assessment. Carol Jago Frameworks 2009
NAEP 2011 Writing Assessment: Issues in Developing a Framework and Specifications / NAGB This paper is designed as a discussion-starter, attempting to frame a number of issues and debates in writing assessment that could be constructively revisited by the Framework Committees. Arthur N. Applebee Frameworks 2005
NAEP 2009 Science Framework Development: Issues and Recommendations The Science Issues Paper will frame the deliberations of the Framework Steering and Planning Committees, convened by WestEd and the Council of Chief State School Officers (CCSSO) under contract to the National Assessment Governing Board. Audrey Champagne Frameworks 2004
TIME FOR LEARNING: An Exploratory Analysis of NAEP Data and Appendix This Appendix provides a State by State and Urban District analyses of the associate between student absenteeism and NAEP mathematics achievement levels. Alan Ginsburg and Naomi Chudowsky Contextual Data 2012
Monitoring What Matters About Context and Instruction in Science Education: A NAEP Data Analysis Report This report explores background variables in the National Assessment of Educational Progress (NAEP) to examine key context and instructional factors behind science learning for eighth grade students. Alan Friedman and Alan Ginsburg Contextual Data 2013
Key Education Indicators for NAEP: A Composite Indicator Approach This report recommends that the National Assessment of Educational Progress (NAEP) develop ten to 15 composite Key Education Indicators (KEIs) that would be regularly reported along with student achievement results. Alan Ginsburg and Marshall S. Smith Contextual Data 2014
NAEP Background Questions: An Underused National Resource For more than four decades the National Assessment of Educational Progress (NAEP) has tracked the achievement of U.S. students in major academic subjects. This national resource is the only assessment that states and now many urban districts can look to as an objective yardstick of their performance over time, relative to national benchmarks, and compared with other jurisdictions. Marshall S. Smith Contextual Data 2012
Developing a NAEP Indicators Framework: Lessons from Major International and Domestic Education Indicator Reports This is the first of two reports exploring the use of the background data collected by the Nation Assessment of Educational Progress (NAEP) to develop key education indicators at national, state, and urban district system levels. Alan Ginsburg and Marshall S. Smith Contextual Data 2013
Who Attends Charter Schools and How Are Those Students Doing? This report examines what the National Assessment of Educational Progress (NAEP) can tell us about charter school enrollment and student performance compared to that of regular public schools. Naomi Chudowsky and Alan Ginsburg Contextual Data 2012
To Be a Member of The Governing Board The membership of the Board is prescribed in the federal law. Its clear intent is to produce a Board that consists of a diverse group of people from different backgrounds, who are knowledgeable about education. Diane Ravitch Board Operations 2009
Overseeing the Nation's Report Card: The Creation and Evolution of the National Assessment Governing Board This study hopefully will provide a useful introduction to the history of NAGB and stimulate additional research in the near future. Maris A. Vinovskis Board Operations 1998
Ad Hoc Committee on NAEP Parent Engagement: Reaching Parents with NAEP Resources The purpose of this report is to document the work of the Ad Hoc Committee and present its recommendations. Tonya Miles Board Operations 2012
20th Anniversary Conference Proceedings To commemorate 20 years of setting policy for the National Assessment of Educational Progress (NAEP), the National Assessment Governing Board convened a conference in Washington, DC, on March 4, 2009. Sheila Byrd Carmichael Board Operations 2009
NAEP 12th Grade World History Assessment: Issues and Options This paper presents a snapshot of world history education to illuminate the challenges NAGB faces in creating a NAEP world history framework. Robert B. Bain Assessment Design 2004
The NAEP Long-Term Trend Assessment: A Review of Its Transformation, Use, and Findings This paper describes how NAEP’s trend assessment changed, its use in national educational discussions, and its major findings. Lawrence C. Stedman Assessment Design 2009
Setting Achievement Levels on the 2014 NAEP TEL Assessment This White Paper will articulate the various issues where further understanding and research may be helpful in achieving the long-standing NAEP standard-setting goals successfully and efficiently. Mary Lyn Bourque Achievement Levels 2013
A History of NAEP Achievement Levels: Issues, Implementation, and Impact, 1989-2009 A history of the achievement levels for the National Assessment of Educational Progress (NAEP). Mary Lyn Bourque Achievement Levels 2009
Consultant Papers on NAEP Background Questions A collection of consultant papers on NAEP background questions from esteemed individuals in the education system. Various Assessment Design 2003
Contents for a New NAEP Report: The Five Largest States This paper addresses the possible content and organization of a National Assessment Governing Board (NAGB) “Mega Report” based on the most populous five states and the largest metropolitan areas in each of them. Paul E. Barton Assessment Design 2009