Benchmarking Study with Texas College Freshmen: Methodology Report

Technical Documentation for the NAEP Study of First-Year Texas Postsecondary Students 2010 Pilot Test

WESTAT
NATIONAL ASSESSMENT GOVERNING BOARD, 2010, GRADE 12

This report presents the methodology of a study to evaluate the feasibility of administering the 12th grade NAEP reading and math assessments to college freshman at nine Texas colleges to establish reference points for academic preparedness on the NAEP score scale.

The NAEP Study of First-Year Texas Postsecondary Students was designed to help policymakers better understand the academic links between high school and college as they relate to preparedness for postsecondary instruction, as measured by the NAEP 12th grade math and reading assessments. Specifically, this study addresses two key research questions: What points on the NAEP reading and mathematics scales represent knowledge and skills required for entry-level, credit-bearing postsecondary coursework? And, conversely, what points on the NAEP scales are aligned with developmental or remedial instruction?

This report describes the methodology of a 2010 pilot study to evaluate the feasibility of administering the 12th grade NAEP reading and math assessments to incoming first-year postsecondary students at nine public colleges and universities in Texas.

A separate report presents the lessons learned from this project. Several appendices present implementation details:

A: NAEP First-Year Postsecondary Students (FYPS) Sample Questions Booklet, Texas Preparedness Study Literature Review, and Notes from April 20, 2010 Expert Panel Meeting

B: Phase 1 Telephone Interview Guide

C: Implementation Timeline, Sample Data Collection Plan, Student Selection Letter, NAEP FYPS Supervisor Training Agenda, NAEP FYPS Assessment Administrator Training Agenda, NAEP FYPS Field Staff Debriefing Questionnaire

Benchmarking: POSTSECONDARY TEST | COLLEGE FRESHMEN | READING | REMEDIATION | MATHEMATICS | COLLEGE