American Economic Review
ISSN 0002-8282 (Print) | ISSN 1944-7981 (Online)
The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools
American Economic Review
vol. 95,
no. 4, September 2005
(pp. 1237–1258)
Abstract
Many programs reward or penalize schools based on students' average performance. Mean reversion is a potentially serious hindrance to the evaluation of such interventions. Chile's 900 Schools Program (P-900) allocated resources based on cutoffs in schools' mean test scores. This paper shows that transitory noise in average scores and mean reversion lead conventional estimation approaches to overstate the impacts of such programs. It further shows how a regression-discontinuity design can be used to control for reversion biases. It concludes that P-900 had significant effects on test score gains, albeit much smaller than is widely believed.Citation
Chay, Kenneth, Y., Patrick J. McEwan, and Miguel Urquiola. 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools." American Economic Review, 95 (4): 1237–1258. DOI: 10.1257/0002828054825529Additional Materials
JEL Classification
- C23 Single Equation Models; Single Variables: Panel Data Models; Spatio-temporal Models
- I21 Analysis of Education
- I28 Education: Government Policy