Short Run Impacts of Accountability on School Quality

Working Paper: NBER ID: w14564

Authors: Jonah E. Rockoff; Lesley J. Turner

Abstract: In November of 2007, the New York City Department of Education assigned elementary and middle schools a letter grade (A to F) under a new accountability system. Grades were based on numeric scores derived from student achievement and other school environmental factors such as attendance, and were linked to a system of rewards and consequences. We use the discontinuities in the assignment of grades to estimate the impact of accountability in the short run. Specifically, we examine student achievement in English Language Arts and mathematics (measured in January and March of 2008, respectively) using school level aggregate data. Although schools had only a few months to respond to the release of accountability grades, we find that receipt of a low grade significantly increased student achievement in both subjects, with larger effects in math. We find no evidence that these grades were related to the percentage of students tested, implying that accountability can cause real changes in school quality that increase student achievement over a short time horizon. We also find that parental evaluations of educational quality improved for schools receiving low accountability grades. However, changes in survey response rates hold open the possibility of selection bias in these complementary results.

Keywords: accountability; school quality; student achievement; New York City

JEL Codes: H52; H75; I21; I28; L38


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Accountability grades (M48)Student achievement (I24)
Receiving a low grade (D or F) (Y40)Student achievement in English (I24)
Receiving an F grade (Y20)Math scores (C12)
Receiving a D grade (Y40)Math scores (C12)

Back to index