Working Paper: NBER ID: w14775
Authors: Marigee Bacolod; John DiNardo; Mireille Jacobson
Abstract: "Accountability mandates" -- the explicit linking of school funding, resources, and autonomy to student performance on standardized exams -- have proliferated in the last 10 years. In this paper, we examine California's accountability system, which for several years financially rewarded schools based on a deterministic function of test scores. The sharp discontinuity in the assignment rule -- schools that barely missed their target received no funding -- generates "as good as random" assignment of awards for schools near their eligibility threshold and enables us to estimate the (local average) treatment effect of California's financial award program. \nThis design allows us to explore an understudied aspect of accountability systems -- how schools use their financial rewards. Our findings indicate that California's accountability system significantly increased resources allocated to some schools. In the 2000 school year, the average value of the award was about 60 dollars per student and 50 dollars in 2001. Moreover, we find that the total resources flowing to districts with schools that received awards increased more than dollar for dollar. This resource shift was greatest for districts with schools that qualified for awards in the 2000 school year,the first year of the program, increasing total per pupil revenues by roughly 5 percent. \nDespite the increase in revenues, we find no evidence that these resources increased student achievement. Schools that won awards did not purchase more instructional material, such as computers, which may be inputs into achievement. Although the awards were likely paid out as teacher bonuses, we cannot detect any effect of these bonuses on test scores or other measures of achievement. More worrisome, we also find a practical effect of assigning the award based in part on the performance of "numerically significant subgroups" within a school was to reduce the relative resources of schools attended by traditionally disadvantaged students.
Keywords: accountability; education; performance-based rewards
JEL Codes: H0; I0; I2; J0; J24
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| California's financial award program (I22) | school resources (I20) |
| California's financial award program (I22) | student achievement (I24) |
| increase in funding (I22) | total resources flowing to districts (H79) |
| total resources flowing to districts (H79) | per pupil revenues (H52) |
| California's financial award program (I22) | instructional materials (Y20) |
| California's financial award program (I22) | teacher bonuses (M52) |
| California's financial award program (I22) | subgroup performance (C92) |