Working Paper: NBER ID: w28241
Authors: Joshua Angrist; Peter Hull; Parag A. Pathak; Christopher R. Walters
Abstract: Many large urban school districts match students to schools using algorithms that incorporate an element of random assignment. We introduce two simple empirical strategies to harness this randomization for value-added models (VAMs) measuring the causal effects of individual schools. The first estimator controls for the probability of being offered admission to different schools, treating the take-up decision as independent of potential outcomes. Randomness in school assignments is used to test this key conditional independence assumption. The second estimator uses randomness in offers to generate instrumental variables (IVs) for school enrollment. This procedure uses a low-dimensional model of school quality mediators to solve the under-identification challenge arising from the fact that some schools are under-subscribed. Both approaches relax the assumptions of conventional value-added models while obviating the need for elaborate nonlinear estimators. In applications to data from Denver and New York City, we find that models controlling for both assignment risk and lagged achievement yield highly reliable VAM estimates. Estimates from models with fewer controls and older lagged score controls are improved markedly by IV.
Keywords: value-added models; school assignment; causal inference; instrumental variables
JEL Codes: C11; C21; C26; C52; I21; I28; J24
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| RC VAM (C26) | selection bias control (C83) |
| school assignment propensity scores (C90) | selection bias control (C83) |
| random assignment of students to schools (C90) | RC VAM (C26) |
| RC VAM (C26) | valid VAM estimates (C26) |
| RC VAM (C26) | mean-squared error (MSE) reduction (C52) |
| IV VAM (C26) | under-identification problem (D80) |
| school value-added (D46) | mediating school characteristics (I24) |
| IV VAM (C26) | valid VAM estimates (C26) |
| IV VAM (C26) | estimates with fewer controls (C51) |