When Do Informational Interventions Work? Experimental Evidence from New York City High School Choice

Working Paper: NBER ID: w29690

Authors: Sarah Cohodes; Sean Corcoran; Jennifer Jennings; Carolyn Sattinbajaj

Abstract: This paper reports the results of a large, school-level randomized controlled trial evaluating a set of three informational interventions for young people choosing high schools in 473 middle schools, serving over 115,000 8th graders. The interventions differed in their level of customization to the student and their mode of delivery (paper or online); all treated schools received identical materials to scaffold the decision-making process. Every intervention reduced likelihood of application to and enrollment in schools with graduation rates below the city median (75 percent). An important channel is their effect on reducing nonoptimal first choice application strategies. Providing a simplified, middle-school specific list of relatively high graduation rate schools had the largest impacts, causing students to enroll in high schools with 1.5-percentage point higher graduation rates. Providing the same information online, however, did not alter students’ choices or enrollment. This appears to be due to low utilization. Online interventions with individual customization, including a recommendation tool and search engine, induced students to enroll in high schools with 1-percentage point higher graduation rates, but with more variance in impact. Together, these results show that successful informational interventions must generate engagement with the material, and this is possible through multiple channels.

Keywords: Informational Interventions; High School Choice; Randomized Controlled Trial; New York City

JEL Codes: D83; H75; I21; I24


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Engagement with intervention materials (Y20)Successful outcomes in enrollment (I24)
Informational interventions (D83)Reduced likelihood of applying to schools with graduation rates below city median (I23)
Informational interventions (D83)Reduced likelihood of enrolling in schools with graduation rates below city median (I24)
Providing high school lists (I21)Enrolling in schools with graduation rates approximately 15 percentage points higher (I23)
Online interventions with individual customization (C91)Slight increase in enrollment in higher graduation rate schools (I23)
Informational interventions (D83)Reductions of enrollment in low graduation rate schools by 51 to 61 percentage points (I21)

Back to index