Improving the Targeting of Treatment: Evidence from College Remediation

Working Paper: NBER ID: w18457

Authors: Judith Scott-Clayton; Peter M. Crosta; Clive R. Belfield

Abstract: At an annual cost of roughly $7 billion nationally, remedial coursework is one of the single largest interventions intended to improve outcomes for underprepared college students. But like a costly medical treatment with non-trivial side effects, the value of remediation overall depends upon whether those most likely to benefit can be identified in advance. Our analysis uses administrative data and a rich predictive model to examine the accuracy of remedial screening tests, either instead of or in addition to using high school transcript data to determine remedial assignment. We find that roughly one in four test-takers in math and one in three test-takers in English are severely mis-assigned under current test-based policies, with mis-assignments to remediation much more common than mis-assignments to college-level coursework. We find that using high school transcript information--either instead of or in addition to test scores--could significantly reduce the prevalence of assignment errors. Further, we find that the choice of screening device has significant implications for the racial and gender composition of both remedial and college-level courses. Finally, we find that if institutions took account of students' high school performance, they could remediate substantially fewer students without lowering success rates in college-level courses.

Keywords: remediation; college completion; screening tests; high school transcripts

JEL Codes: H75; I23; J24


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
accuracy of remedial screening tests (C52)student outcomes (A21)
current misassignment rates (J68)underplacement in remediation (I24)
high school transcript information (I21)assignment errors (C78)
screening device choice (C52)racial and gender composition of courses (J79)
considering students' high school performance (D29)number of students remediated (Y10)

Back to index