Can Online Off-the-Shelf Lessons Improve Student Outcomes? Evidence from a Field Experiment

Working Paper: NBER ID: w22398

Authors: C. Kirabo Jackson; Alexey Makarin

Abstract: There has been a proliferation of websites that warehouse instructional materials designed to be taught by teachers in a traditional classroom. While this new technology has revolutionized how most teachers plan their lessons, the potential benefits of this innovation are unknown. To present evidence on this, we analyze an experiment in which middle-school math teachers were randomly given access to high-quality “off-the-shelf” lessons. Only providing teachers with online access to the lessons increased students’ math achievement by 0.06 of a standard deviation, but providing teachers with online access to the lessons along with supports to promote their use increased students’ math achievement by 0.09 of a standard deviation. Benefits were much larger for weaker teachers, suggesting that weaker teachers compensated for skill deficiencies by substituting the lessons for their own efforts. Survey evidence suggests that these effects were mediated by both improvements in lesson quality and teachers having more time to engage in other tasks. We rationalize these results with a multitask model of teaching. The intervention is more scalable and cost effective than most policies aimed at improving teacher quality, suggesting a real benefit to making high-quality instructional materials available to teachers on the internet.

Keywords: education; teacher quality; student outcomes; field experiment

JEL Codes: I20; J00; J48


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Weaker teachers (I24)Larger effects from lesson access (C92)
Improved lesson quality (A21)Student math achievement (I24)
Increased teacher engagement (A21)Improved lesson quality (A21)
Access to mathalicious lessons (C02)Improved lesson quality (A21)
Access to mathalicious lessons (C02)Increased teacher engagement (A21)
Access to mathalicious lessons (C02)Student math achievement (I24)

Back to index