Working Paper: NBER ID: w20006
Authors: Theodore J. Joyce; Sean Crockett; David A. Jaeger; Onur Altindag; Stephen D. O'Connell
Abstract: We test whether students in a hybrid format of introductory microeconomics, which met once per week, performed as well as students in a traditional lecture format of the same class, which met twice per week. We randomized 725 students at a large, urban public university into the two formats, and unlike past studies, had a very high participation rate of 96 percent. Two experienced professors taught one section of each format, and students in both formats had access to the same online materials. We find that students in the traditional format scored 2.3 percentage points more on a 100-point scale on the combined midterm and final. There were no differences between formats in non-cognitive effort (attendance, time spent with online materials) nor in withdrawal from the class. Comparing our experimental estimates of the effect of attendance with non-experimental estimates using only students in the traditional format, we find that the non-experimental were 2.5 times larger, suggesting that the large effects of attending lectures found in the previous literature are likely due to selection bias. Overall our results suggest that hybrid classes may offer a cost effective alternative to traditional lectures while having a small impact on student performance.
Keywords: hybrid learning; traditional lectures; student performance; randomized experiment
JEL Codes: I20; I23
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| attendance effects (nonexperimental estimates) (C90) | attendance effects (experimental estimates) (J22) |
| noncognitive effort, attendance, or engagement with online materials (C91) | academic performance (D29) |
| classroom time (A21) | academic performance (D29) |
| traditional format (Y20) | academic performance (D29) |