Working Paper: NBER ID: w17047
Authors: David Card; Stefano Dellavigna; Ulrike Malmendier
Abstract: We propose a new classification of experiments that captures the extent to which the experimental design and analysis are linked to economic theory. We then use this system to classify all published field experiments in the five top economics journals from 1975 to 2010. We find that the vast majority of field experiments (68%) are Descriptive studies that lack any explicit model; 18% are Single Model studies that test a single model-based hypothesis; 6% are Competing Models studies that test competing model-based hypotheses; and 8% are Parameter Estimation studies that estimate structural parameters in a completely specified model. Using the same system to classify laboratory experiments published over the same period, we find that economic theory has played a more central role in the laboratory than in the field. Finally, we discuss in detail three sets of field experiments, on gift exchange, on charitable giving, and on negative income tax, that illustrate both the benefits and the potential costs of a tighter link between experimental design and theoretical underpinnings.
Keywords: field experiments; economic theory; empirical research
JEL Codes: C9; C93
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| Field experiments lack explicit models (C93) | Limited theoretical underpinning in empirical research (C91) |
| Single model-based hypothesis testing (C20) | Varying degrees of theoretical engagement (D80) |
| Competing model-based hypothesis testing (C52) | Varying degrees of theoretical engagement (D80) |
| Parameter estimation studies (C51) | Varying degrees of theoretical engagement (D80) |
| Economic theory in laboratory experiments (C92) | More central role in research (C90) |
| Tighter link between experimental design and theoretical frameworks (C90) | Enhanced understanding of behavioral mechanisms (D91) |
| Overly complex designs (L23) | Obscure clear causal inferences (D80) |