Working Paper: NBER ID: w1061
Authors: Jerry A. Hausman; David A. Wise
Abstract: The goal of the paper is to set forth general guidelines that we believe would enhance the usefulness of future social experiments and to suggest ways of correcting for inherent limitations of them. Although the major motivation for an experiment is to overcome the inherent limitations of structural econometric models, in many instances the experimental designs have subverted this motivation. The primary advantages of randomized controlled experiments were often lost. The major complication for the analysis of the experiments was induced by an endogenous sample selection and treatment assignment procedure that selected the experimental participants and assigned them to controlversus treatment groups partly on the basis of the variable whose response the experiments were intended to measure. We propose that to overcome these difficulties, the goal of an experimental design should be as nearly as possible to allow analysis based on a simple analysis of variance model. Although complexities attendant to endogenous stratification can be avoided, there are inherent limitations of the experiments that cannot. Two major ones are self-determination of participation and self-selection out, through attrition.But these problems, we believe, can be corrected for with relative ease if endogenous stratification is eliminated. Finally, we propose that as a guiding principle, the experiments should have as a first priority the precise estimation of a single or a small number of treatment effects.
Keywords: social experiments; randomized controlled trials; econometric models; treatment effects
JEL Codes: C93; D04; I38
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| endogenous sample selection and treatment assignment (C90) | biased estimates of treatment effects (C51) |
| self-selection and attrition (C34) | complications in analysis of treatment effects (C22) |
| correcting for biases (C83) | feasible if endogenous stratification is avoided (P39) |
| children more likely to contract polio (J13) | more likely to participate in the Salk vaccine experiment (C90) |
| participation in the Salk vaccine experiment (C90) | exaggeration of perceived effectiveness of the vaccine (I19) |
| randomized controlled experiments (C90) | unbiased estimates of treatment effects (C90) |