Working Paper: NBER ID: w25217
Authors: Isaiah Andrews; Matthew Gentzkow; Jesse M. Shapiro
Abstract: We propose a way to formalize the relationship between descriptive analysis and structural estimation. A researcher reports an estimate ĉ of a structural quantity of interest c that is exactly or asymptotically unbiased under some base model. The researcher also reports descriptive statistics γ̂ that estimate features γ of the distribution of the data that are related to c under the base model. A reader entertains a less restrictive model that is local to the base model, under which the estimate ĉ may be biased. We study the reduction in worst-case bias from a restriction that requires the reader's model to respect the relationship between c and γ specified by the base model. Our main result shows that the proportional reduction in worst-case bias depends only on a quantity we call the informativeness of γ̂ for ĉ. Informativeness can be easily estimated even for complex models. We recommend that researchers report estimated informativeness alongside their descriptive analyses, and we illustrate with applications to three recent papers.\n\n\n
Keywords: Descriptive Statistics; Structural Estimates; Informativeness; Bias Reduction
JEL Codes: C18; D12; I13; I25
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| Reporting descriptive statistics (C29) | Reduction in worst-case bias in structural estimates (C51) |
| Informativeness (D83) | Reduction in worst-case bias in structural estimates (C51) |
| Informativeness (D83) | Confidence in structural estimates (C51) |
| Descriptive statistics (C29) | Structural estimates (C51) |