Working Paper: NBER ID: w24412
Authors: Charles J. Courtemanche; Augustine Denteh; Rusty Tchernis
Abstract: Administrative data are considered the “gold standard” when measuring program participation, but little evidence exists on the potential problems with administrative records or their implications for econometric estimates. We explore issues with administrative data using the FoodAPS, a unique dataset that contains two different administrative measures of Supplemental Nutrition Assistance Program (SNAP) participation as well as a survey-based measure. We first document substantial ambiguity in the two administrative participation variables and show that they disagree with each other almost as often as they disagree with self-reported participation. Estimated participation and misreporting rates can be meaningfully sensitive to choices made to resolve this ambiguity and disagreement. We then document similar sensitivity in regression estimates of the associations between SNAP and food insecurity, obesity, and the Healthy Eating Index. These results serve as a cautionary tale about uncritically relying on linked administrative records when conducting program evaluation research.
Keywords: SNAP; Food Insecurity; Obesity; Food Purchases; Administrative Data
JEL Codes: C81; H51; I12; I18
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| SNAP participation (H53) | food insecurity (I32) |
| SNAP participation (H53) | obesity (I12) |
| SNAP participation (H53) | Body Mass Index (BMI) (I32) |
| Different coding strategies for administrative measures (C80) | variability in estimated associations (C20) |
| SNAP participation (H53) | dietary healthfulness (I10) |