Working Paper: NBER ID: w25626
Authors: Raj Chetty; John N. Friedman
Abstract: We develop a simple method to reduce privacy loss when disclosing statistics such as OLS regression estimates based on samples with small numbers of observations. We focus on the case where the dataset can be broken into many groups (“cells”) and one is interested in releasing statistics for one or more of these cells. Building on ideas from the differential privacy literature, we add noise to the statistic of interest in proportion to the statistic's maximum observed sensitivity, defined as the maximum change in the statistic from adding or removing a single observation across all the cells in the data. Intuitively, our approach permits the release of statistics in arbitrarily small samples by adding sufficient noise to the estimates to protect privacy. Although our method does not offer a formal privacy guarantee, it generally outperforms widely used methods of disclosure limitation such as count-based cell suppression both in terms of privacy loss and statistical bias. We illustrate how the method can be implemented by discussing how it was used to release estimates of social mobility by Census tract in the Opportunity Atlas. We also provide a step-by-step guide and illustrative Stata code to implement our approach.
Keywords: privacy; statistics; small samples; differential privacy
JEL Codes: C0; H0
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
Cause | Effect |
---|---|
noise infusion method (C26) | privacy loss (K24) |
noise added is inversely proportional to number of observations (C29) | release of meaningful statistics (C80) |
noise infusion method (C26) | unbiased estimates (C51) |
noise infusion method (C26) | relationship between teenage birth rates and single parent shares (J12) |
traditional disclosure limitation methods (count-based cell suppression) (C80) | uncontrolled privacy risks (K24) |