Difficulty to Reach Respondents and Nonresponse Bias: Evidence from Large Government Surveys

Working Paper: NBER ID: w22333

Authors: Ori Heffetz; Daniel B. Reeves

Abstract: How high is unemployment? How low is labor force participation? Is obesity more prevalent among men? How large are household expenditures? We study the sources of the relevant official statistics—the Current Population Survey (CPS), the Behavioral Risk Factor Surveillance System (BRFSS), and the Consumer Expenditure Survey (CEX)—and find that the answers depend on whether we look at easy- or at difficult-to-reach respondents, measured by the number of call and visit attempts made by interviewers. A challenge to the (conditionally-)random-nonresponse assumption, these findings empirically substantiate the theoretical warning against making population-wide estimates from surveys with low response rates.

Keywords: Nonresponse bias; Survey methodology; Labor force participation; Unemployment; Obesity; Household expenditures

JEL Codes: C18; C83; I18; J60


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
reachability (R12)labor force participation (J22)
reachability (R12)unemployment rate (J64)
reachability (R12)obesity prevalence (I14)
reachability (R12)household expenditures (D12)

Back to index