Eliciting People's First-Order Concerns: Text Analysis of Open-Ended Survey Questions

Working Paper: CEPR ID: DP16929

Authors: Stefanie Stantcheva; Beatrice Ferrario

Abstract: This paper illustrates the design and use of open-ended survey questions as a way of eliciting people's first-order concerns on policies. Multiple choice questions are the backbone of most surveys, but they may prime respondents to select answer options that they would not naturally have thought about, and they may omit relevant options. Open-ended questions that do not constrain respondents with specific answer choices are a valuable tool for eliciting first-order thinking. We discuss three text analysis methods to analyze open-ended questions' answers. To illustrate how to apply these methods, we provide evidence from large-scale surveys on income and estate taxation. We show the that key concerns relate mostly to distribution issues, fairness, and government, rather than to efficiency concerns. There are large partisan gaps in the first-order concerns on policies.

Keywords: surveys; open-ended questions; preferences; political economy; taxation

JEL Codes: H20; D72; D91


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Open-ended questions (C99)Elicit first-order concerns about taxation (H26)
Partisan differences in political affiliation (D72)Divergent views on taxation (H29)
Concerns about government spending and efficiency (H59)Less prominent compared to fairness and distribution (D30)

Back to index