The Impact of Joint versus Separate Prediction Mode on Forecasting Accuracy

Working Paper: NBER ID: w30611

Authors: Alex Imas; Minah H. Jung; Silvia Saccardo; Joachim Vosgerau

Abstract: Forecasters predicting how people change their behavior in response to a treatment or intervention often consider a set of alternatives. In contrast, those who are treated are typically exposed to only one of the treatment alternatives. For example, managers selecting a wage schedule consider a set of alternative wages while employees are hired at a given rate. We show that forecasts made in joint-prediction mode—which considers a set of alternatives—generate predictions that expect substantially larger behavioral responses than those made in separate-prediction mode—which considers the response to only one treatment realization in isolation. Results show the latter to be more accurate in matching people’s actual responses to interventions and treatment changes. We present applications to managerial decision-making and forecasting of scientific results.

Keywords: forecasting; prediction modes; behavioral responses; decision-making

JEL Codes: D0; D9


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Joint prediction mode (C53)Larger expected behavioral responses to wage increases (J39)
Separate prediction mode (C53)More accurate forecasts (C53)
Joint prediction mode (C53)Overestimation of the impact of incentive schemes (J33)
Separate prediction mode (C53)Aligning forecasters' mental models with agents (C53)
Joint prediction mode (C53)Higher wage choices than profit-maximizing levels (J38)

Back to index