Learning When to Quit: An Empirical Model of Experimentation

Working Paper: CEPR ID: DP12733

Authors: Bernhard Ganglmair; Timothy Simcoe; Emanuele Tarantino

Abstract: We study a dynamic model of the decision to continue or abandon a research project. Researchers improve their ideas over time and also learn whether those ideas will be adopted by the scientific community. Projects are abandoned as researchers grow more pessimistic about their chance of success. We estimate the structural parameters of this dynamic decision problem using a novel data set that contains information on both successful and abandoned projects submitted to the Internet Engineering Task Force (IETF), an organization that creates and maintains internet standards. Using the model and parameter estimates, we simulate two counterfactual policies: a cost-subsidy and a prize-based incentive scheme. For a fixed budget, subsidies have a larger impact on research output, but prizes perform better when accounting for researchers' opportunity costs.

Keywords: learning; experimentation; standardization; dynamic discrete choice

JEL Codes: D83; O31; O32


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
Researchers' pessimism about success (D80)Project abandonment (J63)
Number of project revisions (H43)Probability of abandonment (C41)
Cost-subsidy policies (H23)Research output (O36)
Prize-based incentive schemes (J33)Research output (O36)
Cost-subsidy policies and Prize-based incentive schemes (H23)Research output (O36)

Back to index