Selecting the Best When Selection is Hard

Working Paper: CEPR ID: DP17484

Authors: Mikhail Drugov; Margaret Meyer; Marc Möller

Abstract: In dynamic promotion contests, where performance measurement is noisy and constrained to be ordinal, selection of the most able agent can be improved by biasing later stages in favor of early performers. We show that even in the worst-case scenario, where external random factors swamp the difference in agents' abilities in determining their relative performance, optimal bias is (i) strictly positive and (ii) locally insensitive to changes in the ratio of heterogeneity to noise. To explain these, arguably surprising, limiting results, we demonstrate a close relationship in the limit between optimal bias under ordinal information and the expected optimal bias when bias can be conditioned on cardinal information about relative performance. As a consequence of these two limiting properties, the simple rule of setting bias as if in the worst-case scenario achieves most of the potential gains in selective efficiency from biasing dynamic rank-order contests.

Keywords: dynamic contests; selective efficiency; bias; learning; promotions

JEL Codes: D21; D82; D83; M51


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
bias (D91)selection of the most competent individual (D79)
implementation of bias (J71)enhancement of selective efficiency (D61)
bias is locally insensitive to changes in heterogeneity-to-noise ratio (C21)robust relationship (C10)
heuristic approach to bias setting (D91)improved outcomes in selection (C52)

Back to index