Working Paper: NBER ID: w29768
Authors: Magne Mogstad; Joseph P. Romano; Azeem Shaikh; Daniel Wilhelm
Abstract: Economists are obsessed with rankings of institutions, journals, or scholars according to the value of some feature of interest. These rankings are invariably computed using estimates rather than the true values of such features. As a result, there may be considerable uncertainty concerning the ranks. In this paper, we consider the problem of accounting for such uncertainty by constructing confidence sets for the ranks. We consider both the problem of constructing marginal confidence sets for the rank of, say, a particular journal as well as simultaneous confidence sets for the ranks of all journals. We apply these confidence sets to draw inferences about uncertainty in the ranking of economics journals and universities by impact factors.
Keywords: ranking; journals; universities; statistical uncertainty; confidence sets
JEL Codes: A0; C12
Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.
| Cause | Effect |
|---|---|
| true journal impact factors (A14) | estimated ranks (C51) |
| estimated ranks (C51) | interpretation by researchers and policymakers (D78) |
| confidence sets (D80) | reliability of rankings (A14) |