An Empirical Comparison of the British REF Peer Review and the Italian VQR Bibliometric Algorithm

Working Paper: CEPR ID: DP13521

Authors: Alberto Ciolfi; Daniele Checchi; Gianni De Fraja; Irene Mazzotta; Stefano Verzillo

Abstract: This paper determines the ranking of the publications units of assessment which were submitted to the UK research evaluation carried out in 2014, the REF, which would have been obtained if their submission had been evaluated with the bibliometric algorithm used by the Italian evaluation agency, ANVUR, for its evaluation of the research of Italian universities. We find very high correlation between the two methods, especially in regard to the funding allocation, with a headline figure of 0.9997 for the funding attributed to the institutions.

Keywords: Assessment of academic research; Incentives; University funding; University ranking; Publications; Bibliometry

JEL Codes: I23; I28


Causal Claims Network Graph

Edges that are evidenced by causal inference methods are in orange, and the rest are in light blue.


Causal Claims

CauseEffect
REF peer review (Y30)funding allocation (I22)
ANVUR bibliometric algorithm (C29)funding allocation (I22)
REF peer review (Y30)ANVUR bibliometric algorithm (C29)
ANVUR bibliometric algorithm (C29)REF peer review (Y30)

Back to index