Header

UZH-Logo

Maintenance Infos

Do rankings reflect research quality?


Frey, Bruno S; Rost, Katja (2010). Do rankings reflect research quality? Journal of Applied Economics, 13(1):1-38.

Abstract

Publication and citation rankings have become major indicators of the scientific worth of universities and determine to a large extent the career of individual scholars. Such rankings do not effectively measure research quality, which should be the essence of any evaluation. These quantity rankings are not objective; two citation rankings, based on different samples, produce entirely different results. For that reason, an alternative ranking is developed as a quality indicator, based on membership on academic editorial boards of professional journals. It turns out that the ranking of individual scholars based on that measure is far from objective. Furthermore, the results differ markedly, depending on whether research quantity or quality is considered. Thus, career decisions based on rankings are dominated by chance and do not reflect research quality. We suggest that evaluations should rely on multiple criteria. Public management should return to approved methods such as engaging independent experts who in turn provide measurements of research quality for their research communities.

Abstract

Publication and citation rankings have become major indicators of the scientific worth of universities and determine to a large extent the career of individual scholars. Such rankings do not effectively measure research quality, which should be the essence of any evaluation. These quantity rankings are not objective; two citation rankings, based on different samples, produce entirely different results. For that reason, an alternative ranking is developed as a quality indicator, based on membership on academic editorial boards of professional journals. It turns out that the ranking of individual scholars based on that measure is far from objective. Furthermore, the results differ markedly, depending on whether research quantity or quality is considered. Thus, career decisions based on rankings are dominated by chance and do not reflect research quality. We suggest that evaluations should rely on multiple criteria. Public management should return to approved methods such as engaging independent experts who in turn provide measurements of research quality for their research communities.

Statistics

Citations

39 citations in Web of Science®
42 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

294 downloads since deposited on 04 Feb 2011
63 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Economics
03 Faculty of Economics > Department of Business Administration
Dewey Decimal Classification:330 Economics
Language:English
Date:May 2010
Deposited On:04 Feb 2011 14:44
Last Modified:26 Jan 2017 08:48
Publisher:Elsevier
ISSN:1514-0326
Publisher DOI:https://doi.org/10.1016/S1514-0326(10)60002-5
Official URL:http://www.ucema.edu.ar/publicaciones/jae.html
Related URLs:http://ideas.repec.org/a/cem/jaecon/v13y2010n1p1-38.html

Download

Preview Icon on Download
Preview
Content: Accepted Version
Filetype: PDF
Size: 1MB
View at publisher

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations