Header

UZH-Logo

Maintenance Infos

How much do journal titles tell us about the academic interest and relevance of economic research? An empirical analysis


Schlaepfer, Felix (2009). How much do journal titles tell us about the academic interest and relevance of economic research? An empirical analysis. Working paper series / Socioeconomic Institute No. 917, University of Zurich.

Abstract

Unlike in other disciplines, research output in economics is commonly measured based on the journal titles in which an author has published. Here, I examine how much output measures based on journal titles tell us about the academic interest and relevance of economic papers as measured by citation frequency. Using data from the 2008 Handelsblatt ranking of economists in German speaking countries and interdisciplinary citation data from the Web of Science, I find that researcher scores based on journal titles explain only about one fourth of the variation (variance) in article citations. When the top 10 (20) percent of the researchers according to journal title scores are excluded, the percentage of explained variation in citation frequency drops to 5 (3) percent. These findings empirically confirm the hypothesis that the measures of research output in economics promote narrow and complacent work that is of interest to few, even among an academic audience. They suggest that responsible hiring committees and funding institutions should re-examine existing standards in evaluation and abandon the heavy reliance on journal titles as a measure of individual research output.

Abstract

Unlike in other disciplines, research output in economics is commonly measured based on the journal titles in which an author has published. Here, I examine how much output measures based on journal titles tell us about the academic interest and relevance of economic papers as measured by citation frequency. Using data from the 2008 Handelsblatt ranking of economists in German speaking countries and interdisciplinary citation data from the Web of Science, I find that researcher scores based on journal titles explain only about one fourth of the variation (variance) in article citations. When the top 10 (20) percent of the researchers according to journal title scores are excluded, the percentage of explained variation in citation frequency drops to 5 (3) percent. These findings empirically confirm the hypothesis that the measures of research output in economics promote narrow and complacent work that is of interest to few, even among an academic audience. They suggest that responsible hiring committees and funding institutions should re-examine existing standards in evaluation and abandon the heavy reliance on journal titles as a measure of individual research output.

Statistics

Downloads

609 downloads since deposited on 29 Nov 2011
14 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Working Paper
Communities & Collections:03 Faculty of Economics > Department of Economics
Working Paper Series > Socioeconomic Institute (former)
Dewey Decimal Classification:330 Economics
JEL Classification:A10
Language:English
Date:December 2009
Deposited On:29 Nov 2011 20:09
Last Modified:21 Nov 2017 15:35
Series Name:Working paper series / Socioeconomic Institute
Official URL:http://www.econ.uzh.ch/wp.html

Download

Download PDF  'How much do journal titles tell us about the academic interest and relevance of economic research? An empirical analysis'.
Preview
Filetype: PDF
Size: 185kB