Research assessment using early citation information

Stephan B. Bruns; David I. Stern

doi:10.1007/s11192-016-1979-1

Research assessment using early citation information

Stephan B. Bruns^*, David I. Stern

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

21 Citations (Scopus)

Abstract

Peer-review based research assessment, as implemented in Australia, the United Kingdom, and some other countries, is a very costly exercise. We show that university rankings in economics based on long-run citation counts can be easily predicted using early citations. This would allow a research assessment to predict the relative long-run impact of articles published by a university immediately at the end of the evaluation period. We compare these citation-based university rankings with the rankings of the 2010 Excellence in Research assessment in Australia and the 2008 Research Assessment Exercise in the United Kingdom. Rank correlations are quite strong, but there are some differences between rankings. However, if assessors are willing to consider citation analysis to assess some disciplines, as is the case for the natural sciences and psychology in Australia, it seems reasonable to consider also including economics in that set.

Original language	English
Pages (from-to)	917-935
Number of pages	19
Journal	Scientometrics
Volume	108
Issue number	2
DOIs	https://doi.org/10.1007/s11192-016-1979-1
Publication status	Published - 1 Aug 2016

Access to Document

10.1007/s11192-016-1979-1

Cite this

@article{59152114dbe44b8e96c89b4135ca1316,

title = "Research assessment using early citation information",

abstract = "Peer-review based research assessment, as implemented in Australia, the United Kingdom, and some other countries, is a very costly exercise. We show that university rankings in economics based on long-run citation counts can be easily predicted using early citations. This would allow a research assessment to predict the relative long-run impact of articles published by a university immediately at the end of the evaluation period. We compare these citation-based university rankings with the rankings of the 2010 Excellence in Research assessment in Australia and the 2008 Research Assessment Exercise in the United Kingdom. Rank correlations are quite strong, but there are some differences between rankings. However, if assessors are willing to consider citation analysis to assess some disciplines, as is the case for the natural sciences and psychology in Australia, it seems reasonable to consider also including economics in that set.",

keywords = "Bibliometrics, Citations, Research assessment",

author = "Bruns, {Stephan B.} and Stern, {David I.}",

note = "Publisher Copyright: {\textcopyright} 2016, Akad{\'e}miai Kiad{\'o}, Budapest, Hungary.",

year = "2016",

month = aug,

day = "1",

doi = "10.1007/s11192-016-1979-1",

language = "English",

volume = "108",

pages = "917--935",

journal = "Scientometrics",

issn = "0138-9130",

publisher = "Akademiai Kiado",

number = "2",

}

TY - JOUR

T1 - Research assessment using early citation information

AU - Bruns, Stephan B.

AU - Stern, David I.

PY - 2016/8/1

Y1 - 2016/8/1

N2 - Peer-review based research assessment, as implemented in Australia, the United Kingdom, and some other countries, is a very costly exercise. We show that university rankings in economics based on long-run citation counts can be easily predicted using early citations. This would allow a research assessment to predict the relative long-run impact of articles published by a university immediately at the end of the evaluation period. We compare these citation-based university rankings with the rankings of the 2010 Excellence in Research assessment in Australia and the 2008 Research Assessment Exercise in the United Kingdom. Rank correlations are quite strong, but there are some differences between rankings. However, if assessors are willing to consider citation analysis to assess some disciplines, as is the case for the natural sciences and psychology in Australia, it seems reasonable to consider also including economics in that set.

AB - Peer-review based research assessment, as implemented in Australia, the United Kingdom, and some other countries, is a very costly exercise. We show that university rankings in economics based on long-run citation counts can be easily predicted using early citations. This would allow a research assessment to predict the relative long-run impact of articles published by a university immediately at the end of the evaluation period. We compare these citation-based university rankings with the rankings of the 2010 Excellence in Research assessment in Australia and the 2008 Research Assessment Exercise in the United Kingdom. Rank correlations are quite strong, but there are some differences between rankings. However, if assessors are willing to consider citation analysis to assess some disciplines, as is the case for the natural sciences and psychology in Australia, it seems reasonable to consider also including economics in that set.

KW - Bibliometrics

KW - Citations

KW - Research assessment

UR - http://www.scopus.com/inward/record.url?scp=84969834651&partnerID=8YFLogxK

U2 - 10.1007/s11192-016-1979-1

DO - 10.1007/s11192-016-1979-1

M3 - Article

SN - 0138-9130

VL - 108

SP - 917

EP - 935

JO - Scientometrics

JF - Scientometrics

IS - 2

ER -

Research assessment using early citation information

Abstract

Access to Document

Other files and links

Fingerprint

Cite this