ICT assessment: Moving beyond journal outputs

Linda Butler*

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    24 Citations (Scopus)

    Abstract

    There are increasing moves to deploy quantitative indicators in the assessment of research, particularly in the university sector. In Australia, discussions surrounding their use have long acknowledged the unsuitability of many standard quantitative measures for most humanities, arts, social science, and applied science disciplines. To fill this void, several projects are running concurrently. This paper details the methodology and initial results for one of the projects that aims to rank conferences into prestige tiers, and which is fast gaining a reputation for best practice in such exercises. The study involves a five-stage process: identifying conferences; constructing a preliminary ranking of these; engaging in extensive consultation; testing performance measures based on the rankings on 'live' data; and assessing the measures. In the past, many similar attempts to develop a ranking classification for publication outlets have faltered due to the inability of researchers to agree on a hierarchy. However the Australian experience suggests that when researchers are faced with the imposition of alternative metrics that are far less palatable, consensus is more readily achieved.

    Original languageEnglish
    Pages (from-to)39-55
    Number of pages17
    JournalScientometrics
    Volume74
    Issue number1
    DOIs
    Publication statusPublished - Jan 2008

    Fingerprint

    Dive into the research topics of 'ICT assessment: Moving beyond journal outputs'. Together they form a unique fingerprint.

    Cite this