Standardizing measurement in psychological studies: On why one second has different value in a sprint versus a marathon

Stephanie C. Goodhew*, Amy Dawel, Mark Edwards

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    15 Citations (Scopus)

    Abstract

    Here we highlight the importance of considering relative performance and the standardization of measurement in psychological research. In particular, we highlight three key analytic issues. The first is the fact that the popular method of calculating difference scores can be misleading because current approaches rely on absolute differences, neglecting what proportion of baseline performance this change reflects. We propose a simple solution of dividing absolute differences by mean levels of performance to calculate a relative measure, much like a Weber fraction from psychophysics. The second issue we raise is that there is an increasing need to compare the variability of effects across studies. The standard deviation score (SD) represents the average amount by which scores differ from their mean, but is sensitive to units, and to where a distribution lies along a measure even when the units are common. We propose two simple solutions to calculate a truly standardized SD (SSD), one for when the range of possible scores is known (e.g., scales, accuracy), and one for when it is unknown (e.g., reaction time). The third and final issue we address is the importance of considering relative performance in applying exclusion criteria to screen overly slow reaction time scores from distributions.

    Original languageEnglish
    Pages (from-to)2338-2348
    Number of pages11
    JournalBehavior Research Methods
    Volume52
    Issue number6
    DOIs
    Publication statusPublished - Dec 2020

    Fingerprint

    Dive into the research topics of 'Standardizing measurement in psychological studies: On why one second has different value in a sprint versus a marathon'. Together they form a unique fingerprint.

    Cite this