Abstract
This paper investigates the effect of real-time performance feedback and competition on the accuracy of crowd-workers for a document relevance assessment task. Through a series of controlled tests, we show that displaying a leaderboard to crowd-workers can motivate them to improve their performance, providing a bonus is offered to the best performing workers. This effect is observed even when test questions are used to enforce quality control during task completion.
Original language | English |
---|---|
Pages (from-to) | 29-36 |
Number of pages | 8 |
Journal | CEUR Workshop Proceedings |
Volume | 1642 |
Publication status | Published - 2016 |
Event | 3rd International Workshop on Gamification for Information Retrieval, GamifIR 2016 - Pisa, Italy Duration: 21 Jul 2016 → … |