TY - JOUR
T1 - Overview of the CLEF eHealth 2020 Task 2
T2 - 11th Conference and Labs of the Evaluation Forum, CLEF 2020
AU - Goeuriot, Lorraine
AU - Suominen, Hanna
AU - Kelly, Liadh
AU - Liu, Zhengyang
AU - Pasi, Gabriella
AU - Saez, Gabriela Gonzalez
AU - Viviani, Marco
AU - Xu, Chenchen
N1 - Publisher Copyright:
Copyright © 2020 for this paper by its authors.
PY - 2020
Y1 - 2020
N2 - In this paper, we provide an overview of the CLEF eHealth Task 2 on Information Retrieval (IR), organized as part of the eighth annual edition of the CLEF eHealth evaluation lab by the Conference and Labs of the Evaluation Forum. Its aim was to address laypeople’s difficulties in retrieving and digesting valid and relevant information, in their preferred language, to make health-centred decisions. The task was a novel extension of the most popular and established task in CLEF eHealth on Consumer Health Search (CHS), which makes responses to spoken ad-hoc queries. In total, five submissions were made to its two subtasks; three addressed the ad-hoc IR task on text data and two considered the spoken queries. Herein, we describe the resources created for the task and evaluation methodology adopted. We also summarize lab submissions and results. As in previous years, organizers have made data, methods, and tools associated with the lab tasks available for future research and development.
AB - In this paper, we provide an overview of the CLEF eHealth Task 2 on Information Retrieval (IR), organized as part of the eighth annual edition of the CLEF eHealth evaluation lab by the Conference and Labs of the Evaluation Forum. Its aim was to address laypeople’s difficulties in retrieving and digesting valid and relevant information, in their preferred language, to make health-centred decisions. The task was a novel extension of the most popular and established task in CLEF eHealth on Consumer Health Search (CHS), which makes responses to spoken ad-hoc queries. In total, five submissions were made to its two subtasks; three addressed the ad-hoc IR task on text data and two considered the spoken queries. Herein, we describe the resources created for the task and evaluation methodology adopted. We also summarize lab submissions and results. As in previous years, organizers have made data, methods, and tools associated with the lab tasks available for future research and development.
KW - Dimensions of relevance
KW - EHealth
KW - Evaluation
KW - Health records
KW - Information storage and retrieval
KW - Medical informatics
KW - Self-diagnosis
KW - Speech recognition
KW - Test-set generation
UR - http://www.scopus.com/inward/record.url?scp=85121776854&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85121776854
SN - 1613-0073
VL - 2696
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
Y2 - 22 September 2020 through 25 September 2020
ER -