TY - GEN
T1 - Overview of the CLEF eHealth Evaluation Lab 2021
AU - Suominen, Hanna
AU - Goeuriot, Lorraine
AU - Kelly, Liadh
AU - Alemany, Laura Alonso
AU - Bassani, Elias
AU - Brew-Sam, Nicola
AU - Cotik, Viviana
AU - Filippo, Darío
AU - González-Sáez, Gabriela
AU - Luque, Franco
AU - Mulhem, Philippe
AU - Pasi, Gabriella
AU - Roller, Roland
AU - Seneviratne, Sandaru
AU - Upadhyay, Rishabh
AU - Vivaldi, Jorge
AU - Viviani, Marco
AU - Xu, Chenchen
N1 - Publisher Copyright:
© 2021, Springer Nature Switzerland AG.
PY - 2021
Y1 - 2021
N2 - In this paper, we provide an overview of the ninth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2021 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, health care professionals, and health scientists in understanding, accessing, and authoring electronic health information in a multilingual setting. The 2021 lab offered two tasks: Task 1 on multilingual Information Extraction (IE), this year extending to a corpus of Spanish radiology reports; and Task 2 on Consumer Health Search (CHS) that builds on the previous year’s Information Retrieval (IR) tasks. In total, 11 teams took part in these tasks (7 in Task 1 on IE and 4 in Task 2 on IR). Herein, we describe the resources created for these tasks and the evaluation methodology adopted, and we provide a brief summary of the participants of this year’s challenges as well as the results obtained. As in previous years, the organizers have made data, tools, and more specific overview papers associated with the lab tasks available for future research and development.
AB - In this paper, we provide an overview of the ninth annual edition of the CLEF eHealth evaluation lab. CLEF eHealth 2021 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, health care professionals, and health scientists in understanding, accessing, and authoring electronic health information in a multilingual setting. The 2021 lab offered two tasks: Task 1 on multilingual Information Extraction (IE), this year extending to a corpus of Spanish radiology reports; and Task 2 on Consumer Health Search (CHS) that builds on the previous year’s Information Retrieval (IR) tasks. In total, 11 teams took part in these tasks (7 in Task 1 on IE and 4 in Task 2 on IR). Herein, we describe the resources created for these tasks and the evaluation methodology adopted, and we provide a brief summary of the participants of this year’s challenges as well as the results obtained. As in previous years, the organizers have made data, tools, and more specific overview papers associated with the lab tasks available for future research and development.
KW - Entity linking
KW - Evaluation
KW - Health records
KW - Information extraction
KW - Information retrieval
KW - Medical informatics
KW - Self-diagnosis
KW - Test-set generation
KW - Text classification
KW - Text segmentation
UR - http://www.scopus.com/inward/record.url?scp=85113513018&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-85251-1_21
DO - 10.1007/978-3-030-85251-1_21
M3 - Conference contribution
SN - 9783030852504
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 308
EP - 323
BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction - 12th International Conference of the CLEF Association, CLEF 2021, Proceedings
A2 - Candan, K. Selçuk
A2 - Ionescu, Bogdan
A2 - Goeuriot, Lorraine
A2 - Larsen, Birger
A2 - Müller, Henning
A2 - Joly, Alexis
A2 - Maistro, Maria
A2 - Piroi, Florina
A2 - Faggioli, Guglielmo
A2 - Ferro, Nicola
PB - Springer Science and Business Media Deutschland GmbH
T2 - 12th International Conference of the Cross-Language Evaluation Forum for European Languages, CLEF 2021
Y2 - 21 September 2021 through 24 September 2021
ER -