Overview of the CLEF eHealth evaluation lab 2016

Liadh Kelly; Lorraine Goeuriot; Hanna Suominen; Aurèlie Nèvèol; João Palotti; Guido Zuccon

doi:10.1007/978-3-319-44564-9_24

Overview of the CLEF eHealth evaluation lab 2016

Liadh Kelly^*, Lorraine Goeuriot, Hanna Suominen, Aurèlie Nèvèol, João Palotti, Guido Zuccon

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › peer-review

62 Citations (Scopus)

Abstract

In this paper we provide an overview of the fourth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2016 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins and clinical staff in understanding, accessing and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on handover information extraction related to Australian nursing shift changes, Task 2 on information extraction in French corpora, and Task 3 on multilingual patient-centred information retrieval considering query variations. In total 20 teams took part in these tasks (3 in Task 1, 7 in Task 2 and 10 in Task 3). Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants to this year’s challenges and some results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

Original language	English
Title of host publication	Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings
Editors	Birger Larsen, Linda Cappellato, Nicola Ferro, Norbert Fuhr, Krisztian Balog, Craig Macdonald, Paulo Quaresma, Teresa Gonçalves
Publisher	Springer Verlag
Pages	255-266
Number of pages	12
ISBN (Print)	9783319445632
DOIs	https://doi.org/10.1007/978-3-319-44564-9_24
Publication status	Published - 2016
Event	7th International Conference of the CLEF Association, CLEF 2016 - Evora, Portugal Duration: 5 Sept 2016 → 8 Sept 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9822 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	7th International Conference of the CLEF Association, CLEF 2016
Country/Territory	Portugal
City	Evora
Period	5/09/16 → 8/09/16

Access to Document

10.1007/978-3-319-44564-9_24

Cite this

Kelly, L., Goeuriot, L., Suominen, H., Nèvèol, A., Palotti, J., & Zuccon, G. (2016). Overview of the CLEF eHealth evaluation lab 2016. In B. Larsen, L. Cappellato, N. Ferro, N. Fuhr, K. Balog, C. Macdonald, P. Quaresma, & T. Gonçalves (Eds.), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings (pp. 255-266). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9822 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-44564-9_24

Kelly, Liadh ; Goeuriot, Lorraine ; Suominen, Hanna et al. / Overview of the CLEF eHealth evaluation lab 2016. Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings. editor / Birger Larsen ; Linda Cappellato ; Nicola Ferro ; Norbert Fuhr ; Krisztian Balog ; Craig Macdonald ; Paulo Quaresma ; Teresa Gonçalves. Springer Verlag, 2016. pp. 255-266 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{cb4ed53dd28b42018c378f99245db711,

title = "Overview of the CLEF eHealth evaluation lab 2016",

abstract = "In this paper we provide an overview of the fourth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2016 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins and clinical staff in understanding, accessing and authoring eHealth information in a multilingual setting. This year{\textquoteright}s lab offered three tasks: Task 1 on handover information extraction related to Australian nursing shift changes, Task 2 on information extraction in French corpora, and Task 3 on multilingual patient-centred information retrieval considering query variations. In total 20 teams took part in these tasks (3 in Task 1, 7 in Task 2 and 10 in Task 3). Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants to this year{\textquoteright}s challenges and some results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.",

keywords = "Entity linking, Evaluation, Information extraction, Information retrieval, Medical informatics, Nursing records, Patient handoff/handover, Self-diagnosis, Speech recognition, Test-set generation, Text classification, Text segmentation",

author = "Liadh Kelly and Lorraine Goeuriot and Hanna Suominen and Aur{\`e}lie N{\`e}v{\`e}ol and Jo{\~a}o Palotti and Guido Zuccon",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2016.; 7th International Conference of the CLEF Association, CLEF 2016 ; Conference date: 05-09-2016 Through 08-09-2016",

year = "2016",

doi = "10.1007/978-3-319-44564-9\_24",

language = "English",

isbn = "9783319445632",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "255--266",

editor = "Birger Larsen and Linda Cappellato and Nicola Ferro and Norbert Fuhr and Krisztian Balog and Craig Macdonald and Paulo Quaresma and Teresa Gon{\c c}alves",

booktitle = "Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings",

address = "Germany",

}

Kelly, L, Goeuriot, L, Suominen, H, Nèvèol, A, Palotti, J & Zuccon, G 2016, Overview of the CLEF eHealth evaluation lab 2016. in B Larsen, L Cappellato, N Ferro, N Fuhr, K Balog, C Macdonald, P Quaresma & T Gonçalves (eds), Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9822 LNCS, Springer Verlag, pp. 255-266, 7th International Conference of the CLEF Association, CLEF 2016, Evora, Portugal, 5/09/16. https://doi.org/10.1007/978-3-319-44564-9_24

Overview of the CLEF eHealth evaluation lab 2016. / Kelly, Liadh; Goeuriot, Lorraine; Suominen, Hanna et al.
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings. ed. / Birger Larsen; Linda Cappellato; Nicola Ferro; Norbert Fuhr; Krisztian Balog; Craig Macdonald; Paulo Quaresma; Teresa Gonçalves. Springer Verlag, 2016. p. 255-266 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9822 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › peer-review

TY - GEN

T1 - Overview of the CLEF eHealth evaluation lab 2016

AU - Kelly, Liadh

AU - Goeuriot, Lorraine

AU - Suominen, Hanna

AU - Nèvèol, Aurèlie

AU - Palotti, João

AU - Zuccon, Guido

N1 - Publisher Copyright: © Springer International Publishing Switzerland 2016.

PY - 2016

Y1 - 2016

N2 - In this paper we provide an overview of the fourth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2016 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins and clinical staff in understanding, accessing and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on handover information extraction related to Australian nursing shift changes, Task 2 on information extraction in French corpora, and Task 3 on multilingual patient-centred information retrieval considering query variations. In total 20 teams took part in these tasks (3 in Task 1, 7 in Task 2 and 10 in Task 3). Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants to this year’s challenges and some results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

AB - In this paper we provide an overview of the fourth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2016 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins and clinical staff in understanding, accessing and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on handover information extraction related to Australian nursing shift changes, Task 2 on information extraction in French corpora, and Task 3 on multilingual patient-centred information retrieval considering query variations. In total 20 teams took part in these tasks (3 in Task 1, 7 in Task 2 and 10 in Task 3). Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants to this year’s challenges and some results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

KW - Entity linking

KW - Evaluation

KW - Information extraction

KW - Information retrieval

KW - Medical informatics

KW - Nursing records

KW - Patient handoff/handover

KW - Self-diagnosis

KW - Speech recognition

KW - Test-set generation

KW - Text classification

KW - Text segmentation

UR - https://www.scopus.com/pages/publications/84984804764

U2 - 10.1007/978-3-319-44564-9_24

DO - 10.1007/978-3-319-44564-9_24

M3 - Conference Paper

SN - 9783319445632

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 255

EP - 266

BT - Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings

A2 - Larsen, Birger

A2 - Cappellato, Linda

A2 - Ferro, Nicola

A2 - Fuhr, Norbert

A2 - Balog, Krisztian

A2 - Macdonald, Craig

A2 - Quaresma, Paulo

A2 - Gonçalves, Teresa

PB - Springer Verlag

T2 - 7th International Conference of the CLEF Association, CLEF 2016

Y2 - 5 September 2016 through 8 September 2016

ER -

Kelly L, Goeuriot L, Suominen H, Nèvèol A, Palotti J, Zuccon G. Overview of the CLEF eHealth evaluation lab 2016. In Larsen B, Cappellato L, Ferro N, Fuhr N, Balog K, Macdonald C, Quaresma P, Gonçalves T, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction - 7th International Conference of the CLEF Association, CLEF 2016, Proceedings. Springer Verlag. 2016. p. 255-266. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-44564-9_24

Overview of the CLEF eHealth evaluation lab 2016

Abstract

Publication series

Conference

Access to Document

Other files and links

Cite this