CLEF 2017 eHealth evaluation lab overview

Lorraine Goeuriot, Liadh Kelly, Hanna Suominen*, Aurélie Névéol, Aude Robert, Evangelos Kanoulas, Rene Spijker, João Palotti, Guido Zuccon

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    68 Citations (Scopus)

    Abstract

    In this paper we provide an overview of the fifth edition of the CLEF eHealth evaluation lab. CLEF eHealth 2017 continues our evaluation resource building efforts around the easing and support of patients, their next-of-kins, clinical staff, and health scientists in understanding, accessing, and authoring eHealth information in a multilingual setting. This year’s lab offered three tasks: Task 1 on multilingual information extraction to extend from last year’s task on French corpora, Task 2 on technologically assisted reviews in empirical medicine as a new pilot task, and Task 3 on patient-centered information retrieval (IR) building on the 2013-16 IR tasks. In total 32 teams took part in these tasks (11 in Task 1, 14 in Task 2, and 7 in Task 3). We also continued the replication track from 2016. Herein, we describe the resources created for these tasks, evaluation methodology adopted and provide a brief summary of participants of this year’s challenges and results obtained. As in previous years, the organizers have made data and tools associated with the lab tasks available for future research and development.

    Original languageEnglish
    Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 8th International Conference of the CLEF Association, CLEF 2017, Proceedings
    EditorsLorraine Goeuriot, Julio Gonzalo, Gareth J.F. Jones, Liadh Kelly, Thomas Mandl, Linda Cappellato, Nicola Ferro, Seamus Lawless
    PublisherSpringer Verlag
    Pages291-303
    Number of pages13
    ISBN (Print)9783319658124
    DOIs
    Publication statusPublished - 2017
    Event8th International Conference of the CLEF Association, CLEF 2017 - Dublin, Ireland
    Duration: 11 Sept 201714 Sept 2017

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume10456 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference8th International Conference of the CLEF Association, CLEF 2017
    Country/TerritoryIreland
    CityDublin
    Period11/09/1714/09/17

    Cite this