(apologies for multiple postings)
==========================================================
CLEF eHealth Evaluation Lab 2018
Lab registration now open at
http://clef2018-labs-registration.dei.unipd.it/
Held as part of CLEF 2018, September 10-14 2018, Avignon - France
In today’s information overloaded society it is increasingly difficult
to retrieve and digest valid and relevant information to make
health-centered decisions. Medical content is becoming available
electronically in a variety of forms ranging from patient records and
medical dossiers, scientific publications and health-related websites to
medical-related topics shared across social networks. Laypeople,
clinicians and policy-makers need to easily retrieve, and make sense of
medical content to support their decision making. Information retrieval
systems have been commonly used as a means to access health information
available online. However, the reliability, quality, and suitability of
the information for the target audience varies greatly while high recall
or coverage, that is finding all relevant information about a topic, is
often as important as high precision, if not more. Furthermore, the
information seekers in the health domain also experience difficulties in
expressing their information needs as search queries.
CLEF eHealth aims to bring together researchers working on related
information access topics and provide them with datasets to work with
and validate the outcomes. This, the sixth year of the lab, offers the
following three tasks.
Task 1. Multilingual Information Extraction
Task 2. Technologically Assisted Reviews in Empirical Medicine
Task 3. Patient-centred Information Retrieval
The lab also offers a student mentoring track. Contact the lab chairs if you are interested in taking part in this track.
Please register at
http://clef2018-labs-registration.dei.unipd.it/
and see
https://sites.google.com/view/clef-ehealth-2018 for full details.
The vision for the Lab is two-fold: (1) to develop tasks that
potentially impact patient understanding of medical information and (2)
to provide the community with an increasingly sophisticated dataset of
clinical narrative, enriched with links to evidence-based care
guidelines, systematic reviews, and other further information, to
advance the state-of-the-art in multilingual information extraction and
information retrieval in health care. Furthermore, we aim to support
reproducible research by encouraging participants to reflect on methods
and practical steps to take to facilitate the replication of their
experiments. In particular, we call participants to submit their systems
and configuration files, and independent researchers to reproduce the
results of the participating teams.
CLEF eHealth for You
===========================================================
The tasks are open to everybody. We particularly welcome academic and
industrial researchers, scientists, engineers and graduate students in
information retrieval, natural language processing, machine learning and
biomedical/health informatics to participate. We also encourage
participation by multidisciplinary teams that combine technological
skills with clinical expertise.
For students: annotated data; methods and code for processing and
evaluation to lower the entry barrier; evaluation results, benchmarked
against other participants and organisers’ methods; student mentoring;
working notes paper; professional networks
For supervisors: tasks with data, methods, code, evaluations, and
mentoring for your student theses/projects or course assignments;
working notes paper that can be extended to journal/conference papers;
and professional networks
For researchers: annotated data; methods and code for processing and
evaluation to lower the entry barrier; evaluation results, benchmarked
against other participants and organisers’ methods; working notes paper
that can be extended to journal/conference papers; and professional
networks
For engineers/industrial participants: annotated data; methods and code
for processing and evaluation to lower the entry barrier; evaluation
results, benchmarked against other participants and organisers’ methods;
repeatable evaluations to test your software on; and professional
networks
CLEF eHealth Contacts
===========================================================
CLEF eHealth Chairs: Lorraine Goeuriot (lorraine.goeuriot [at]
imag.fr),
Liadh Kelly (liadh.kelly [at]
mu.ie), and Hanna Suominen
(hanna.suominen [at]
anu.edu.au)
Task 1 Leaders: Aurélie Névéol (aurelie.neveol [at]
limsi.fr) , Lionel
Ramadier (lionel.ramadier[at]
limsi.fr), and Aude Robert (aude.robert
[at]
inserm.fr)
Task 2 Leaders: Leif Azzopardi (leif.azzopardi [at]
uni.strath.ac.uk),
Evangelos Kanoulas (E.Kanoulas [at]
uva.nl), and Rene Spijker
(renespijker [at]
gmail.com)
Task 3 Leaders: Joao Palotti (joaopalotti [at]
gmail.com) and Guido Zuccon (g.zuccon [at]
qut.edu.au)
Forum:
https://groups.google.com/forum/#!forum/clef-ehealth-evaluation-lab-information