[CfP] TREC Health Misinformation Track 2022

17 views
Skip to first unread message

Maria Maistro

unread,
Aug 12, 2022, 11:43:41 AMAug 12
to Machine Learning News
Call for Participation - TREC Health Misinformation Track 2022
https://trec-health-misinfo.github.io

Overview ๐Ÿง
--------------------------
Web search engines are frequently used to help people make decisions about health-related issues. Unfortunately, the web is filled with misinformation regarding the efficacy of treatments for health issues. Search users may not be able to discern correct from incorrect information, nor credible from non-credible sources. As a result of finding misinformation deemed by the user to be useful to their decision making task, they can make incorrect decisions that waste money and put their health at risk.

The TREC Health Misinformation track fosters research on retrieval methods that promote reliable and correct information over misinformation for health-related decision making tasks.

Tasks ๐Ÿ’ผ
--------------------------
* Ad-hoc Retrieval Task: design a ranking model that promotes credible and correct information over incorrect information;
* Answer Prediction Task: predict the answer to the topicโ€™s stance.

Guidelines ๐Ÿ“‹
--------------------------
* Corpus: noclean version of the C4 dataset (https://huggingface.co/datasets/allenai/c4);
* Topics: about consumer health search (people seeking health advice online);
* Runs: runs may be either automatic or manual with the standard TREC run format.

Detailed guidelines: https://trec-health-misinfo.github.io

Important Dates ๐Ÿ”ฅ
--------------------------
* Runs due from participants: August 28, 2022
* Evaluation results returned: End of September 2022
* Notebook paper due: October 2022
* TREC 2022 Conference: November 14-18, 2022
* Final paper due: February 2023

Organization ๐Ÿ‘”
--------------------------
* Charles Clarke, University of Waterloo
* Maria Maistro, University of Copenhagen
* Mark Smucker, University of Waterloo
Reply all
Reply to author
Forward
0 new messages