ValueEval'24

[Johannes Kiesel]

Hi all,

ValueEval'24 is part of Touché, which just opened registration! So prepare for another round of human value detection ;)

If you have not found it yet, here is our web page: https://touche.webis.de/clef24/touche24-web/human-value-detection.html

This year we have two sub-tasks, long document, multi-linguality, and further increased awesomeness due to our collaboration with the ValuesML project [1].

Moreover,  we improved our evaluator so that you get a detailed run analysis (including ROC-curves and a table showing which sentences your approach performed worst on) every time you submit. And with our improved submission templates (python script [2] and notebook [3]) your approach can automatically also run as a server application for demo purposes (like [4]).

Don't hesitate to ask more questions here.

We are looking forward to your registration [5] and submission (until May 6, 2024)! Please spread the word, encourage your students, and participate yourself ;)

Regards,

Johannes

PS: Some tweet to show some love: https://twitter.com/KieselJohannes/status/1737036907236700532

[1] https://knowledge4policy.ec.europa.eu/projects-activities/valuesml-unravelling-expressed-values-media-informed-policy-making_en

[2] https://github.com/touche-webis-de/touche-code/tree/main/clef24/human-value-detection/approaches/random-baseline

[3] https://github.com/touche-webis-de/touche-code/tree/main/clef24/human-value-detection/approaches/random-baseline-notebook

[4] https://values.args.me/

[5] https://clef2024-labs-registration.dei.unipd.it/ via Touché -> Human Value Detection