Test set and the submission system

28 views
Skip to first unread message

cagri coltekin

unread,
Apr 25, 2024, 6:20:38 PMApr 25
to Ideology and Power in Parliamentary Speeches
Dear all,

A bit later than planned, but the test set and submission system
is now ready. Test data is released at

https://zenodo.org/doi/10.5281/zenodo.11061649.

You can now submit your result through TIRA [1]. The submission
information is updated at the shared task web page [2].

You can either submit prediction files (runs) or Docker
containers with your software computing the predictions. We have
also updated the baseline and the evaluation script [3] to be
compatible with the TIRA docker submissions.

Please do not hesitate to ask here if you have any questions, or
let us know if you discover any problems. For the questions
regarding the submission system please use TIRA forum [4].

Thank you all for the interest!

Best wishes,
Cagri

[1] https://www.tira.io/task-overview/ideology-and-power-identification-in-parliamentary-debates-2024/
[2] https://touche.webis.de/clef24/touche24-web/ideology-and-power-identification-in-parliamentary-debates.html#submission
[3] https://github.com/coltekin/ideology-power-st-baseline
[4] https://www.tira.io/c/touche/

Reply all
Reply to author
Forward
0 new messages