Test set and the submission system

[cagri coltekin]

Dear all,

A bit later than planned, but the test set and submission system
is now ready. Test data is released at

https://zenodo.org/doi/10.5281/zenodo.11061649.

You can now submit your result through TIRA [1]. The submission
information is updated at the shared task web page [2].

You can either submit prediction files (runs) or Docker
containers with your software computing the predictions. We have
also updated the baseline and the evaluation script [3] to be
compatible with the TIRA docker submissions.

Please do not hesitate to ask here if you have any questions, or
let us know if you discover any problems. For the questions
regarding the submission system please use TIRA forum [4].

Thank you all for the interest!

Best wishes,
Cagri

[1] https://www.tira.io/task-overview/ideology-and-power-identification-in-parliamentary-debates-2024/
[2] https://touche.webis.de/clef24/touche24-web/ideology-and-power-identification-in-parliamentary-debates.html#submission
[3] https://github.com/coltekin/ideology-power-st-baseline
[4] https://www.tira.io/c/touche/